-- Logs begin at Wed 2022-07-27 10:05:07 UTC, end at Wed 2022-07-27 11:16:12 UTC. -- Jul 27 10:34:36.576575 dv-cinder-850840-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 10:34:36.583988 dv-cinder-850840-3-smb devstack@keystone.service[86609]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 10:34:36 2022] *** Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: nodename: dv-cinder-850840-3-smb Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: machine: x86_64 Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: clock source: unix Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: pcre jit disabled Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: detected number of CPU cores: 4 Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: current working directory: / Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: detected binary path: /usr/bin/uwsgi-core Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: your processes number limit is 47680 Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: your memory page size is 4096 bytes Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: detected max file descriptor number: 2048 Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: lock engine: pthread robust mutexes Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: thunder lock: enabled Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 10:34:36.589152 dv-cinder-850840-3-smb devstack@keystone.service[86609]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 10:34:36.626816 dv-cinder-850840-3-smb devstack@keystone.service[86609]: Python main interpreter initialized at 0x5632bdaf99c0 Jul 27 10:34:36.626816 dv-cinder-850840-3-smb devstack@keystone.service[86609]: python threads support enabled Jul 27 10:34:36.626816 dv-cinder-850840-3-smb devstack@keystone.service[86609]: your server socket listen backlog is limited to 100 connections Jul 27 10:34:36.626816 dv-cinder-850840-3-smb devstack@keystone.service[86609]: your mercy for graceful operations on workers is 90 seconds Jul 27 10:34:36.627281 dv-cinder-850840-3-smb devstack@keystone.service[86609]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 10:34:36.627281 dv-cinder-850840-3-smb devstack@keystone.service[86609]: *** Operational MODE: preforking *** Jul 27 10:34:36.627545 dv-cinder-850840-3-smb devstack@keystone.service[86609]: *** uWSGI is running in multiple interpreter mode *** Jul 27 10:34:36.627545 dv-cinder-850840-3-smb devstack@keystone.service[86609]: spawned uWSGI master process (pid: 86609) Jul 27 10:34:36.627757 dv-cinder-850840-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 27 10:34:36.634214 dv-cinder-850840-3-smb devstack@keystone.service[86609]: spawned uWSGI worker 1 (pid: 86616, cores: 1) Jul 27 10:34:36.634214 dv-cinder-850840-3-smb devstack@keystone.service[86609]: spawned uWSGI worker 2 (pid: 86617, cores: 1) Jul 27 10:34:36.634214 dv-cinder-850840-3-smb devstack@keystone.service[86609]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 10:34:42.229625 dv-cinder-850840-3-smb devstack@keystone.service[86617]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 10:34:42.229625 dv-cinder-850840-3-smb devstack@keystone.service[86617]: from cryptography.utils import int_from_bytes Jul 27 10:34:42.230432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 10:34:42.230432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: from cryptography.utils import int_from_bytes Jul 27 10:34:42.230539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 10:34:42.230539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: from cryptography.utils import int_from_bytes Jul 27 10:34:42.230539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 10:34:42.230539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: from cryptography.utils import int_from_bytes Jul 27 10:34:42.280720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 10:34:42.281099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 10:34:42.281322 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 10:34:42.281517 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 10:34:42.281604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] command line args: [] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 10:34:42.281688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] command line args: [] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 10:34:42.281806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 10:34:42.281903 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 10:34:42.281973 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ================================================================================ {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 10:34:42.282033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ================================================================================ {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 10:34:42.282033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] admin_token = **** {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.282147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] admin_token = **** {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.282241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] config_dir = [] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.282381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] config_dir = [] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.282456 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.282577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.282638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] config_source = [] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.282708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] config_source = [] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.282768 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] debug = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.282830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] debug = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.282894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.283251 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.283251 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.283703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.283810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.283914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.284023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.284129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.284224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.284456 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.284573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] list_limit = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.284731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] list_limit = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.284731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] log_config_append = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.284924 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] log_config_append = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.285077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.285156 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.285418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] log_dir = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.285553 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] log_dir = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.285647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] log_file = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.285775 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] log_file = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.285858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.285936 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.286064 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.286277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.286372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.286447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.287199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.287917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.288006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.288125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.288216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.288333 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.288419 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.288531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.288608 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.288677 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.288788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.288908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.288988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.289104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.289179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.289306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.289384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.289499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.289499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.289697 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.289777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.289904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.289986 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.290105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.290203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.290279 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.290415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] publish_errors = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.290494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] publish_errors = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.290574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.290654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.290731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.290803 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.290925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.291006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.291084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.291173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.291254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.291332 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.291404 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] standard_threads = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.291520 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] standard_threads = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.291646 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.291721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.291797 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.291869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.291939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.292063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.292153 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] use_journal = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.292226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] use_journal = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.292302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] use_json = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.292379 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] use_json = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.292456 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] use_stderr = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.292539 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] use_stderr = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.292611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] use_syslog = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.292682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] use_syslog = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.292751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.292821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 10:34:42.292890 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.292968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.293046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.293118 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.293188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.293257 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.293328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.293456 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.293539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.293616 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.293687 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.293757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.293826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.293907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.294018 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.294108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.294298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.294378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.294551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.294644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.294804 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.294883 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.295044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.295124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.295291 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.295377 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.295531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.295613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.295785 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.295865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.296034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.296190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.296272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.296350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.296518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.296598 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.296772 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.296859 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.297021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.297105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.297259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.297337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.297515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.297601 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.297775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.297852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.298032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.298109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.298313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.298410 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.298553 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.298631 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.298787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.298865 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.299022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.299108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.299262 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.299339 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.299516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.299593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.299766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.299851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.300000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.300077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.300233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.300317 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.300485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.300564 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.300734 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.300811 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.300975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.301052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.301226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.301305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.301460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.301537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.301696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.301773 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.301919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.301993 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.302159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.302303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.302420 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.302498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.302656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.302742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.302985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.303077 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.303197 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.303276 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.303454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.303543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.303693 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.303775 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.303934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.304013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.304168 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.304249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.304411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.304492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.304653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.304775 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.304908 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.305032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.305140 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.305273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.305394 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.305531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.305643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.305744 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.305842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.305979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.306091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.306308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.306428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.306530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.306629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.306789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.306906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.307032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.307123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.307273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.307353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.307507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.307597 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.307745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.307874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.308002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.308124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.308238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.308346 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.308480 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.308658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.308744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.308981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.309061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.309224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.309302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.309480 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.309568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.309731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.309813 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.309974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.310048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.310243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.310340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.310539 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.310673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.310757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.310877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.311208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.311293 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.311434 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.311516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.311680 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.311760 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.311922 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.312004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.312239 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.312400 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.312481 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.312641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.312727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.312876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.312954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.313115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.313193 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.313359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.313446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.313599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.313677 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.313840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.313926 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.314088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.314263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.314342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.314413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.314581 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.314662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.314821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.314909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.315058 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.315153 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.315294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.315374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.315528 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.315607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.315763 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.315848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.316003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.316092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.316236 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.316323 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.316543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.316649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.316732 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.316805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.316951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.317087 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.317204 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.317292 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.317450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.317529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.317695 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.317773 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.317932 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] auth.external = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.318020 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.318169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.318316 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.318449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] auth.external = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.318540 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.318742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.318852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.318982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] auth.password = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.319109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.319335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] auth.token = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.319420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.319493 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.319571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] auth.password = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.319659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.319758 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] auth.token = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.319912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.320000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.320151 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.320233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.320405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.320496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.320659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.320740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.320898 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.320979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.321140 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] credential.caching = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.321223 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.321395 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.321475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.321635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] credential.caching = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.321713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.321887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.321980 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.322130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.322230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.322406 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.322498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.322650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.322731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.322904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.322984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.323148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.323228 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.323399 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.323481 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.323659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.323739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.323900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.323979 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.324163 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.324244 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.324438 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.324517 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.324686 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.324766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.324949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.325031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.325190 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] federation.caching = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.325276 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.325433 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.325511 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.325678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] federation.caching = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.325758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.325923 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.326003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.326168 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.326275 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.326446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.326527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.326685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.326764 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.326943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.327022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.327184 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.327281 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.327443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.327523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.327682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.327762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.327942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.328028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.328181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity.caching = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.328260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.328435 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.328515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.328668 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity.caching = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.328744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.328916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.329006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.329153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.329240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.329402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.329481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.329633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.329711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.329876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.329964 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.330113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.330216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.330385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.330466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.330636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.330727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.330874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.330955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.331112 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.331192 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.331348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.331435 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.331589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.331669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.331837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.331916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.332089 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.332176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.332338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.332418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.332596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.332675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.332846 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.332936 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.333089 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.333170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.333327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.333407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.333569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.333658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.333806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.333885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.334043 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.334703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.334852 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.334995 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.335084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.335166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.335338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.335538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.335617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.335793 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.335875 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.336053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.336139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.336288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.336367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.336541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.336623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.336793 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.336872 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.337025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.337104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.337269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.337350 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.337505 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.337585 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.337744 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.337823 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.337982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.338064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.338236 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.338321 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.338486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.338566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.338724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.338806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.338971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.339050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.339218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.339297 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.339450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.339531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.339685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.339766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.339938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.340024 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.340173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.340254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.340411 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.340491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.340648 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.340726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.340890 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.340972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.341127 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.341208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.341368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.341447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.341614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.341697 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.341848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.341917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.342092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.342178 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.342382 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.342463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.342623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.342703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.342879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.342971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.343111 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.343190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.343353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.343433 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.343594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.343686 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.343828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.343907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.344060 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.344139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.344300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.344387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.344544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.344624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.344788 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.344868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.345042 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.345166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.345299 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.345422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.345555 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.345667 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.345919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.346011 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.346164 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.346263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.346432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.346512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.346674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.346766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.346915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.346996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.347158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.347237 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.347405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.347493 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.347641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.347721 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.347894 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.347972 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.348127 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.348214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.348379 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.348459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.348619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.348700 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.348868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.349001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.349107 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.349186 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.349347 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.349426 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.349591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.349679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.350446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.350660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.350740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.350907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] resource.caching = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.350987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.351165 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.351287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.351419 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.351534 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.351662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.351791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.351917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.352021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] resource.caching = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.352171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.352285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.352413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.352545 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.352667 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.352808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.352892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.353057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.353137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.353317 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.353471 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] role.caching = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.353548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.353621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] role.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.353807 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.353887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.354053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.354142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.354326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.354408 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.354573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] role.caching = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.354654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.354821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.354914 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] role.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.355064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.355144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.355312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.355391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.355566 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.355655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.355816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.355897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.356053 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.356133 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.356306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.356387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.356553 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.356632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.356803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.356883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.357051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.357137 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.357301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.357518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.357594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.357723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.357814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.357979 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.358061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.358260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.358346 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.358520 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.358694 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.358778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.358941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.359022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.359200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.359281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.359458 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.359540 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.359714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.359794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.359953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.360034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.360191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.360274 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.360445 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.360534 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.360683 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.360771 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.360925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.361007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.361167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.361247 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.361407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.361494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.361641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.361721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.361871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.361950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.362113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] token.caching = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.362220 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.362391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.362472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.362643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.362723 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.362882 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.362973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.363123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.363205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.363368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] token.caching = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.363448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.363605 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.363692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.363855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.363936 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.364095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.364174 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.364344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.364431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.364587 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.364667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.364828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.364907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.365063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.365150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.365314 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.365514 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.365597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.365710 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.365817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.365993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.366075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.366264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.366372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.366510 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.366638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.connection = **** {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.366769 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.366889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.367025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.367142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.367264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.367385 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.367516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.367631 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.367819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.367902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.368088 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.connection = **** {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.368177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.368322 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.368404 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.368563 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.368653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.368811 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.368891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.369050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.369129 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.369288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.369375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.369525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.369604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.369763 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.369842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.370003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.370090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.370274 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.370355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.370510 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.370589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.370757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.370849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.370996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.371075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.371169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 10:34:42.371250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.371481 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.371734 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.371972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.372219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.372462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 10:34:42.372641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86616) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 10:34:42.401354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.401568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.401653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.401848 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.401994 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.402126 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.410344 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.410488 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.441617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.441896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.442056 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.442247 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.496533 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.496883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.548864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.549176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.550092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.550438 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.616873 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.617139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.617298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.617436 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.617588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.617720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.617850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.617977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.618105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.618271 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.618400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.618528 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.641871 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.642212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.642418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.642584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.642747 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.642903 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.643058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.643222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.643376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.643528 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.643679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.643841 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.643994 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.644175 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.654987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.655196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.668465 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.668797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.668982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.669146 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.669436 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.669605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.669780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.670003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.670230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.670488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.670666 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86617) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.670787 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.670787 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.670787 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86616) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 10:34:42.688382 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.688605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.688605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 10:34:42.688793 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 10:34:42.688916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.689002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.689122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 10:34:42.689204 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 10:34:42.689394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.689476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.689722 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.689818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.689938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.690019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.690157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.690328 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.700784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.701018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.701112 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.701301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.701387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.701575 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.701661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.701861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.708702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.708928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.714369 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.714639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.714896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.714993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.715168 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.715269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.715457 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.715540 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.715741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.715823 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.716009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.716096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.716234 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.716318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.716523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.716617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.716824 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.716903 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.717036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.717119 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.717304 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.717583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.741587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.742649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.743164 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.743449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.744204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.744504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.748286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.748587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.748856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.749235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.749600 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.749892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.755582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.755827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.757012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.757335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.760238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.760532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.760826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.761115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.761400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.761665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.761763 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.761957 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.762041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.762252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.762350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.762572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.762827 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.763131 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.763390 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.763701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.779017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.779300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.780755 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.781036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.783319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.785026 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.786533 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.786835 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.788858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.789154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.793612 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.796846 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.800092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.800391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.800687 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.800977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.801261 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.801555 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.802587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.806098 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.809538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.809836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.810136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.810473 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.810737 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.811297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.818918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.819201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.819470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.819742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.826904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.827970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.828240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.828395 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.828511 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.828681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.828791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.831527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.831851 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.832155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.832449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.832743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.836570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.838135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.838437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.841386 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.841668 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.841968 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.842288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.842575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.845083 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.845362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.845642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.845926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.846226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.846511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.846797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.855420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.855702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.855990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.856270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.856559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.856826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.857112 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.863344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.866724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.869627 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.872295 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.873899 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.874019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.874219 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.874464 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.877012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.880111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.881242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.882906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.883018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.884701 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.884988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.885279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.885860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.886154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.886473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.886758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.892241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.893873 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.895031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.895324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.895608 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.897528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.897825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.898106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.898420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.903255 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86617) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.903535 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.903822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.904106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.904415 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.904657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.904940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.905237 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.905673 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.905962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.906268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.906537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.906826 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.906916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.907087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86617) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.907179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.907449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.917283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86616) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 10:34:42.917736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.918217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.918674 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.919126 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.919588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.920046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.920592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.921103 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.921568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.922044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.922518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.922998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.923442 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86616) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 10:34:42.942704 dv-cinder-850840-3-smb devstack@keystone.service[86617]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632bdaf99c0 pid: 86617 (default app) Jul 27 10:34:42.946303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f6b6e-791c-4649-a564-3c19b10e5759 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:42.946597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f6b6e-791c-4649-a564-3c19b10e5759 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:42.946875 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f6b6e-791c-4649-a564-3c19b10e5759 None None] PATH_INFO: `/v3` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:42.951196 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Wed Jul 27 10:34:42 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:34:42.961873 dv-cinder-850840-3-smb devstack@keystone.service[86616]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632bdaf99c0 pid: 86616 (default app) Jul 27 10:34:50.713351 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0937ab0-fc86-44bb-ac70-2aed5836e63b None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:50.713922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0937ab0-fc86-44bb-ac70-2aed5836e63b None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:50.713922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0937ab0-fc86-44bb-ac70-2aed5836e63b None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:50.715270 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:34:50.722640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269825e-9e60-4b92-9639-7f1f3155cd8b None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:50.723088 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269825e-9e60-4b92-9639-7f1f3155cd8b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:50.723249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269825e-9e60-4b92-9639-7f1f3155cd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:50.794653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: INFO dbcounter [None req-e269825e-9e60-4b92-9639-7f1f3155cd8b None None] Registered counter for database keystone Jul 27 10:34:50.816641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG oslo_db.sqlalchemy.engines [None req-e269825e-9e60-4b92-9639-7f1f3155cd8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86616) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 10:34:50.823114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writer thread running {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 10:34:51.000470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG passlib.handlers.bcrypt [None req-e269825e-9e60-4b92-9639-7f1f3155cd8b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86616) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 10:34:51.000798 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG passlib.handlers.bcrypt [None req-e269825e-9e60-4b92-9639-7f1f3155cd8b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86616) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 10:34:51.055588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e269825e-9e60-4b92-9639-7f1f3155cd8b None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:34:51.057188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e269825e-9e60-4b92-9639-7f1f3155cd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:34:51.181770 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1/3] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:34:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 10:34:51.308760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0937ab0-fc86-44bb-ac70-2aed5836e63b None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:51.377606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: INFO dbcounter [None req-d0937ab0-fc86-44bb-ac70-2aed5836e63b None None] Registered counter for database keystone Jul 27 10:34:51.397049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG oslo_db.sqlalchemy.engines [None req-d0937ab0-fc86-44bb-ac70-2aed5836e63b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 10:34:51.403425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writer thread running {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 10:34:51.522563 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0937ab0-fc86-44bb-ac70-2aed5836e63b None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:34:51.527072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5b62d-ddb7-43db-9558-bef0d2be909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:34:51.527703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5b62d-ddb7-43db-9558-bef0d2be909d admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:51.527984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5b62d-ddb7-43db-9558-bef0d2be909d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:51.528258 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5b62d-ddb7-43db-9558-bef0d2be909d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:51.536353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5b62d-ddb7-43db-9558-bef0d2be909d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:34:51.589556 dv-cinder-850840-3-smb devstack@keystone.service[86617]: WARNING keystone.common.rbac_enforcer.enforcer [None req-09a5b62d-ddb7-43db-9558-bef0d2be909d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 10:34:51.589831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5b62d-ddb7-43db-9558-bef0d2be909d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:34:51.599754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 3/4] 10.222.0.43 () {58 vars in 1324 bytes} [Wed Jul 27 10:34:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 10:34:51.605904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269825e-9e60-4b92-9639-7f1f3155cd8b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:51.623021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269825e-9e60-4b92-9639-7f1f3155cd8b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:34:51.627558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd868c69-0799-4c2d-bc6f-382ec7de5521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:34:51.628682 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd868c69-0799-4c2d-bc6f-382ec7de5521 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:51.628970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd868c69-0799-4c2d-bc6f-382ec7de5521 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:51.629246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd868c69-0799-4c2d-bc6f-382ec7de5521 admin admin] PATH_INFO: `/v3/projects/4c0fb163aada45c0be9fae56f3795bdd` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:51.631604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd868c69-0799-4c2d-bc6f-382ec7de5521 admin admin] RBAC: Authorizing `identity:get_project(project_id=4c0fb163aada45c0be9fae56f3795bdd)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:34:51.682558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bd868c69-0799-4c2d-bc6f-382ec7de5521 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 10:34:51.682904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd868c69-0799-4c2d-bc6f-382ec7de5521 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:34:51.687866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 2/5] 10.222.0.43 () {56 vars in 1207 bytes} [Wed Jul 27 10:34:51 2022] GET /identity/v3/projects/4c0fb163aada45c0be9fae56f3795bdd => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:34:53.684148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c64c89-8110-4c10-8c99-bbeba33ab9d6 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:53.684708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c64c89-8110-4c10-8c99-bbeba33ab9d6 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:53.684708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c64c89-8110-4c10-8c99-bbeba33ab9d6 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:53.689013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 4/6] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:34:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:34:53.695433 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf67a27-19dd-4f3a-b71e-9836780b2260 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:53.695883 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf67a27-19dd-4f3a-b71e-9836780b2260 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:53.695977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf67a27-19dd-4f3a-b71e-9836780b2260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:53.716698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-cbf67a27-19dd-4f3a-b71e-9836780b2260 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:34:53.718278 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-cbf67a27-19dd-4f3a-b71e-9836780b2260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:34:53.726476 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 3/7] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:34:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 27 10:34:53.748434 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c64c89-8110-4c10-8c99-bbeba33ab9d6 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:53.761709 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c64c89-8110-4c10-8c99-bbeba33ab9d6 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:34:53.765987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1b3b6-a7c1-4607-939c-d4698c0f8daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:34:53.766620 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1b3b6-a7c1-4607-939c-d4698c0f8daa admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:53.766909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1b3b6-a7c1-4607-939c-d4698c0f8daa admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:53.767188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1b3b6-a7c1-4607-939c-d4698c0f8daa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:53.775796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1b3b6-a7c1-4607-939c-d4698c0f8daa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:34:53.777589 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1b3b6-a7c1-4607-939c-d4698c0f8daa admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:34:53.786405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 5/8] 10.222.0.43 () {58 vars in 1324 bytes} [Wed Jul 27 10:34:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 10:34:53.791929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf67a27-19dd-4f3a-b71e-9836780b2260 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:53.801077 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf67a27-19dd-4f3a-b71e-9836780b2260 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:34:53.805533 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0c0d8-2c04-4016-b68c-93ad3062321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:34:53.806166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0c0d8-2c04-4016-b68c-93ad3062321f admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:53.806479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0c0d8-2c04-4016-b68c-93ad3062321f admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:53.806755 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0c0d8-2c04-4016-b68c-93ad3062321f admin admin] PATH_INFO: `/v3/users/877c11b74f674bd1b8410ffe1d18db3e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:53.808120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0c0d8-2c04-4016-b68c-93ad3062321f admin admin] RBAC: Authorizing `identity:get_user(user_id=877c11b74f674bd1b8410ffe1d18db3e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:34:53.809929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0c0d8-2c04-4016-b68c-93ad3062321f admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:34:53.811819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 4/9] 10.222.0.43 () {56 vars in 1198 bytes} [Wed Jul 27 10:34:53 2022] GET /identity/v3/users/877c11b74f674bd1b8410ffe1d18db3e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:34:55.887471 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd230ff-406a-4587-bdd5-107899a018ff None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:55.887951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd230ff-406a-4587-bdd5-107899a018ff None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:55.888050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd230ff-406a-4587-bdd5-107899a018ff None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:55.891574 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:34:55.894749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfe1cd-1c36-4588-9923-004d6979e062 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:55.895163 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfe1cd-1c36-4588-9923-004d6979e062 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:55.895310 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfe1cd-1c36-4588-9923-004d6979e062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:55.915376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-d9dfe1cd-1c36-4588-9923-004d6979e062 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:34:55.916580 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d9dfe1cd-1c36-4588-9923-004d6979e062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:34:55.924587 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e3ac7-ff2c-439e-84dd-22fc50528de4 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:55.924901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e3ac7-ff2c-439e-84dd-22fc50528de4 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:55.925177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e3ac7-ff2c-439e-84dd-22fc50528de4 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:55.926537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 7/11] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:34:55.932337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3c87d-2455-43d1-ad82-7db178b5ff19 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:55.932623 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3c87d-2455-43d1-ad82-7db178b5ff19 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:55.932902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3c87d-2455-43d1-ad82-7db178b5ff19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:55.976166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG passlib.handlers.bcrypt [None req-3fb3c87d-2455-43d1-ad82-7db178b5ff19 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86617) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 10:34:55.976644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG passlib.handlers.bcrypt [None req-3fb3c87d-2455-43d1-ad82-7db178b5ff19 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86617) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 10:34:55.999896 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 5/12] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:34:56.022127 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-3fb3c87d-2455-43d1-ad82-7db178b5ff19 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:34:56.022602 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfe1cd-1c36-4588-9923-004d6979e062 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:56.023756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3fb3c87d-2455-43d1-ad82-7db178b5ff19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:34:56.046703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:34:56.125901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 8/13] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:34:56.129793 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfe1cd-1c36-4588-9923-004d6979e062 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:34:56.147941 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3c87d-2455-43d1-ad82-7db178b5ff19 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:56.164259 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a952f-95a7-40d5-a0cb-ab09aa9eec8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:34:56.164928 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a952f-95a7-40d5-a0cb-ab09aa9eec8a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:56.165213 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a952f-95a7-40d5-a0cb-ab09aa9eec8a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:56.165491 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a952f-95a7-40d5-a0cb-ab09aa9eec8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:56.176804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a952f-95a7-40d5-a0cb-ab09aa9eec8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-038a952f-95a7-40d5-a0cb-ab09aa9eec8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:34:56.186753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:34:56.187810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:34:56.188634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:34:56.188634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:34:56.188634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:34:56.188634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:34:56.188634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:34:56.188634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:34:56.188634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:34:56.188634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:34:56.188634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:34:56.188634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:34:56.188634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:34:56.188634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:34:56.188634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 6/14] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:34:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:34:56.195353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a952f-95a7-40d5-a0cb-ab09aa9eec8a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:56.252331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3c87d-2455-43d1-ad82-7db178b5ff19 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:34:56.254649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:34:56.280950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:34:56.291614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc89da9-ae26-4d8c-9ade-cf819a540d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:34:56.292513 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89da9-ae26-4d8c-9ade-cf819a540d9b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:56.292807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89da9-ae26-4d8c-9ade-cf819a540d9b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:56.293088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89da9-ae26-4d8c-9ade-cf819a540d9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:56.300134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a952f-95a7-40d5-a0cb-ab09aa9eec8a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:34:56.337078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540ad12-b083-40fe-a074-e0cb8f4efdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:34:56.337762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540ad12-b083-40fe-a074-e0cb8f4efdc5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:56.338078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540ad12-b083-40fe-a074-e0cb8f4efdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:56.338384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540ad12-b083-40fe-a074-e0cb8f4efdc5 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:56.339131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540ad12-b083-40fe-a074-e0cb8f4efdc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:34:56.339432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540ad12-b083-40fe-a074-e0cb8f4efdc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:34:56.340841 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540ad12-b083-40fe-a074-e0cb8f4efdc5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:34:56.354067 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 7/15] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:34:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:34:56.359809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540ad12-b083-40fe-a074-e0cb8f4efdc5 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:56.368130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc89da9-ae26-4d8c-9ade-cf819a540d9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:34:56.369666 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc89da9-ae26-4d8c-9ade-cf819a540d9b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:34:56.465240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540ad12-b083-40fe-a074-e0cb8f4efdc5 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:34:56.470849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 9/16] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:34:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 10:34:56.477018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc89da9-ae26-4d8c-9ade-cf819a540d9b None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:56.480289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:34:56.585371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc89da9-ae26-4d8c-9ade-cf819a540d9b None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:34:56.606124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a0bce-2507-4d0c-bc6c-fcf5d9a8de39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:34:56.606796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a0bce-2507-4d0c-bc6c-fcf5d9a8de39 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:56.607092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a0bce-2507-4d0c-bc6c-fcf5d9a8de39 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:56.607364 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a0bce-2507-4d0c-bc6c-fcf5d9a8de39 None admin] PATH_INFO: `/v3/users/877c11b74f674bd1b8410ffe1d18db3e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:56.608546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a0bce-2507-4d0c-bc6c-fcf5d9a8de39 None admin] RBAC: Authorizing `identity:get_user(user_id=877c11b74f674bd1b8410ffe1d18db3e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:34:56.610006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a0bce-2507-4d0c-bc6c-fcf5d9a8de39 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:34:56.611641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 8/17] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:34:56 2022] GET /identity/v3/users/877c11b74f674bd1b8410ffe1d18db3e => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:34:56.617709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a0bce-2507-4d0c-bc6c-fcf5d9a8de39 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:56.626105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52b02-a79e-48fb-aa6d-027d28c444b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:34:56.627003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52b02-a79e-48fb-aa6d-027d28c444b0 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:56.627284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52b02-a79e-48fb-aa6d-027d28c444b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:56.627556 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d52b02-a79e-48fb-aa6d-027d28c444b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:56.638213 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:34:56.647699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d52b02-a79e-48fb-aa6d-027d28c444b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:34:56.649234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d52b02-a79e-48fb-aa6d-027d28c444b0 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-22d52b02-a79e-48fb-aa6d-027d28c444b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:34:56.668285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:34:56.669309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:34:56.670121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:34:56.670121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:34:56.670121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:34:56.670121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:34:56.670121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:34:56.675376 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52b02-a79e-48fb-aa6d-027d28c444b0 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:56.727734 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a0bce-2507-4d0c-bc6c-fcf5d9a8de39 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:34:56.732600 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:34:56.761816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd13cf5-97f4-48c2-84a2-94b3ecbc04fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:34:56.762525 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd13cf5-97f4-48c2-84a2-94b3ecbc04fc None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:56.762806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd13cf5-97f4-48c2-84a2-94b3ecbc04fc None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:56.763081 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd13cf5-97f4-48c2-84a2-94b3ecbc04fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:56.764242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd13cf5-97f4-48c2-84a2-94b3ecbc04fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:34:56.765671 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd13cf5-97f4-48c2-84a2-94b3ecbc04fc None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:34:56.767284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:34:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:34:56.773284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd13cf5-97f4-48c2-84a2-94b3ecbc04fc None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:56.778696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d52b02-a79e-48fb-aa6d-027d28c444b0 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:34:56.812772 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce30906-2515-4889-8696-c47df1343cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:34:56.813396 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce30906-2515-4889-8696-c47df1343cc0 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:56.813681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce30906-2515-4889-8696-c47df1343cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:56.813961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce30906-2515-4889-8696-c47df1343cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:56.814703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce30906-2515-4889-8696-c47df1343cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:34:56.815013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce30906-2515-4889-8696-c47df1343cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:34:56.816407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce30906-2515-4889-8696-c47df1343cc0 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:34:56.834966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:34:56.859605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:34:56.882014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd13cf5-97f4-48c2-84a2-94b3ecbc04fc None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:34:56.923310 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa566a-b67d-4791-a2cb-c2bf261ab8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:34:56.924003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa566a-b67d-4791-a2cb-c2bf261ab8dc None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:56.924221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa566a-b67d-4791-a2cb-c2bf261ab8dc None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:56.924626 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa566a-b67d-4791-a2cb-c2bf261ab8dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:56.925321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa566a-b67d-4791-a2cb-c2bf261ab8dc None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.domain.id=default, user.id=877c11b74f674bd1b8410ffe1d18db3e) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:34:56.925637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa566a-b67d-4791-a2cb-c2bf261ab8dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:34:56.927814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa566a-b67d-4791-a2cb-c2bf261ab8dc None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:34:56.935549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1322 bytes} [Wed Jul 27 10:34:56 2022] GET /identity/v3/role_assignments?user.id=877c11b74f674bd1b8410ffe1d18db3e&scope.domain.id=default&role.id=36208a24005e4ff98d827138292bea37 => generated 233 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:34:59.209386 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38315d83-97de-4395-a1fa-254b4fdc2253 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:59.210453 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38315d83-97de-4395-a1fa-254b4fdc2253 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:59.211011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38315d83-97de-4395-a1fa-254b4fdc2253 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:59.212838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:34:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:34:59.218671 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a371a18-5cf3-4231-8416-d47585b95ae4 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:59.219503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a371a18-5cf3-4231-8416-d47585b95ae4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:59.219960 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a371a18-5cf3-4231-8416-d47585b95ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:59.247427 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-7a371a18-5cf3-4231-8416-d47585b95ae4 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:34:59.249012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-7a371a18-5cf3-4231-8416-d47585b95ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:34:59.350263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:34:59.396299 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38315d83-97de-4395-a1fa-254b4fdc2253 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:59.537404 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38315d83-97de-4395-a1fa-254b4fdc2253 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:34:59.543473 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a8b82-e1bd-43ac-a22d-f203c93b73d3 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:59.544013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a8b82-e1bd-43ac-a22d-f203c93b73d3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:59.544491 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a8b82-e1bd-43ac-a22d-f203c93b73d3 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:59.547571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:34:59.552556 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabd88b-560f-473c-9508-115f8129892c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:59.553232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabd88b-560f-473c-9508-115f8129892c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:59.553718 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabd88b-560f-473c-9508-115f8129892c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:59.580934 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:34:59.596145 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-cfabd88b-560f-473c-9508-115f8129892c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:34:59.597353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-cfabd88b-560f-473c-9508-115f8129892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:34:59.631611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c031e-149f-4a6d-bd82-ff71677e187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:34:59.632305 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c031e-149f-4a6d-bd82-ff71677e187d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:59.632594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c031e-149f-4a6d-bd82-ff71677e187d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:59.632878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c031e-149f-4a6d-bd82-ff71677e187d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:59.660136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c031e-149f-4a6d-bd82-ff71677e187d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-864c031e-149f-4a6d-bd82-ff71677e187d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:34:59.667037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:34:59.667987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:34:59.668747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:34:59.668747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:34:59.668747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:34:59.668747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:34:59.668747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:34:59.668747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:34:59.668747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:34:59.668747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:34:59.668747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:34:59.668747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:34:59.668747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:34:59.668747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:34:59.674726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 13/25] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:34:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:34:59.680624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c031e-149f-4a6d-bd82-ff71677e187d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:59.758775 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 13/26] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:34:59.765816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7574f-be93-42c7-8f7c-48559afc82fb None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:59.766107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7574f-be93-42c7-8f7c-48559afc82fb None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:59.766658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7574f-be93-42c7-8f7c-48559afc82fb None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:59.767988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 14/27] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:34:59.773856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08d29c-e5de-4e73-bb07-a8941f829118 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:59.774141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08d29c-e5de-4e73-bb07-a8941f829118 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:59.774441 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08d29c-e5de-4e73-bb07-a8941f829118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:59.782511 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:34:59.804102 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-6e08d29c-e5de-4e73-bb07-a8941f829118 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:34:59.805223 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6e08d29c-e5de-4e73-bb07-a8941f829118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:34:59.882049 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 15/28] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:34:59.883214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08d29c-e5de-4e73-bb07-a8941f829118 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:34:59.892567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c031e-149f-4a6d-bd82-ff71677e187d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:34:59.947929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4626b2-dc6e-4090-8327-3a9e8e6da22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:34:59.949825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4626b2-dc6e-4090-8327-3a9e8e6da22d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:59.950340 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4626b2-dc6e-4090-8327-3a9e8e6da22d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:59.950850 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4626b2-dc6e-4090-8327-3a9e8e6da22d None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:59.951797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4626b2-dc6e-4090-8327-3a9e8e6da22d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:34:59.952274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4626b2-dc6e-4090-8327-3a9e8e6da22d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:34:59.953840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4626b2-dc6e-4090-8327-3a9e8e6da22d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:34:59.968104 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 14/29] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:34:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:34:59.969737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0194c6-6360-4626-bd3b-2c2ed5f1d8ea None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:34:59.970247 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0194c6-6360-4626-bd3b-2c2ed5f1d8ea None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:34:59.970713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0194c6-6360-4626-bd3b-2c2ed5f1d8ea None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:34:59.972187 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 15/30] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:34:59.973126 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0194c6-6360-4626-bd3b-2c2ed5f1d8ea None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:00.012106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08d29c-e5de-4e73-bb07-a8941f829118 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:00.054959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bad9c-dfec-4bd1-ba15-4633ec147f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:00.055590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bad9c-dfec-4bd1-ba15-4633ec147f94 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:00.055878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bad9c-dfec-4bd1-ba15-4633ec147f94 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:00.056161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bad9c-dfec-4bd1-ba15-4633ec147f94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:00.058402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:00.071185 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bad9c-dfec-4bd1-ba15-4633ec147f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:00.072694 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bad9c-dfec-4bd1-ba15-4633ec147f94 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-ba7bad9c-dfec-4bd1-ba15-4633ec147f94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:35:00.091271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:00.092170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:00.092958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:35:00.092958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:35:00.092958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:35:00.092958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:00.092958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 16/31] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:00.098071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bad9c-dfec-4bd1-ba15-4633ec147f94 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:00.144197 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:00.211445 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0194c6-6360-4626-bd3b-2c2ed5f1d8ea None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:00.242059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bad9c-dfec-4bd1-ba15-4633ec147f94 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:00.253920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6ba1b-c9ad-4022-80e0-4b864b788287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:00.254883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6ba1b-c9ad-4022-80e0-4b864b788287 None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:00.255973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6ba1b-c9ad-4022-80e0-4b864b788287 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:00.256466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6ba1b-c9ad-4022-80e0-4b864b788287 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:00.257410 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6ba1b-c9ad-4022-80e0-4b864b788287 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:00.259099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6ba1b-c9ad-4022-80e0-4b864b788287 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:00.285842 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff35f97-f6ba-4f32-8fda-9e2e59753d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:00.286631 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff35f97-f6ba-4f32-8fda-9e2e59753d58 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:00.286910 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff35f97-f6ba-4f32-8fda-9e2e59753d58 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:00.287314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff35f97-f6ba-4f32-8fda-9e2e59753d58 None admin] PATH_INFO: `/v3/users/877c11b74f674bd1b8410ffe1d18db3e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:00.288559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff35f97-f6ba-4f32-8fda-9e2e59753d58 None admin] RBAC: Authorizing `identity:get_user(user_id=877c11b74f674bd1b8410ffe1d18db3e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:00.290236 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff35f97-f6ba-4f32-8fda-9e2e59753d58 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:00.294260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 17/32] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:00 2022] GET /identity/v3/users/877c11b74f674bd1b8410ffe1d18db3e => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:00.294260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18b85e-f3b3-4417-979e-4a83582440a9 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:00.294260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18b85e-f3b3-4417-979e-4a83582440a9 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:00.294260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18b85e-f3b3-4417-979e-4a83582440a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:00.313924 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-8c18b85e-f3b3-4417-979e-4a83582440a9 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:00.315048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-8c18b85e-f3b3-4417-979e-4a83582440a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:00.369305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:00.390903 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 18/33] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:00.391897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18b85e-f3b3-4417-979e-4a83582440a9 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:00.437088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 16/34] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Jul 27 10:34:59 2022] POST /identity/v3/roles => generated 219 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:35:00.438281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6ba1b-c9ad-4022-80e0-4b864b788287 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:00.537446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18b85e-f3b3-4417-979e-4a83582440a9 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:00.558511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:00.565100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6ba1b-c9ad-4022-80e0-4b864b788287 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:00.585416 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed7623-fbb6-4225-907e-4be3db5ebe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:00.586154 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed7623-fbb6-4225-907e-4be3db5ebe3c None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:00.586535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed7623-fbb6-4225-907e-4be3db5ebe3c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:00.587032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed7623-fbb6-4225-907e-4be3db5ebe3c None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:00.588236 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed7623-fbb6-4225-907e-4be3db5ebe3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:00.588619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed7623-fbb6-4225-907e-4be3db5ebe3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:00.590726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed7623-fbb6-4225-907e-4be3db5ebe3c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:00.610465 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74d8e2-0fb4-4f49-ab0e-a1db4d2d8efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:00.612240 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74d8e2-0fb4-4f49-ab0e-a1db4d2d8efe None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:00.612240 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74d8e2-0fb4-4f49-ab0e-a1db4d2d8efe None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:00.612240 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74d8e2-0fb4-4f49-ab0e-a1db4d2d8efe None admin] PATH_INFO: `/v3/domains/default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:00.612987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 19/35] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:00.613703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed7623-fbb6-4225-907e-4be3db5ebe3c None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:00.615069 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74d8e2-0fb4-4f49-ab0e-a1db4d2d8efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:00.616718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74d8e2-0fb4-4f49-ab0e-a1db4d2d8efe None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:00.618435 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 17/36] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:35:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:00.619869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbe1f4-aa14-4668-8e83-20b031a42eb3 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:00.620167 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbe1f4-aa14-4668-8e83-20b031a42eb3 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:00.620454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbe1f4-aa14-4668-8e83-20b031a42eb3 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:00.622017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 18/37] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:00.622704 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbe1f4-aa14-4668-8e83-20b031a42eb3 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:00.679429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:00.742973 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed7623-fbb6-4225-907e-4be3db5ebe3c None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:00.750469 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbe1f4-aa14-4668-8e83-20b031a42eb3 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:00.781190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cdef5-0dab-4231-8d5a-455ed5601e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:00.781823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cdef5-0dab-4231-8d5a-455ed5601e09 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:00.782111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cdef5-0dab-4231-8d5a-455ed5601e09 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:00.782413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cdef5-0dab-4231-8d5a-455ed5601e09 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:00.783181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141cdef5-0dab-4231-8d5a-455ed5601e09 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:00.784575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141cdef5-0dab-4231-8d5a-455ed5601e09 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:00.788136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bdd00-3a91-4a7d-9320-a27e2918cbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:00.788767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bdd00-3a91-4a7d-9320-a27e2918cbca None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:00.789110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bdd00-3a91-4a7d-9320-a27e2918cbca None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:00.789389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bdd00-3a91-4a7d-9320-a27e2918cbca None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:00.790121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bdd00-3a91-4a7d-9320-a27e2918cbca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:00.791662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bdd00-3a91-4a7d-9320-a27e2918cbca None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:00.834302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 19/38] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jul 27 10:35:00 2022] POST /identity/v3/projects => generated 301 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:35:00.834302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52707f1c-81ff-4105-9250-de8d45c7059c None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:00.834302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52707f1c-81ff-4105-9250-de8d45c7059c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:00.834302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52707f1c-81ff-4105-9250-de8d45c7059c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:00.853187 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-52707f1c-81ff-4105-9250-de8d45c7059c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:00.855050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-52707f1c-81ff-4105-9250-de8d45c7059c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:00.873758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:00.918406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 20/39] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Jul 27 10:35:00 2022] POST /identity/v3/roles => generated 225 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:35:00.920261 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cdef5-0dab-4231-8d5a-455ed5601e09 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:00.960607 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 20/40] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:00.962425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d8fa-9b47-46f2-972f-dc2546eea42e None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:00.962871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d8fa-9b47-46f2-972f-dc2546eea42e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:00.963313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0d8fa-9b47-46f2-972f-dc2546eea42e None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:00.965000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 21/41] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:00.983947 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d09cf-8ae7-4e4d-80f6-13f34bb2b329 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:00.984477 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d09cf-8ae7-4e4d-80f6-13f34bb2b329 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:00.984923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d09cf-8ae7-4e4d-80f6-13f34bb2b329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:01.008882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-a07d09cf-8ae7-4e4d-80f6-13f34bb2b329 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:01.010129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a07d09cf-8ae7-4e4d-80f6-13f34bb2b329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:01.082930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cdef5-0dab-4231-8d5a-455ed5601e09 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:01.086947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:01.097665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 22/42] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:01.098526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d09cf-8ae7-4e4d-80f6-13f34bb2b329 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:01.124899 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c37959-0d7b-4854-b9a5-06f6f2c2d537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:01.125601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c37959-0d7b-4854-b9a5-06f6f2c2d537 None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:01.125891 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c37959-0d7b-4854-b9a5-06f6f2c2d537 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:01.126173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c37959-0d7b-4854-b9a5-06f6f2c2d537 None admin] PATH_INFO: `/v3/domains/default/users/877c11b74f674bd1b8410ffe1d18db3e/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:01.128512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c37959-0d7b-4854-b9a5-06f6f2c2d537 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=877c11b74f674bd1b8410ffe1d18db3e, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:01.130822 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c37959-0d7b-4854-b9a5-06f6f2c2d537 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:01.148413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 21/43] 10.222.0.43 () {58 vars in 1361 bytes} [Wed Jul 27 10:35:00 2022] PUT /identity/v3/domains/default/users/877c11b74f674bd1b8410ffe1d18db3e/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:35:01.149274 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c37959-0d7b-4854-b9a5-06f6f2c2d537 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:01.200666 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:01.230697 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d09cf-8ae7-4e4d-80f6-13f34bb2b329 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:01.270605 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694d5c5-70ff-4c28-8540-c6e23f05bd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:01.271444 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694d5c5-70ff-4c28-8540-c6e23f05bd3d None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:01.271830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694d5c5-70ff-4c28-8540-c6e23f05bd3d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:01.272205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694d5c5-70ff-4c28-8540-c6e23f05bd3d None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:01.273029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694d5c5-70ff-4c28-8540-c6e23f05bd3d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:01.274589 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694d5c5-70ff-4c28-8540-c6e23f05bd3d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:01.278965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c37959-0d7b-4854-b9a5-06f6f2c2d537 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:01.301602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Jul 27 10:35:01 2022] POST /identity/v3/roles => generated 223 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:35:01.335686 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a79e2-1d7f-4c27-b80e-733c4e0fda0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:01.336358 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a79e2-1d7f-4c27-b80e-733c4e0fda0e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:01.336645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a79e2-1d7f-4c27-b80e-733c4e0fda0e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:01.337039 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a79e2-1d7f-4c27-b80e-733c4e0fda0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:01.338208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a79e2-1d7f-4c27-b80e-733c4e0fda0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:01.339718 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a79e2-1d7f-4c27-b80e-733c4e0fda0e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:01.341376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 22/45] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:35:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:01.347421 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694d5c5-70ff-4c28-8540-c6e23f05bd3d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:01.468273 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694d5c5-70ff-4c28-8540-c6e23f05bd3d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:01.504844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800fda7-7c11-4f58-9d1c-147258241fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:01.505501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800fda7-7c11-4f58-9d1c-147258241fd5 None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:01.505789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800fda7-7c11-4f58-9d1c-147258241fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:01.506068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800fda7-7c11-4f58-9d1c-147258241fd5 None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:01.506801 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800fda7-7c11-4f58-9d1c-147258241fd5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:01.508261 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800fda7-7c11-4f58-9d1c-147258241fd5 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:01.519894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:01.540750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jul 27 10:35:01 2022] POST /identity/v3/projects => generated 312 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:35:03.201001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75209916-bd8d-4438-bda3-8c1d9ee46342 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:03.201494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75209916-bd8d-4438-bda3-8c1d9ee46342 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:03.201494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75209916-bd8d-4438-bda3-8c1d9ee46342 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:03.202866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 23/47] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:03.208691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dd469-d999-498f-83cb-9aafd92ac0bd None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:03.209081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dd469-d999-498f-83cb-9aafd92ac0bd None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:03.209461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dd469-d999-498f-83cb-9aafd92ac0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:03.227801 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6a7dd469-d999-498f-83cb-9aafd92ac0bd None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:03.228977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6a7dd469-d999-498f-83cb-9aafd92ac0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:03.295710 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 25/48] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:03.319904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75209916-bd8d-4438-bda3-8c1d9ee46342 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:03.353016 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:03.427294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75209916-bd8d-4438-bda3-8c1d9ee46342 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:03.462063 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a4c82-1644-454f-afeb-2dc13c0aaa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:03.462657 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a4c82-1644-454f-afeb-2dc13c0aaa6e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:03.462944 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a4c82-1644-454f-afeb-2dc13c0aaa6e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:03.463223 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a4c82-1644-454f-afeb-2dc13c0aaa6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:03.475031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a4c82-1644-454f-afeb-2dc13c0aaa6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-c19a4c82-1644-454f-afeb-2dc13c0aaa6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:03.480097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:03.481114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:03.482055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:03.482055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:03.482055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:03.482055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:03.482055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:03.482055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:03.482055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:03.482055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:03.482055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:03.482055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:03.482055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:03.482055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:03.482055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 24/49] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:35:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:03.488882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dd469-d999-498f-83cb-9aafd92ac0bd None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:03.574106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9be4c-61c2-4bab-a5a5-799395dce44c None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:03.574464 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9be4c-61c2-4bab-a5a5-799395dce44c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:03.574750 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9be4c-61c2-4bab-a5a5-799395dce44c None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:03.576156 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 25/50] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:35:03.581042 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c5f6a-cb94-4f1a-9b1b-9ef8fed71f0a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:03.581336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c5f6a-cb94-4f1a-9b1b-9ef8fed71f0a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:03.581620 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c5f6a-cb94-4f1a-9b1b-9ef8fed71f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:03.590693 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dd469-d999-498f-83cb-9aafd92ac0bd None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:03.600220 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-172c5f6a-cb94-4f1a-9b1b-9ef8fed71f0a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:03.601749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-172c5f6a-cb94-4f1a-9b1b-9ef8fed71f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:03.611939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:03.628479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7373b-2a96-44ed-a0c4-f268604aa132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:03.629200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7373b-2a96-44ed-a0c4-f268604aa132 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:03.629480 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7373b-2a96-44ed-a0c4-f268604aa132 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:03.630290 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7373b-2a96-44ed-a0c4-f268604aa132 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:03.631035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7373b-2a96-44ed-a0c4-f268604aa132 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:03.631334 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7373b-2a96-44ed-a0c4-f268604aa132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:03.632715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7373b-2a96-44ed-a0c4-f268604aa132 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:03.641531 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 26/51] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:03.647829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7373b-2a96-44ed-a0c4-f268604aa132 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:03.674445 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 26/52] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:03.699180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c5f6a-cb94-4f1a-9b1b-9ef8fed71f0a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:03.729743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:03.752788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7373b-2a96-44ed-a0c4-f268604aa132 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:03.788146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19324ee0-a0f1-4f21-b85c-3f65cbd99e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:03.788801 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19324ee0-a0f1-4f21-b85c-3f65cbd99e69 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:03.789091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19324ee0-a0f1-4f21-b85c-3f65cbd99e69 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:03.789375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19324ee0-a0f1-4f21-b85c-3f65cbd99e69 None admin] PATH_INFO: `/v3/users/877c11b74f674bd1b8410ffe1d18db3e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:03.790856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19324ee0-a0f1-4f21-b85c-3f65cbd99e69 None admin] RBAC: Authorizing `identity:get_user(user_id=877c11b74f674bd1b8410ffe1d18db3e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:03.792324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19324ee0-a0f1-4f21-b85c-3f65cbd99e69 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:03.793966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 27/53] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:03 2022] GET /identity/v3/users/877c11b74f674bd1b8410ffe1d18db3e => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:03.799474 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19324ee0-a0f1-4f21-b85c-3f65cbd99e69 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:03.808884 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c5f6a-cb94-4f1a-9b1b-9ef8fed71f0a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:03.843033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d60fb-2905-42f2-a205-50236f764d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:03.843719 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d60fb-2905-42f2-a205-50236f764d38 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:03.843950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d60fb-2905-42f2-a205-50236f764d38 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:03.844222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d60fb-2905-42f2-a205-50236f764d38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:03.845379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d60fb-2905-42f2-a205-50236f764d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:03.846881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d60fb-2905-42f2-a205-50236f764d38 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:03.848554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 27/54] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:35:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:03.850455 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:03.854251 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d60fb-2905-42f2-a205-50236f764d38 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:03.903103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19324ee0-a0f1-4f21-b85c-3f65cbd99e69 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:03.936670 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfc049-4b94-44ff-9343-0cc309652c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:03.937325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfc049-4b94-44ff-9343-0cc309652c7f None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:03.937610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfc049-4b94-44ff-9343-0cc309652c7f None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:03.937893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfc049-4b94-44ff-9343-0cc309652c7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:03.939092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfc049-4b94-44ff-9343-0cc309652c7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:03.940555 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfc049-4b94-44ff-9343-0cc309652c7f None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:03.942138 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 28/55] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:35:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:03.948700 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfc049-4b94-44ff-9343-0cc309652c7f None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:03.949636 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:03.960092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d60fb-2905-42f2-a205-50236f764d38 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:03.994979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98abf6-fe84-4e1b-a828-f20ee4814933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:03.995624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98abf6-fe84-4e1b-a828-f20ee4814933 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:03.995915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98abf6-fe84-4e1b-a828-f20ee4814933 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:03.996191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98abf6-fe84-4e1b-a828-f20ee4814933 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:03.996882 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98abf6-fe84-4e1b-a828-f20ee4814933 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:03.998370 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98abf6-fe84-4e1b-a828-f20ee4814933 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:04.027036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 28/56] 10.222.0.43 () {60 vars in 1140 bytes} [Wed Jul 27 10:35:03 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:35:04.053823 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfc049-4b94-44ff-9343-0cc309652c7f None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:04.073577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:04.092951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a57068-bf89-440c-a473-068784997744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:04.093589 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a57068-bf89-440c-a473-068784997744 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:04.093876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a57068-bf89-440c-a473-068784997744 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:04.094152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a57068-bf89-440c-a473-068784997744 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:04.095007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a57068-bf89-440c-a473-068784997744 None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.domain.id=default, user.id=877c11b74f674bd1b8410ffe1d18db3e) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:04.095325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a57068-bf89-440c-a473-068784997744 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:04.096815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a57068-bf89-440c-a473-068784997744 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:04.107160 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 29/57] 10.222.0.43 () {56 vars in 1322 bytes} [Wed Jul 27 10:35:03 2022] GET /identity/v3/role_assignments?user.id=877c11b74f674bd1b8410ffe1d18db3e&scope.domain.id=default&role.id=36208a24005e4ff98d827138292bea37 => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:06.071776 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144d928-79c9-414b-9945-81eb0fe1b62a None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:06.072293 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144d928-79c9-414b-9945-81eb0fe1b62a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:06.072543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144d928-79c9-414b-9945-81eb0fe1b62a None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:06.073830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 29/58] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:06.079003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10614fb3-fa92-47ef-86d8-3311bcbf15a0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:06.079423 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10614fb3-fa92-47ef-86d8-3311bcbf15a0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:06.079548 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10614fb3-fa92-47ef-86d8-3311bcbf15a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:06.100741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-10614fb3-fa92-47ef-86d8-3311bcbf15a0 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:06.101963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-10614fb3-fa92-47ef-86d8-3311bcbf15a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:06.166760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 30/59] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:06.190774 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144d928-79c9-414b-9945-81eb0fe1b62a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:06.292743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144d928-79c9-414b-9945-81eb0fe1b62a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:06.326603 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9854d4c-0d54-4c39-afd3-f971209d5f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:06.327241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9854d4c-0d54-4c39-afd3-f971209d5f88 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:06.327526 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9854d4c-0d54-4c39-afd3-f971209d5f88 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:06.327804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9854d4c-0d54-4c39-afd3-f971209d5f88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:06.328971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9854d4c-0d54-4c39-afd3-f971209d5f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:06.330463 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9854d4c-0d54-4c39-afd3-f971209d5f88 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:06.332060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 30/60] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:35:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:06.338373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10614fb3-fa92-47ef-86d8-3311bcbf15a0 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:06.441308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10614fb3-fa92-47ef-86d8-3311bcbf15a0 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:06.454678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:06.477535 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950053ec-8fcf-48da-bdc5-230ffd0221cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:06.478164 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950053ec-8fcf-48da-bdc5-230ffd0221cd None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:06.478485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950053ec-8fcf-48da-bdc5-230ffd0221cd None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:06.478767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950053ec-8fcf-48da-bdc5-230ffd0221cd None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:06.479470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950053ec-8fcf-48da-bdc5-230ffd0221cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:06.480918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950053ec-8fcf-48da-bdc5-230ffd0221cd None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:06.508093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 31/61] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:35:06 2022] POST /identity/v3/users => generated 275 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:35:09.629083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27180cbb-7807-4abd-abda-b21ec21e62e3 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:09.630235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27180cbb-7807-4abd-abda-b21ec21e62e3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:09.630235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27180cbb-7807-4abd-abda-b21ec21e62e3 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:09.631579 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 31/62] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:09.637246 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fd397-66eb-4be4-a2f6-3ae604df8e45 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:09.637735 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fd397-66eb-4be4-a2f6-3ae604df8e45 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:09.637848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fd397-66eb-4be4-a2f6-3ae604df8e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:09.663227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-c67fd397-66eb-4be4-a2f6-3ae604df8e45 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:09.664463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c67fd397-66eb-4be4-a2f6-3ae604df8e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:09.697770 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a54ba-65c9-41c7-b0d3-ced09dd9f28a None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:09.698087 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a54ba-65c9-41c7-b0d3-ced09dd9f28a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:09.698463 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a54ba-65c9-41c7-b0d3-ced09dd9f28a None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:09.699855 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 32/63] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:35:09.728841 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f02be-8f99-4f4c-b74d-ee6e1f7f6e03 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:09.729128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f02be-8f99-4f4c-b74d-ee6e1f7f6e03 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:09.729783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f02be-8f99-4f4c-b74d-ee6e1f7f6e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:09.756930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 32/64] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:09.758158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-8e6f02be-8f99-4f4c-b74d-ee6e1f7f6e03 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:09.759528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-8e6f02be-8f99-4f4c-b74d-ee6e1f7f6e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:09.782587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:09.823983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fd397-66eb-4be4-a2f6-3ae604df8e45 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:09.853106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 33/65] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:09.880538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f02be-8f99-4f4c-b74d-ee6e1f7f6e03 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:10.007688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fd397-66eb-4be4-a2f6-3ae604df8e45 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:10.010486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:10.062518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002635b-1458-49ac-afba-ad139bc82502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:10.063567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002635b-1458-49ac-afba-ad139bc82502 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.064050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002635b-1458-49ac-afba-ad139bc82502 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.064522 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002635b-1458-49ac-afba-ad139bc82502 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.077496 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002635b-1458-49ac-afba-ad139bc82502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:10.081819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f02be-8f99-4f4c-b74d-ee6e1f7f6e03 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-d002635b-1458-49ac-afba-ad139bc82502 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:10.084318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:10.085356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:10.086208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:10.086208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:10.086208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:10.086208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:10.086208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:10.086208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:10.086208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:10.086208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:10.086208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:10.086208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:10.086208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:10.086208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:10.086806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 33/66] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:35:10.091775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0354d8-859d-44a9-8b25-9eb97e0df666 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.091775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0354d8-859d-44a9-8b25-9eb97e0df666 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.091775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0354d8-859d-44a9-8b25-9eb97e0df666 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.091775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 34/67] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:10.092518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0354d8-859d-44a9-8b25-9eb97e0df666 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:10.144029 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc34200-c570-43f4-a5b4-2caf58a96af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:10.145941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc34200-c570-43f4-a5b4-2caf58a96af1 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.146727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc34200-c570-43f4-a5b4-2caf58a96af1 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.147419 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc34200-c570-43f4-a5b4-2caf58a96af1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.160350 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:10.167000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc34200-c570-43f4-a5b4-2caf58a96af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-0fc34200-c570-43f4-a5b4-2caf58a96af1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:10.176091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:10.177328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:10.178151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:10.178151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:10.178151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:10.178151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:10.178151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:10.178151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:10.178151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:10.178151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:10.178151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:10.178151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:10.178151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:10.178151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:10.179241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 34/68] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:35:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:35:10.181118 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ef91a-52e8-4278-91ed-e3eacd4cee54 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.181549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ef91a-52e8-4278-91ed-e3eacd4cee54 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.181959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ef91a-52e8-4278-91ed-e3eacd4cee54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.202790 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e66ef91a-52e8-4278-91ed-e3eacd4cee54 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:10.204001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e66ef91a-52e8-4278-91ed-e3eacd4cee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:10.227862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0354d8-859d-44a9-8b25-9eb97e0df666 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:10.268628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0b87c-decf-4950-8aae-681426cdf040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:10.269274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0b87c-decf-4950-8aae-681426cdf040 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.269574 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0b87c-decf-4950-8aae-681426cdf040 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.269850 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0b87c-decf-4950-8aae-681426cdf040 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.271382 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0b87c-decf-4950-8aae-681426cdf040 None admin] RBAC: Adding query filter params (name=member) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:10.271700 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0b87c-decf-4950-8aae-681426cdf040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:10.273431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0b87c-decf-4950-8aae-681426cdf040 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:10.283044 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 35/69] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:10.284336 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d287-f9f1-468e-8655-4ebbcaeee1de None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.284632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d287-f9f1-468e-8655-4ebbcaeee1de None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.284915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3d287-f9f1-468e-8655-4ebbcaeee1de None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.290999 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 35/70] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:10.291146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 36/71] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:10.291219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ef91a-52e8-4278-91ed-e3eacd4cee54 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:10.291286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8039448-1d2a-47d6-b397-9bc915f6346d None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.291286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8039448-1d2a-47d6-b397-9bc915f6346d None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.291286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8039448-1d2a-47d6-b397-9bc915f6346d None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.291286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 37/72] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:10.291286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8039448-1d2a-47d6-b397-9bc915f6346d None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:10.321517 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:10.402729 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ef91a-52e8-4278-91ed-e3eacd4cee54 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:10.411075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8039448-1d2a-47d6-b397-9bc915f6346d None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:10.432973 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:10.439796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec0a97-5ab2-41f0-891f-fe0ad520279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:10.440430 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec0a97-5ab2-41f0-891f-fe0ad520279e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.440719 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec0a97-5ab2-41f0-891f-fe0ad520279e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.440999 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec0a97-5ab2-41f0-891f-fe0ad520279e None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.442282 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec0a97-5ab2-41f0-891f-fe0ad520279e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:10.442593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec0a97-5ab2-41f0-891f-fe0ad520279e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:10.444122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec0a97-5ab2-41f0-891f-fe0ad520279e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:10.448398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87785205-ff22-4763-99d9-bbb6c5a0af11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:10.449047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87785205-ff22-4763-99d9-bbb6c5a0af11 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.449369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87785205-ff22-4763-99d9-bbb6c5a0af11 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.449643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87785205-ff22-4763-99d9-bbb6c5a0af11 None admin] PATH_INFO: `/v3/users/219a03f07bac42d1b262d74a9cd3c014` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.453051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:10.454299 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891b18b-859c-4efd-928a-838cd396fde4 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.454597 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891b18b-859c-4efd-928a-838cd396fde4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.454877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891b18b-859c-4efd-928a-838cd396fde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.466082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87785205-ff22-4763-99d9-bbb6c5a0af11 None admin] RBAC: Authorizing `identity:get_user(user_id=219a03f07bac42d1b262d74a9cd3c014)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:10.467579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87785205-ff22-4763-99d9-bbb6c5a0af11 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:10.469283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 38/74] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:10 2022] GET /identity/v3/users/219a03f07bac42d1b262d74a9cd3c014 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:10.470474 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb35501-07f6-411f-a1c0-e32ce67fa417 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.470765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb35501-07f6-411f-a1c0-e32ce67fa417 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.471045 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb35501-07f6-411f-a1c0-e32ce67fa417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.472847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e891b18b-859c-4efd-928a-838cd396fde4 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:10.474469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e891b18b-859c-4efd-928a-838cd396fde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:10.493579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6eb35501-07f6-411f-a1c0-e32ce67fa417 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:10.495347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6eb35501-07f6-411f-a1c0-e32ce67fa417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:10.543130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 37/75] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:10.543984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891b18b-859c-4efd-928a-838cd396fde4 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:10.576451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 39/76] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:10.577302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb35501-07f6-411f-a1c0-e32ce67fa417 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:10.587430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:10.661343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891b18b-859c-4efd-928a-838cd396fde4 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:10.678384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb35501-07f6-411f-a1c0-e32ce67fa417 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:10.684552 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:10.698043 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f69dd-3e17-4044-ac8c-5230e73297ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:10.698728 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f69dd-3e17-4044-ac8c-5230e73297ba None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.699017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f69dd-3e17-4044-ac8c-5230e73297ba None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.699299 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f69dd-3e17-4044-ac8c-5230e73297ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.709614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f69dd-3e17-4044-ac8c-5230e73297ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:10.714260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fa868-8c22-4ed0-a076-54ea4e7c75c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-aa8f69dd-3e17-4044-ac8c-5230e73297ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:10.714623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:10.715575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:10.721504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:10.721504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:10.721504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:10.721504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:10.721504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:10.721504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:10.721504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:10.721504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:10.721504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:10.721504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:10.721504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:10.721504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:10.722284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fa868-8c22-4ed0-a076-54ea4e7c75c8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.722284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fa868-8c22-4ed0-a076-54ea4e7c75c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.722284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fa868-8c22-4ed0-a076-54ea4e7c75c8 None admin] PATH_INFO: `/v3/users/877c11b74f674bd1b8410ffe1d18db3e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.722501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 38/77] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:10.722501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f69dd-3e17-4044-ac8c-5230e73297ba None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:10.722639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fa868-8c22-4ed0-a076-54ea4e7c75c8 None admin] RBAC: Authorizing `identity:get_user(user_id=877c11b74f674bd1b8410ffe1d18db3e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:10.722639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fa868-8c22-4ed0-a076-54ea4e7c75c8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:10.722639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 40/78] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:10 2022] GET /identity/v3/users/877c11b74f674bd1b8410ffe1d18db3e => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:10.722639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fa868-8c22-4ed0-a076-54ea4e7c75c8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:10.802552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:10.824267 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f69dd-3e17-4044-ac8c-5230e73297ba None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:10.827459 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fa868-8c22-4ed0-a076-54ea4e7c75c8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:10.859133 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4031459-63d7-4ad0-97a8-17163ceb6465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:10.859783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4031459-63d7-4ad0-97a8-17163ceb6465 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.860068 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4031459-63d7-4ad0-97a8-17163ceb6465 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.860351 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4031459-63d7-4ad0-97a8-17163ceb6465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.860958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502959a2-172c-4f3d-a535-becf4ad7db53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:10.861597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502959a2-172c-4f3d-a535-becf4ad7db53 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:10.861877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502959a2-172c-4f3d-a535-becf4ad7db53 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:10.862150 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502959a2-172c-4f3d-a535-becf4ad7db53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:10.875286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502959a2-172c-4f3d-a535-becf4ad7db53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-502959a2-172c-4f3d-a535-becf4ad7db53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:10.881076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:10.882225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:10.883676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:10.883676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:10.883676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:10.883676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:10.883676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:10.883676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:10.883676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:10.883676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:10.883676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:10.883676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:10.883676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:10.883676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:10.883676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 41/79] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:35:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:10.883676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502959a2-172c-4f3d-a535-becf4ad7db53 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:10.919057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:10.939108 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4031459-63d7-4ad0-97a8-17163ceb6465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:10.940604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4031459-63d7-4ad0-97a8-17163ceb6465 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:10.990826 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502959a2-172c-4f3d-a535-becf4ad7db53 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:11.025802 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978b0b0-9dfa-44d3-b72e-dccb1be5e590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:11.026484 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978b0b0-9dfa-44d3-b72e-dccb1be5e590 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:11.026775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978b0b0-9dfa-44d3-b72e-dccb1be5e590 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:11.027057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978b0b0-9dfa-44d3-b72e-dccb1be5e590 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:11.028231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978b0b0-9dfa-44d3-b72e-dccb1be5e590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:11.029691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978b0b0-9dfa-44d3-b72e-dccb1be5e590 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:11.031332 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 42/80] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:35:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:11.036427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978b0b0-9dfa-44d3-b72e-dccb1be5e590 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:11.036427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:11.040909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 39/81] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:11.041766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4031459-63d7-4ad0-97a8-17163ceb6465 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:11.126739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:11.136025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978b0b0-9dfa-44d3-b72e-dccb1be5e590 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:11.147395 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4031459-63d7-4ad0-97a8-17163ceb6465 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:11.170705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affa72f-3261-406e-94c0-a59d32740fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:11.171255 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affa72f-3261-406e-94c0-a59d32740fa7 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:11.171547 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affa72f-3261-406e-94c0-a59d32740fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:11.171824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affa72f-3261-406e-94c0-a59d32740fa7 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:11.172565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affa72f-3261-406e-94c0-a59d32740fa7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:11.172847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affa72f-3261-406e-94c0-a59d32740fa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:11.174249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affa72f-3261-406e-94c0-a59d32740fa7 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:11.181650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be19028-992e-4dae-b2e2-ad4d17dbc2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:11.182314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be19028-992e-4dae-b2e2-ad4d17dbc2bd None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:11.182623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be19028-992e-4dae-b2e2-ad4d17dbc2bd None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:11.182883 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be19028-992e-4dae-b2e2-ad4d17dbc2bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:11.183009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 43/82] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:11.183807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affa72f-3261-406e-94c0-a59d32740fa7 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:11.252033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be19028-992e-4dae-b2e2-ad4d17dbc2bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:11.252266 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:11.253583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be19028-992e-4dae-b2e2-ad4d17dbc2bd None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:11.290361 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affa72f-3261-406e-94c0-a59d32740fa7 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:11.325234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35ace0-f840-4d35-ba9f-4f9f6cb9e781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:11.325821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35ace0-f840-4d35-ba9f-4f9f6cb9e781 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:11.326102 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35ace0-f840-4d35-ba9f-4f9f6cb9e781 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:11.326403 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35ace0-f840-4d35-ba9f-4f9f6cb9e781 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:11.327121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35ace0-f840-4d35-ba9f-4f9f6cb9e781 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:11.327435 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35ace0-f840-4d35-ba9f-4f9f6cb9e781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:11.328813 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35ace0-f840-4d35-ba9f-4f9f6cb9e781 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:11.335744 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:11.337493 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 44/83] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:35:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:11.338429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35ace0-f840-4d35-ba9f-4f9f6cb9e781 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:11.356957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 40/84] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:11.357803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be19028-992e-4dae-b2e2-ad4d17dbc2bd None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:11.443128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35ace0-f840-4d35-ba9f-4f9f6cb9e781 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:11.460986 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be19028-992e-4dae-b2e2-ad4d17dbc2bd None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:11.470079 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:11.479453 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066739b-f659-49c8-8ed9-9159f018e93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:11.480079 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066739b-f659-49c8-8ed9-9159f018e93c None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:11.480427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066739b-f659-49c8-8ed9-9159f018e93c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:11.480649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066739b-f659-49c8-8ed9-9159f018e93c None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:11.481344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066739b-f659-49c8-8ed9-9159f018e93c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:11.482840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066739b-f659-49c8-8ed9-9159f018e93c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:11.494949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4fcb4-9dbd-4b57-9110-dcd17a82bc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:11.495742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4fcb4-9dbd-4b57-9110-dcd17a82bc72 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:11.496110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4fcb4-9dbd-4b57-9110-dcd17a82bc72 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:11.496451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4fcb4-9dbd-4b57-9110-dcd17a82bc72 None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:11.497818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4fcb4-9dbd-4b57-9110-dcd17a82bc72 None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:11.499455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4fcb4-9dbd-4b57-9110-dcd17a82bc72 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:11.501105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 41/85] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:11 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:11.501874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4fcb4-9dbd-4b57-9110-dcd17a82bc72 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:11.503872 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 45/86] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:35:11 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:35:11.504971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066739b-f659-49c8-8ed9-9159f018e93c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:11.580287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:11.620058 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066739b-f659-49c8-8ed9-9159f018e93c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:11.652423 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4fcb4-9dbd-4b57-9110-dcd17a82bc72 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:11.661127 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd85a1-4571-4df3-904d-35d36809c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:11.662012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd85a1-4571-4df3-904d-35d36809c538 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:11.662345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd85a1-4571-4df3-904d-35d36809c538 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:11.662632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd85a1-4571-4df3-904d-35d36809c538 None admin] PATH_INFO: `/v3/users/219a03f07bac42d1b262d74a9cd3c014` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:11.664698 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd85a1-4571-4df3-904d-35d36809c538 None admin] RBAC: Authorizing `identity:get_user(user_id=219a03f07bac42d1b262d74a9cd3c014)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:11.666179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd85a1-4571-4df3-904d-35d36809c538 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:11.667922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 46/87] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:11 2022] GET /identity/v3/users/219a03f07bac42d1b262d74a9cd3c014 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:11.668728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd85a1-4571-4df3-904d-35d36809c538 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:11.702950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c77ea2-1611-4004-a07c-c26c15d3c634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:11.703904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c77ea2-1611-4004-a07c-c26c15d3c634 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:11.703904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c77ea2-1611-4004-a07c-c26c15d3c634 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:11.704084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c77ea2-1611-4004-a07c-c26c15d3c634 None admin] PATH_INFO: `/v3/users/219a03f07bac42d1b262d74a9cd3c014` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:11.705420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c77ea2-1611-4004-a07c-c26c15d3c634 None admin] RBAC: Authorizing `identity:get_user(user_id=219a03f07bac42d1b262d74a9cd3c014)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:11.706940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c77ea2-1611-4004-a07c-c26c15d3c634 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:11.709355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 42/88] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:11 2022] GET /identity/v3/users/219a03f07bac42d1b262d74a9cd3c014 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:11.710154 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c77ea2-1611-4004-a07c-c26c15d3c634 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:11.740156 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:11.811422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd85a1-4571-4df3-904d-35d36809c538 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:11.847122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c77ea2-1611-4004-a07c-c26c15d3c634 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:11.860743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d146b-d8b8-42bb-9d89-e841d0a68f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:11.861404 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d146b-d8b8-42bb-9d89-e841d0a68f4d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:11.861850 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d146b-d8b8-42bb-9d89-e841d0a68f4d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:11.862133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d146b-d8b8-42bb-9d89-e841d0a68f4d None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:11.865216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d146b-d8b8-42bb-9d89-e841d0a68f4d None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:11.867298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:11.867416 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d146b-d8b8-42bb-9d89-e841d0a68f4d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:11.869355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 47/89] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:11 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:11.870169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d146b-d8b8-42bb-9d89-e841d0a68f4d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:11.890616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c1eeb-74a9-4b8c-ba35-ae5a45f05c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:11.891539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c1eeb-74a9-4b8c-ba35-ae5a45f05c01 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:11.891988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c1eeb-74a9-4b8c-ba35-ae5a45f05c01 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:11.892447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c1eeb-74a9-4b8c-ba35-ae5a45f05c01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:11.893441 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c1eeb-74a9-4b8c-ba35-ae5a45f05c01 None admin] RBAC: Adding query filter params (role.id=eef1174229014437a0db0fd8954bc25e, scope.project.id=c42f8c638d1645be870a7efafeb6b2ac, user.id=219a03f07bac42d1b262d74a9cd3c014) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:11.893967 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c1eeb-74a9-4b8c-ba35-ae5a45f05c01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:11.896257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c1eeb-74a9-4b8c-ba35-ae5a45f05c01 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:11.904789 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 43/90] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:11 2022] GET /identity/v3/role_assignments?user.id=219a03f07bac42d1b262d74a9cd3c014&scope.project.id=c42f8c638d1645be870a7efafeb6b2ac&role.id=eef1174229014437a0db0fd8954bc25e => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:11.906106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c1eeb-74a9-4b8c-ba35-ae5a45f05c01 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:12.077907 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c1eeb-74a9-4b8c-ba35-ae5a45f05c01 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:12.116209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d146b-d8b8-42bb-9d89-e841d0a68f4d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:12.128670 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082783-fede-4568-9fa5-9c0059b54224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:12.130384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082783-fede-4568-9fa5-9c0059b54224 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:12.130759 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082783-fede-4568-9fa5-9c0059b54224 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:12.131161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee082783-fede-4568-9fa5-9c0059b54224 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:12.142584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:12.164333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af6e1f-44a4-46ad-9a4a-dc6f758c742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:12.165591 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af6e1f-44a4-46ad-9a4a-dc6f758c742e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:12.166082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af6e1f-44a4-46ad-9a4a-dc6f758c742e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:12.166582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af6e1f-44a4-46ad-9a4a-dc6f758c742e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:12.218413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:12.248509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee082783-fede-4568-9fa5-9c0059b54224 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:12.250380 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee082783-fede-4568-9fa5-9c0059b54224 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:12.273161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af6e1f-44a4-46ad-9a4a-dc6f758c742e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:12.275028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af6e1f-44a4-46ad-9a4a-dc6f758c742e None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:12.433030 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 48/91] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:12.438373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af6e1f-44a4-46ad-9a4a-dc6f758c742e None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:12.458269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 44/92] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:12.462381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082783-fede-4568-9fa5-9c0059b54224 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:12.466750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:12.603353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af6e1f-44a4-46ad-9a4a-dc6f758c742e None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:12.635090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:12.668483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4efca3-f5b2-4c91-8c6f-d148a7ce85a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:12.669488 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4efca3-f5b2-4c91-8c6f-d148a7ce85a3 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:12.669963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4efca3-f5b2-4c91-8c6f-d148a7ce85a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:12.670483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4efca3-f5b2-4c91-8c6f-d148a7ce85a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:12.671980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4efca3-f5b2-4c91-8c6f-d148a7ce85a3 None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=c42f8c638d1645be870a7efafeb6b2ac, user.id=877c11b74f674bd1b8410ffe1d18db3e) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:12.672645 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4efca3-f5b2-4c91-8c6f-d148a7ce85a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:12.674329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4efca3-f5b2-4c91-8c6f-d148a7ce85a3 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:12.685750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 49/93] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:12 2022] GET /identity/v3/role_assignments?user.id=877c11b74f674bd1b8410ffe1d18db3e&scope.project.id=c42f8c638d1645be870a7efafeb6b2ac&role.id=36208a24005e4ff98d827138292bea37 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:12.690477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee082783-fede-4568-9fa5-9c0059b54224 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:12.692024 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4efca3-f5b2-4c91-8c6f-d148a7ce85a3 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:12.809627 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa5d23-7dae-4d42-9183-d912eded7cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:12.810613 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa5d23-7dae-4d42-9183-d912eded7cea None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:12.810929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa5d23-7dae-4d42-9183-d912eded7cea None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:12.811304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa5d23-7dae-4d42-9183-d912eded7cea None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:12.818286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa5d23-7dae-4d42-9183-d912eded7cea None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:12.818286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa5d23-7dae-4d42-9183-d912eded7cea None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:12.820097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 45/94] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:12 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:12.826670 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa5d23-7dae-4d42-9183-d912eded7cea None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:12.868431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:12.892991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4efca3-f5b2-4c91-8c6f-d148a7ce85a3 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:12.965282 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b9551-41e3-4bfc-8cc5-982c74814808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:12.966542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b9551-41e3-4bfc-8cc5-982c74814808 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:12.966850 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b9551-41e3-4bfc-8cc5-982c74814808 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:12.967154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b9551-41e3-4bfc-8cc5-982c74814808 None admin] PATH_INFO: `/v3/projects/41a3e603183f48f0b1354fca971ddd00` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:12.972848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b9551-41e3-4bfc-8cc5-982c74814808 None admin] RBAC: Authorizing `identity:get_project(project_id=41a3e603183f48f0b1354fca971ddd00)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:12.975486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b9551-41e3-4bfc-8cc5-982c74814808 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:12.977845 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 50/95] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:12 2022] GET /identity/v3/projects/41a3e603183f48f0b1354fca971ddd00 => generated 312 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:12.985464 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b9551-41e3-4bfc-8cc5-982c74814808 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:13.146262 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa5d23-7dae-4d42-9183-d912eded7cea None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:13.176861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b9551-41e3-4bfc-8cc5-982c74814808 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:13.224812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefec6f-00c5-420b-ac11-454840037aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:13.226178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefec6f-00c5-420b-ac11-454840037aa8 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:13.232420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefec6f-00c5-420b-ac11-454840037aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:13.232952 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefec6f-00c5-420b-ac11-454840037aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:13.234963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefec6f-00c5-420b-ac11-454840037aa8 None admin] RBAC: Adding query filter params (role.id=fcaec44122534716b69d5e7f05160915, scope.project.id=c42f8c638d1645be870a7efafeb6b2ac, user.id=219a03f07bac42d1b262d74a9cd3c014) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:13.236570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefec6f-00c5-420b-ac11-454840037aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:13.241407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefec6f-00c5-420b-ac11-454840037aa8 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:13.245460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ba5d5-5fcc-422a-b23a-0101c67c7300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:13.246671 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ba5d5-5fcc-422a-b23a-0101c67c7300 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:13.249204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ba5d5-5fcc-422a-b23a-0101c67c7300 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:13.249708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ba5d5-5fcc-422a-b23a-0101c67c7300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:13.252615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ba5d5-5fcc-422a-b23a-0101c67c7300 None admin] RBAC: Adding query filter params (role.id=eef1174229014437a0db0fd8954bc25e, scope.project.id=41a3e603183f48f0b1354fca971ddd00, user.id=219a03f07bac42d1b262d74a9cd3c014) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:13.253347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ba5d5-5fcc-422a-b23a-0101c67c7300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:13.256407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 46/96] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:12 2022] GET /identity/v3/role_assignments?user.id=219a03f07bac42d1b262d74a9cd3c014&scope.project.id=c42f8c638d1645be870a7efafeb6b2ac&role.id=fcaec44122534716b69d5e7f05160915 => generated 259 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:13.258533 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ba5d5-5fcc-422a-b23a-0101c67c7300 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:13.266219 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 51/97] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:12 2022] GET /identity/v3/role_assignments?user.id=219a03f07bac42d1b262d74a9cd3c014&scope.project.id=41a3e603183f48f0b1354fca971ddd00&role.id=eef1174229014437a0db0fd8954bc25e => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:14.423181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8648e8b-3e90-4f62-a887-5c8255e12ed1 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:14.424182 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8648e8b-3e90-4f62-a887-5c8255e12ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:14.424887 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8648e8b-3e90-4f62-a887-5c8255e12ed1 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:14.426514 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 47/98] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:14.432035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14a73f-57f2-40e1-9d75-7be36def55a8 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:14.432907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14a73f-57f2-40e1-9d75-7be36def55a8 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:14.433396 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14a73f-57f2-40e1-9d75-7be36def55a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:14.454735 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-1f14a73f-57f2-40e1-9d75-7be36def55a8 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:14.456250 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1f14a73f-57f2-40e1-9d75-7be36def55a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:14.473848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:14.549836 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 52/99] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:14.557029 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122e199-9483-4691-a9cf-783ab8e87f05 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:14.557564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122e199-9483-4691-a9cf-783ab8e87f05 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:14.558032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122e199-9483-4691-a9cf-783ab8e87f05 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:14.559817 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 48/100] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:14.565491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03ab04-f063-479b-b4ff-2a0fd23df696 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:14.566033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03ab04-f063-479b-b4ff-2a0fd23df696 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:14.566584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03ab04-f063-479b-b4ff-2a0fd23df696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:14.591833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-8a03ab04-f063-479b-b4ff-2a0fd23df696 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:14.593325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8a03ab04-f063-479b-b4ff-2a0fd23df696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:14.597473 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122e199-9483-4691-a9cf-783ab8e87f05 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:14.637422 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:14.719608 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 53/101] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:14.752794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03ab04-f063-479b-b4ff-2a0fd23df696 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:14.830509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122e199-9483-4691-a9cf-783ab8e87f05 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:14.898286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5d2e0-29d0-41bf-8cc4-9f50f95fca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:14.899470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5d2e0-29d0-41bf-8cc4-9f50f95fca58 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:14.900108 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5d2e0-29d0-41bf-8cc4-9f50f95fca58 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:14.900581 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5d2e0-29d0-41bf-8cc4-9f50f95fca58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:14.915686 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5d2e0-29d0-41bf-8cc4-9f50f95fca58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:14.918548 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-fda5d2e0-29d0-41bf-8cc4-9f50f95fca58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:14.922496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:14.923336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:14.924119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:14.924119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:14.924119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:14.924119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:14.924119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:14.924119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:14.924119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:14.924119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:14.924119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:14.924119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:14.924119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:14.924119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:14.927897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 49/102] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:14.929480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5952d2-a3c8-4e0e-855e-5b4eec5d2e75 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:14.929959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5952d2-a3c8-4e0e-855e-5b4eec5d2e75 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:14.930465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5952d2-a3c8-4e0e-855e-5b4eec5d2e75 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:14.931996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 50/103] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:14.939505 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf4565-9fbc-4207-9402-c038ab42c368 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:14.939799 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf4565-9fbc-4207-9402-c038ab42c368 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:14.940082 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf4565-9fbc-4207-9402-c038ab42c368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:14.975740 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03ab04-f063-479b-b4ff-2a0fd23df696 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:14.980834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e6cf4565-9fbc-4207-9402-c038ab42c368 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:14.982054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e6cf4565-9fbc-4207-9402-c038ab42c368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:15.026350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a5cbc-5542-44c6-a0b2-c0698e0fb4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:15.027062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a5cbc-5542-44c6-a0b2-c0698e0fb4a6 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:15.027353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a5cbc-5542-44c6-a0b2-c0698e0fb4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:15.027634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a5cbc-5542-44c6-a0b2-c0698e0fb4a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:15.047186 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a5cbc-5542-44c6-a0b2-c0698e0fb4a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-264a5cbc-5542-44c6-a0b2-c0698e0fb4a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:15.054862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:15.055723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:15.056482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:15.056482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:15.056482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:15.056482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:15.056482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:15.056482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:15.056482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:15.056482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:15.056482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:15.056482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:15.056482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:15.056482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:15.057064 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 54/104] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:15.057829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a5cbc-5542-44c6-a0b2-c0698e0fb4a6 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:15.139615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 51/105] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:15.140496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf4565-9fbc-4207-9402-c038ab42c368 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:15.158560 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:15.227718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a5cbc-5542-44c6-a0b2-c0698e0fb4a6 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:15.264527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310a677-3f93-49a4-93c3-42e2af806f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:15.265155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310a677-3f93-49a4-93c3-42e2af806f14 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:15.265446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310a677-3f93-49a4-93c3-42e2af806f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:15.265729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310a677-3f93-49a4-93c3-42e2af806f14 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:15.266492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310a677-3f93-49a4-93c3-42e2af806f14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:15.266805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310a677-3f93-49a4-93c3-42e2af806f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:15.268294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310a677-3f93-49a4-93c3-42e2af806f14 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:15.271196 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:15.279832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 55/106] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:15.280719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310a677-3f93-49a4-93c3-42e2af806f14 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:15.366719 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf4565-9fbc-4207-9402-c038ab42c368 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:15.440768 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01a962-9f10-41f0-8eb4-22e159aa1e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:15.441385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01a962-9f10-41f0-8eb4-22e159aa1e59 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:15.442413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01a962-9f10-41f0-8eb4-22e159aa1e59 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:15.442876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01a962-9f10-41f0-8eb4-22e159aa1e59 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:15.443791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01a962-9f10-41f0-8eb4-22e159aa1e59 None admin] RBAC: Adding query filter params (name=member) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:15.444102 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01a962-9f10-41f0-8eb4-22e159aa1e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:15.445495 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01a962-9f10-41f0-8eb4-22e159aa1e59 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:15.455035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 52/107] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:15.455889 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01a962-9f10-41f0-8eb4-22e159aa1e59 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:15.473109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310a677-3f93-49a4-93c3-42e2af806f14 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:15.535471 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:15.551543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f7a3d-c625-4338-89ac-2410099640bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:15.552222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f7a3d-c625-4338-89ac-2410099640bd None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:15.552511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f7a3d-c625-4338-89ac-2410099640bd None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:15.552794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f7a3d-c625-4338-89ac-2410099640bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:15.558923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f7a3d-c625-4338-89ac-2410099640bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:15.560667 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f7a3d-c625-4338-89ac-2410099640bd None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:15.562349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 56/108] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:35:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:15.563128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f7a3d-c625-4338-89ac-2410099640bd None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:15.575861 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01a962-9f10-41f0-8eb4-22e159aa1e59 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:15.621870 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb324b1d-6eff-4ba9-90b9-8ec2dea34c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:15.622565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb324b1d-6eff-4ba9-90b9-8ec2dea34c6f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:15.622852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb324b1d-6eff-4ba9-90b9-8ec2dea34c6f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:15.623133 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb324b1d-6eff-4ba9-90b9-8ec2dea34c6f None admin] PATH_INFO: `/v3/users/4108d69e697a4a34aef42ade8e4521ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:15.652660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb324b1d-6eff-4ba9-90b9-8ec2dea34c6f None admin] RBAC: Authorizing `identity:get_user(user_id=4108d69e697a4a34aef42ade8e4521ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:15.654155 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb324b1d-6eff-4ba9-90b9-8ec2dea34c6f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:15.656086 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 53/109] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:15 2022] GET /identity/v3/users/4108d69e697a4a34aef42ade8e4521ac => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:15.656670 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb324b1d-6eff-4ba9-90b9-8ec2dea34c6f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:15.668436 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:15.750036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f7a3d-c625-4338-89ac-2410099640bd None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:15.775086 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb324b1d-6eff-4ba9-90b9-8ec2dea34c6f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:15.800124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:15.822507 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28682749-3b48-488e-8622-57e36c28f765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:15.823487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28682749-3b48-488e-8622-57e36c28f765 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:15.824401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28682749-3b48-488e-8622-57e36c28f765 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:15.825200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28682749-3b48-488e-8622-57e36c28f765 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:15.826608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28682749-3b48-488e-8622-57e36c28f765 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:15.827404 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d59b84-a60c-4a25-b47c-49dd00bd4d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:15.829084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28682749-3b48-488e-8622-57e36c28f765 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:15.829927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d59b84-a60c-4a25-b47c-49dd00bd4d64 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:15.830442 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d59b84-a60c-4a25-b47c-49dd00bd4d64 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:15.830923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d59b84-a60c-4a25-b47c-49dd00bd4d64 None admin] PATH_INFO: `/v3/users/219a03f07bac42d1b262d74a9cd3c014` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:15.838209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d59b84-a60c-4a25-b47c-49dd00bd4d64 None admin] RBAC: Authorizing `identity:get_user(user_id=219a03f07bac42d1b262d74a9cd3c014)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:15.838209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d59b84-a60c-4a25-b47c-49dd00bd4d64 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:15.839017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 57/110] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:15 2022] GET /identity/v3/users/219a03f07bac42d1b262d74a9cd3c014 => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:15.839276 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d59b84-a60c-4a25-b47c-49dd00bd4d64 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:15.907052 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 54/111] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jul 27 10:35:15 2022] POST /identity/v3/projects => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:35:15.907693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28682749-3b48-488e-8622-57e36c28f765 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:15.980011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d59b84-a60c-4a25-b47c-49dd00bd4d64 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:16.040123 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeec3c2-d724-4f19-93b3-42f6fb4112ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:16.040769 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec3c2-d724-4f19-93b3-42f6fb4112ee None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:16.041057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec3c2-d724-4f19-93b3-42f6fb4112ee None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:16.041337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeec3c2-d724-4f19-93b3-42f6fb4112ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:16.047837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:16.165429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28682749-3b48-488e-8622-57e36c28f765 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:16.190633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeec3c2-d724-4f19-93b3-42f6fb4112ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:16.193617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeec3c2-d724-4f19-93b3-42f6fb4112ee None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:16.209547 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc0606-57e6-433c-a330-0a824caa1204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:16.210286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc0606-57e6-433c-a330-0a824caa1204 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:16.210576 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc0606-57e6-433c-a330-0a824caa1204 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:16.210857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc0606-57e6-433c-a330-0a824caa1204 None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:16.212066 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc0606-57e6-433c-a330-0a824caa1204 None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:16.213546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc0606-57e6-433c-a330-0a824caa1204 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:16.215284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 55/112] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:15 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:16.216669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a377518-ecdb-4201-b9c3-3bd50e5c7673 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:16.217134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a377518-ecdb-4201-b9c3-3bd50e5c7673 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:16.217590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a377518-ecdb-4201-b9c3-3bd50e5c7673 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:16.219069 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 56/113] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:16.220246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539e926-3b83-4d74-b85c-6d9cd728049b None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:16.220705 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539e926-3b83-4d74-b85c-6d9cd728049b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:16.221173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539e926-3b83-4d74-b85c-6d9cd728049b None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:16.222874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 57/114] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:16.230342 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d87f7-0e9d-4b4e-b025-bdbb0bfc2c36 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:16.230867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d87f7-0e9d-4b4e-b025-bdbb0bfc2c36 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:16.231322 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d87f7-0e9d-4b4e-b025-bdbb0bfc2c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:16.252030 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-3d1d87f7-0e9d-4b4e-b025-bdbb0bfc2c36 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:16.253248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3d1d87f7-0e9d-4b4e-b025-bdbb0bfc2c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:16.296078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:16.318868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 58/115] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:16.320341 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb94b8-4ed6-48b0-973a-b9d54a7f9054 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:16.320720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb94b8-4ed6-48b0-973a-b9d54a7f9054 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:16.320910 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb94b8-4ed6-48b0-973a-b9d54a7f9054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:16.331603 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 58/116] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:16.333490 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d87f7-0e9d-4b4e-b025-bdbb0bfc2c36 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:16.340365 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-38eb94b8-4ed6-48b0-973a-b9d54a7f9054 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:16.341738 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-38eb94b8-4ed6-48b0-973a-b9d54a7f9054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:16.370568 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:16.416094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 59/117] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:16.417689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b88a34-7f71-403c-8667-784327aff188 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:16.417984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b88a34-7f71-403c-8667-784327aff188 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:16.418299 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b88a34-7f71-403c-8667-784327aff188 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:16.423768 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 60/118] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:16.423768 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b88a34-7f71-403c-8667-784327aff188 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:16.465882 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d87f7-0e9d-4b4e-b025-bdbb0bfc2c36 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:16.501712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de6122-c1dd-4db4-b616-a3c451232aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:16.502649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de6122-c1dd-4db4-b616-a3c451232aca None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:16.502940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de6122-c1dd-4db4-b616-a3c451232aca None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:16.503227 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de6122-c1dd-4db4-b616-a3c451232aca None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac/users/219a03f07bac42d1b262d74a9cd3c014/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:16.505546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de6122-c1dd-4db4-b616-a3c451232aca None admin] RBAC: Authorizing `identity:create_grant(project_id=c42f8c638d1645be870a7efafeb6b2ac, user_id=219a03f07bac42d1b262d74a9cd3c014, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:16.507136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de6122-c1dd-4db4-b616-a3c451232aca None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:16.521768 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 59/119] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:35:16 2022] PUT /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac/users/219a03f07bac42d1b262d74a9cd3c014/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:35:16.522885 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de6122-c1dd-4db4-b616-a3c451232aca None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:16.540109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b88a34-7f71-403c-8667-784327aff188 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:16.576344 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:16.586051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50284b-83f8-42d5-8e8c-f4dea8ba487c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:16.587186 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50284b-83f8-42d5-8e8c-f4dea8ba487c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:16.587655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50284b-83f8-42d5-8e8c-f4dea8ba487c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:16.588174 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50284b-83f8-42d5-8e8c-f4dea8ba487c None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:16.590732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50284b-83f8-42d5-8e8c-f4dea8ba487c None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:16.592300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be50284b-83f8-42d5-8e8c-f4dea8ba487c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:16.594570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 61/120] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:16 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:16.601721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3d26e-8bd2-4443-937f-6b8cc0863cbc None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:16.602043 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3d26e-8bd2-4443-937f-6b8cc0863cbc None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:16.602370 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3d26e-8bd2-4443-937f-6b8cc0863cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:16.623294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-7fa3d26e-8bd2-4443-937f-6b8cc0863cbc None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:16.624681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7fa3d26e-8bd2-4443-937f-6b8cc0863cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:16.659821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:16.669002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de6122-c1dd-4db4-b616-a3c451232aca None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:16.713115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2babd11-1fc2-4b48-86c8-de14b376e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:16.713602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 62/121] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:16.714405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2babd11-1fc2-4b48-86c8-de14b376e725 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:16.714583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3d26e-8bd2-4443-937f-6b8cc0863cbc None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:16.715061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2babd11-1fc2-4b48-86c8-de14b376e725 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:16.715583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2babd11-1fc2-4b48-86c8-de14b376e725 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:16.729963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2babd11-1fc2-4b48-86c8-de14b376e725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-d2babd11-1fc2-4b48-86c8-de14b376e725 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:16.735961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:16.736803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:16.737599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:16.737599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:16.737599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:16.737599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:16.737599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:16.737599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:16.737599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:16.737599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:16.737599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:16.737599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:16.737599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:16.737599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:16.740835 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 60/122] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:16.742038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2babd11-1fc2-4b48-86c8-de14b376e725 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:16.845279 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3d26e-8bd2-4443-937f-6b8cc0863cbc None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:16.851551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:16.860410 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2babd11-1fc2-4b48-86c8-de14b376e725 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:16.893639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1a7d5-0725-45c1-931b-552f9ad58e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:16.895281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1a7d5-0725-45c1-931b-552f9ad58e0e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:16.895819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1a7d5-0725-45c1-931b-552f9ad58e0e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:16.896286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1a7d5-0725-45c1-931b-552f9ad58e0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:16.909987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5043b15-a497-4bb6-82db-c0a2a0890d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:16.911245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5043b15-a497-4bb6-82db-c0a2a0890d81 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:16.911445 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1a7d5-0725-45c1-931b-552f9ad58e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:16.911718 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5043b15-a497-4bb6-82db-c0a2a0890d81 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:16.912004 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5043b15-a497-4bb6-82db-c0a2a0890d81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:16.912880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5043b15-a497-4bb6-82db-c0a2a0890d81 None admin] RBAC: Adding query filter params (role.id=2838dfaf550b4ad68846863e49c6a7ae, scope.project.id=c42f8c638d1645be870a7efafeb6b2ac, user.id=4108d69e697a4a34aef42ade8e4521ac) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:16.913200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5043b15-a497-4bb6-82db-c0a2a0890d81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:16.915012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5043b15-a497-4bb6-82db-c0a2a0890d81 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-91e1a7d5-0725-45c1-931b-552f9ad58e0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:16.918585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:16.919599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:16.920359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:16.920359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:16.920359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:16.920359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:16.920359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:16.920359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:16.920359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:16.920359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:16.920359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:16.920359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:16.920359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:16.920359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:16.920359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 63/123] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:35:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:16.920980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1a7d5-0725-45c1-931b-552f9ad58e0e None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:16.929918 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 61/124] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:16 2022] GET /identity/v3/role_assignments?user.id=4108d69e697a4a34aef42ade8e4521ac&scope.project.id=c42f8c638d1645be870a7efafeb6b2ac&role.id=2838dfaf550b4ad68846863e49c6a7ae => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:16.931158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5043b15-a497-4bb6-82db-c0a2a0890d81 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:16.978603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:17.138220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1a7d5-0725-45c1-931b-552f9ad58e0e None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:17.140531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5043b15-a497-4bb6-82db-c0a2a0890d81 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:17.196051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ef8df-0d3a-4736-aa51-50fdb217e845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:17.196609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ef8df-0d3a-4736-aa51-50fdb217e845 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:17.196896 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ef8df-0d3a-4736-aa51-50fdb217e845 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:17.197175 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ef8df-0d3a-4736-aa51-50fdb217e845 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:17.197918 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ef8df-0d3a-4736-aa51-50fdb217e845 None admin] RBAC: Adding query filter params (name=member) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:17.198264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ef8df-0d3a-4736-aa51-50fdb217e845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:17.199660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ef8df-0d3a-4736-aa51-50fdb217e845 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:17.209640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 62/125] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:17.214943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ef8df-0d3a-4736-aa51-50fdb217e845 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:17.219976 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c990e-64c0-4e19-bdf1-c59f1dc96dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:17.220644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c990e-64c0-4e19-bdf1-c59f1dc96dda None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:17.220934 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c990e-64c0-4e19-bdf1-c59f1dc96dda None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:17.221214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c990e-64c0-4e19-bdf1-c59f1dc96dda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:17.245929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c990e-64c0-4e19-bdf1-c59f1dc96dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-f49c990e-64c0-4e19-bdf1-c59f1dc96dda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:17.251007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:17.251859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:17.252652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:17.252652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:17.252652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:17.252652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:17.252652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:17.252652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:17.252652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:17.252652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:17.252652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:17.252652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:17.252652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:17.252652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:17.252652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 64/126] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:35:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:17.253291 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c990e-64c0-4e19-bdf1-c59f1dc96dda None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:17.272859 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:17.426028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ef8df-0d3a-4736-aa51-50fdb217e845 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:17.441007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:17.469657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c990e-64c0-4e19-bdf1-c59f1dc96dda None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:17.489972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dde92e-c2c7-48b4-8922-bb0fee3a7fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:17.490670 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dde92e-c2c7-48b4-8922-bb0fee3a7fef None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:17.490961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dde92e-c2c7-48b4-8922-bb0fee3a7fef None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:17.491243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dde92e-c2c7-48b4-8922-bb0fee3a7fef None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:17.491978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dde92e-c2c7-48b4-8922-bb0fee3a7fef None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:17.492290 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dde92e-c2c7-48b4-8922-bb0fee3a7fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:17.493699 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dde92e-c2c7-48b4-8922-bb0fee3a7fef None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:17.514014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 63/127] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:17.517868 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dde92e-c2c7-48b4-8922-bb0fee3a7fef None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:17.544956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660a203-fc7d-4b6b-9227-edc490ed1fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:17.545664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660a203-fc7d-4b6b-9227-edc490ed1fe3 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:17.545956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660a203-fc7d-4b6b-9227-edc490ed1fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:17.546260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660a203-fc7d-4b6b-9227-edc490ed1fe3 None admin] PATH_INFO: `/v3/users/219a03f07bac42d1b262d74a9cd3c014` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:17.548065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660a203-fc7d-4b6b-9227-edc490ed1fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=219a03f07bac42d1b262d74a9cd3c014)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:17.550643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660a203-fc7d-4b6b-9227-edc490ed1fe3 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:17.552865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 65/128] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:17 2022] GET /identity/v3/users/219a03f07bac42d1b262d74a9cd3c014 => generated 275 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:17.553654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660a203-fc7d-4b6b-9227-edc490ed1fe3 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:17.670660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660a203-fc7d-4b6b-9227-edc490ed1fe3 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:17.708617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbadcc-d769-4e64-be5a-4405c03d54b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:17.709279 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbadcc-d769-4e64-be5a-4405c03d54b8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:17.709642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbadcc-d769-4e64-be5a-4405c03d54b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:17.709956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbadcc-d769-4e64-be5a-4405c03d54b8 None admin] PATH_INFO: `/v3/users/877c11b74f674bd1b8410ffe1d18db3e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:17.711237 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbadcc-d769-4e64-be5a-4405c03d54b8 None admin] RBAC: Authorizing `identity:get_user(user_id=877c11b74f674bd1b8410ffe1d18db3e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:17.712743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbadcc-d769-4e64-be5a-4405c03d54b8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:17.714522 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 66/129] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:17 2022] GET /identity/v3/users/877c11b74f674bd1b8410ffe1d18db3e => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:17.715296 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbadcc-d769-4e64-be5a-4405c03d54b8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:17.735589 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:17.755166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:17.816221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dde92e-c2c7-48b4-8922-bb0fee3a7fef None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:17.830085 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbadcc-d769-4e64-be5a-4405c03d54b8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:17.878238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4566fe2-62ca-46b7-9c3e-22395050e86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:17.878238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4566fe2-62ca-46b7-9c3e-22395050e86c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:17.878238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4566fe2-62ca-46b7-9c3e-22395050e86c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:17.878238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4566fe2-62ca-46b7-9c3e-22395050e86c None admin] PATH_INFO: `/v3/projects/41a3e603183f48f0b1354fca971ddd00` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:17.878653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4566fe2-62ca-46b7-9c3e-22395050e86c None admin] RBAC: Authorizing `identity:get_project(project_id=41a3e603183f48f0b1354fca971ddd00)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:17.878653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4566fe2-62ca-46b7-9c3e-22395050e86c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:17.880977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 67/130] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:17 2022] GET /identity/v3/projects/41a3e603183f48f0b1354fca971ddd00 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:17.882088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4566fe2-62ca-46b7-9c3e-22395050e86c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:17.891343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948a606-11d6-483b-8f7b-74321836cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:17.891753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948a606-11d6-483b-8f7b-74321836cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:17.892042 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948a606-11d6-483b-8f7b-74321836cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:17.892323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948a606-11d6-483b-8f7b-74321836cfd6 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:17.893073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948a606-11d6-483b-8f7b-74321836cfd6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:17.893384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948a606-11d6-483b-8f7b-74321836cfd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:17.895484 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948a606-11d6-483b-8f7b-74321836cfd6 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:17.924805 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 64/131] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:35:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:17.925999 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948a606-11d6-483b-8f7b-74321836cfd6 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:18.078458 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:18.094850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948a606-11d6-483b-8f7b-74321836cfd6 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:18.132405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710021c8-128a-4db2-94a6-f6c90139a78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:18.133094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710021c8-128a-4db2-94a6-f6c90139a78e None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:18.133385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710021c8-128a-4db2-94a6-f6c90139a78e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:18.133868 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710021c8-128a-4db2-94a6-f6c90139a78e None admin] PATH_INFO: `/v3/projects/41a3e603183f48f0b1354fca971ddd00/users/219a03f07bac42d1b262d74a9cd3c014/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:18.135908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710021c8-128a-4db2-94a6-f6c90139a78e None admin] RBAC: Authorizing `identity:create_grant(project_id=41a3e603183f48f0b1354fca971ddd00, user_id=219a03f07bac42d1b262d74a9cd3c014, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:18.136154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4566fe2-62ca-46b7-9c3e-22395050e86c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:18.137366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710021c8-128a-4db2-94a6-f6c90139a78e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:18.159841 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 65/132] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:35:17 2022] PUT /identity/v3/projects/41a3e603183f48f0b1354fca971ddd00/users/219a03f07bac42d1b262d74a9cd3c014/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:35:18.160844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710021c8-128a-4db2-94a6-f6c90139a78e None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:18.174942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:18.263533 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99380c-3730-4522-91c3-d4b1ada0798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:18.264216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99380c-3730-4522-91c3-d4b1ada0798b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:18.264524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99380c-3730-4522-91c3-d4b1ada0798b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:18.264782 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99380c-3730-4522-91c3-d4b1ada0798b None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:18.271308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99380c-3730-4522-91c3-d4b1ada0798b None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:18.272783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99380c-3730-4522-91c3-d4b1ada0798b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:18.274777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 68/133] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:17 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:18.287663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99380c-3730-4522-91c3-d4b1ada0798b None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:18.365451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710021c8-128a-4db2-94a6-f6c90139a78e None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:18.433266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b1774-5a02-408a-9e85-a1b263bffeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:18.433965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b1774-5a02-408a-9e85-a1b263bffeea None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:18.434287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b1774-5a02-408a-9e85-a1b263bffeea None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:18.434573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b1774-5a02-408a-9e85-a1b263bffeea None admin] PATH_INFO: `/v3/users/219a03f07bac42d1b262d74a9cd3c014` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:18.436064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b1774-5a02-408a-9e85-a1b263bffeea None admin] RBAC: Authorizing `identity:get_user(user_id=219a03f07bac42d1b262d74a9cd3c014)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:18.437529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b1774-5a02-408a-9e85-a1b263bffeea None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:18.439408 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 66/134] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:18 2022] GET /identity/v3/users/219a03f07bac42d1b262d74a9cd3c014 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:18.440372 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505736c2-12b1-4d27-a907-1695cff9a148 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:18.440662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505736c2-12b1-4d27-a907-1695cff9a148 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:18.440944 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505736c2-12b1-4d27-a907-1695cff9a148 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:18.447192 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 67/135] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:18.449394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505736c2-12b1-4d27-a907-1695cff9a148 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:18.467971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99380c-3730-4522-91c3-d4b1ada0798b None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:18.513656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2754c30-c044-4c85-9864-c2bace93b12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:18.514428 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2754c30-c044-4c85-9864-c2bace93b12f None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:18.515042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2754c30-c044-4c85-9864-c2bace93b12f None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:18.515330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2754c30-c044-4c85-9864-c2bace93b12f None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac/users/877c11b74f674bd1b8410ffe1d18db3e/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:18.517820 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2754c30-c044-4c85-9864-c2bace93b12f None admin] RBAC: Authorizing `identity:create_grant(project_id=c42f8c638d1645be870a7efafeb6b2ac, user_id=877c11b74f674bd1b8410ffe1d18db3e, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:18.520738 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2754c30-c044-4c85-9864-c2bace93b12f None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:18.539681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 69/136] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:35:18 2022] PUT /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac/users/877c11b74f674bd1b8410ffe1d18db3e/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:35:18.541046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634ae66-d607-47f5-ad2d-7dd52429173d None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:18.541342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634ae66-d607-47f5-ad2d-7dd52429173d None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:18.541625 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634ae66-d607-47f5-ad2d-7dd52429173d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:18.562222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:18.563594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-c634ae66-d607-47f5-ad2d-7dd52429173d None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:18.564874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c634ae66-d607-47f5-ad2d-7dd52429173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:18.590020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:18.615584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505736c2-12b1-4d27-a907-1695cff9a148 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:18.660570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b264537-5042-498b-bc61-34dc28516ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:18.661296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b264537-5042-498b-bc61-34dc28516ebd None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:18.661586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b264537-5042-498b-bc61-34dc28516ebd None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:18.661870 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b264537-5042-498b-bc61-34dc28516ebd None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:18.663883 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b264537-5042-498b-bc61-34dc28516ebd None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:18.665467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b264537-5042-498b-bc61-34dc28516ebd None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:18.668172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 68/137] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:18 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:18.676535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b264537-5042-498b-bc61-34dc28516ebd None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:18.790999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 70/138] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:18.803961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b264537-5042-498b-bc61-34dc28516ebd None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:18.819715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634ae66-d607-47f5-ad2d-7dd52429173d None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:18.846244 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41657f0-f029-4663-8452-c0fcc855f8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:18.847210 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41657f0-f029-4663-8452-c0fcc855f8b3 None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:18.847526 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41657f0-f029-4663-8452-c0fcc855f8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:18.847812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41657f0-f029-4663-8452-c0fcc855f8b3 None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac/users/219a03f07bac42d1b262d74a9cd3c014/roles/fcaec44122534716b69d5e7f05160915` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:18.851431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41657f0-f029-4663-8452-c0fcc855f8b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c42f8c638d1645be870a7efafeb6b2ac, user_id=219a03f07bac42d1b262d74a9cd3c014, role_id=fcaec44122534716b69d5e7f05160915)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:18.853553 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41657f0-f029-4663-8452-c0fcc855f8b3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:18.870862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:18.874959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 69/139] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:35:18 2022] PUT /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac/users/219a03f07bac42d1b262d74a9cd3c014/roles/fcaec44122534716b69d5e7f05160915 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:35:18.959082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634ae66-d607-47f5-ad2d-7dd52429173d None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:19.012233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea92888-2776-4951-b1a4-ca4082b904e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:19.012914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea92888-2776-4951-b1a4-ca4082b904e1 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:19.013202 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea92888-2776-4951-b1a4-ca4082b904e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:19.013489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea92888-2776-4951-b1a4-ca4082b904e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:19.014770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea92888-2776-4951-b1a4-ca4082b904e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:19.016437 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea92888-2776-4951-b1a4-ca4082b904e1 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:19.018562 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 71/140] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:35:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:19.024326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41657f0-f029-4663-8452-c0fcc855f8b3 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:19.157740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41657f0-f029-4663-8452-c0fcc855f8b3 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:19.198952 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc19ac-ac95-4981-ad96-ccfd90babfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:19.199584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc19ac-ac95-4981-ad96-ccfd90babfed None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:19.199867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc19ac-ac95-4981-ad96-ccfd90babfed None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:19.200142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc19ac-ac95-4981-ad96-ccfd90babfed None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:19.200910 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc19ac-ac95-4981-ad96-ccfd90babfed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:19.202446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc19ac-ac95-4981-ad96-ccfd90babfed None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:19.237726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4ad4e-3b64-4aa7-aa28-66c8396d722d None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:19.239119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 70/141] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:35:19 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:35:19.239413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4ad4e-3b64-4aa7-aa28-66c8396d722d None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:19.239762 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4ad4e-3b64-4aa7-aa28-66c8396d722d None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:19.242425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 72/142] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:19.249187 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647398d-fa7f-4c22-be27-758f3ee4cfa5 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:19.249783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647398d-fa7f-4c22-be27-758f3ee4cfa5 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:19.250281 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647398d-fa7f-4c22-be27-758f3ee4cfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:19.270486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e647398d-fa7f-4c22-be27-758f3ee4cfa5 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:19.272020 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e647398d-fa7f-4c22-be27-758f3ee4cfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:19.338211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:19.362307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 71/143] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:19.365576 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e5b27-ee67-45a7-b780-ce646e334170 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:19.365961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e5b27-ee67-45a7-b780-ce646e334170 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:19.366348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e5b27-ee67-45a7-b780-ce646e334170 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:19.367808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 73/144] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:19.373805 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f394a5-0fde-4cb5-be52-a4de2df141e8 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:19.374411 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f394a5-0fde-4cb5-be52-a4de2df141e8 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:19.374873 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f394a5-0fde-4cb5-be52-a4de2df141e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:19.403361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-61f394a5-0fde-4cb5-be52-a4de2df141e8 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:19.404864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-61f394a5-0fde-4cb5-be52-a4de2df141e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:19.429048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e5b27-ee67-45a7-b780-ce646e334170 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:19.461570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:19.502160 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 72/145] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:19.546394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f394a5-0fde-4cb5-be52-a4de2df141e8 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:19.635711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e5b27-ee67-45a7-b780-ce646e334170 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:19.674393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3037a-470f-4ef9-ac57-9645f419fe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:19.675086 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3037a-470f-4ef9-ac57-9645f419fe2f None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:19.675369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3037a-470f-4ef9-ac57-9645f419fe2f None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:19.675711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3037a-470f-4ef9-ac57-9645f419fe2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:19.688208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3037a-470f-4ef9-ac57-9645f419fe2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-81d3037a-470f-4ef9-ac57-9645f419fe2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:19.695746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:19.696701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:19.697500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:19.697500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:19.697500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:19.697500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:19.697500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:19.697500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:19.697500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:19.697500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:19.697500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:19.697500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:19.697500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:19.697500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:19.697500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 74/146] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:19.705191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3037a-470f-4ef9-ac57-9645f419fe2f None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:19.782636 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f394a5-0fde-4cb5-be52-a4de2df141e8 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:19.791750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:19.804395 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:19.829071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3037a-470f-4ef9-ac57-9645f419fe2f None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:19.831164 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cc172-37b7-4e5f-9f7f-16d562dea68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:19.832117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cc172-37b7-4e5f-9f7f-16d562dea68c None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:19.832528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cc172-37b7-4e5f-9f7f-16d562dea68c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:19.832877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cc172-37b7-4e5f-9f7f-16d562dea68c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:19.847142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cc172-37b7-4e5f-9f7f-16d562dea68c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-3a6cc172-37b7-4e5f-9f7f-16d562dea68c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:19.853426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:19.855323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:19.856649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:19.856649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:19.856649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:19.856649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:19.856649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:19.856649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:19.856649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:19.856649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:19.856649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:19.856649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:19.856649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:19.856649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:19.856649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 73/147] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:19.864087 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cc172-37b7-4e5f-9f7f-16d562dea68c None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:19.883779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4d0aa-a0b0-484f-9e8b-c24ea6a7eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:19.884417 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d0aa-a0b0-484f-9e8b-c24ea6a7eea5 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:19.884700 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d0aa-a0b0-484f-9e8b-c24ea6a7eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:19.884978 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d0aa-a0b0-484f-9e8b-c24ea6a7eea5 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:19.885714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4d0aa-a0b0-484f-9e8b-c24ea6a7eea5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:19.886021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4d0aa-a0b0-484f-9e8b-c24ea6a7eea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:19.888162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4d0aa-a0b0-484f-9e8b-c24ea6a7eea5 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:19.898347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 75/148] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:19.903661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4d0aa-a0b0-484f-9e8b-c24ea6a7eea5 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:20.017414 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cc172-37b7-4e5f-9f7f-16d562dea68c None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:20.043046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4d0aa-a0b0-484f-9e8b-c24ea6a7eea5 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:20.067604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bca2f7-2431-419a-988c-8337f45db781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:20.068244 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bca2f7-2431-419a-988c-8337f45db781 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:20.068538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bca2f7-2431-419a-988c-8337f45db781 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:20.068814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bca2f7-2431-419a-988c-8337f45db781 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:20.069556 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bca2f7-2431-419a-988c-8337f45db781 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:20.070461 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bca2f7-2431-419a-988c-8337f45db781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:20.072180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bca2f7-2431-419a-988c-8337f45db781 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:20.084812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 74/149] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:20.091024 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bca2f7-2431-419a-988c-8337f45db781 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:20.095823 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5953b-be03-4f26-94a7-3f5d4518f0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:20.096519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5953b-be03-4f26-94a7-3f5d4518f0eb None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:20.096785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5953b-be03-4f26-94a7-3f5d4518f0eb None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:20.097066 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5953b-be03-4f26-94a7-3f5d4518f0eb None admin] PATH_INFO: `/v3/users/219a03f07bac42d1b262d74a9cd3c014` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:20.098862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5953b-be03-4f26-94a7-3f5d4518f0eb None admin] RBAC: Authorizing `identity:get_user(user_id=219a03f07bac42d1b262d74a9cd3c014)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:20.100930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5953b-be03-4f26-94a7-3f5d4518f0eb None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:20.104416 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 76/150] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:19 2022] GET /identity/v3/users/219a03f07bac42d1b262d74a9cd3c014 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:20.111372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5953b-be03-4f26-94a7-3f5d4518f0eb None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:20.116640 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:20.153989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:20.277599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bca2f7-2431-419a-988c-8337f45db781 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:20.303718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5953b-be03-4f26-94a7-3f5d4518f0eb None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:20.348363 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b921ad-b0b8-40be-a22d-797cc9d835be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:20.349856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b921ad-b0b8-40be-a22d-797cc9d835be None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:20.350288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b921ad-b0b8-40be-a22d-797cc9d835be None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:20.350568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b921ad-b0b8-40be-a22d-797cc9d835be None admin] PATH_INFO: `/v3/users/4108d69e697a4a34aef42ade8e4521ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:20.354818 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2bdf3-4b43-4d72-be55-c84b9f6b77b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:20.355121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b921ad-b0b8-40be-a22d-797cc9d835be None admin] RBAC: Authorizing `identity:get_user(user_id=4108d69e697a4a34aef42ade8e4521ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:20.355561 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2bdf3-4b43-4d72-be55-c84b9f6b77b1 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:20.355844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2bdf3-4b43-4d72-be55-c84b9f6b77b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:20.356118 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2bdf3-4b43-4d72-be55-c84b9f6b77b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:20.356536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b921ad-b0b8-40be-a22d-797cc9d835be None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:20.358336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 75/151] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:20 2022] GET /identity/v3/users/4108d69e697a4a34aef42ade8e4521ac => generated 289 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:20.364022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b921ad-b0b8-40be-a22d-797cc9d835be None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:20.457706 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2bdf3-4b43-4d72-be55-c84b9f6b77b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:20.461383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2bdf3-4b43-4d72-be55-c84b9f6b77b1 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:20.463525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:20.523534 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b921ad-b0b8-40be-a22d-797cc9d835be None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:20.533220 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:20.572529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 77/152] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 10:35:20.577916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2bdf3-4b43-4d72-be55-c84b9f6b77b1 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:20.581207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaee20-e021-45ca-bbdf-4aba339f3bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:20.582449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaee20-e021-45ca-bbdf-4aba339f3bdd None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:20.582738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaee20-e021-45ca-bbdf-4aba339f3bdd None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:20.583014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaee20-e021-45ca-bbdf-4aba339f3bdd None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:20.584226 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaee20-e021-45ca-bbdf-4aba339f3bdd None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:20.585696 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaee20-e021-45ca-bbdf-4aba339f3bdd None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:20.587536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 76/153] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:20 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:20.607893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaee20-e021-45ca-bbdf-4aba339f3bdd None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:20.689658 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2bdf3-4b43-4d72-be55-c84b9f6b77b1 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:20.691777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:20.727724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b68b2-bed0-44da-8cff-85446d763087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:20.728383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b68b2-bed0-44da-8cff-85446d763087 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:20.728664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b68b2-bed0-44da-8cff-85446d763087 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:20.728938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b68b2-bed0-44da-8cff-85446d763087 None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:20.730131 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b68b2-bed0-44da-8cff-85446d763087 None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:20.731607 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b68b2-bed0-44da-8cff-85446d763087 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:20.733281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 78/154] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:20 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:20.739060 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b68b2-bed0-44da-8cff-85446d763087 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:20.791078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaee20-e021-45ca-bbdf-4aba339f3bdd None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:20.845076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b68b2-bed0-44da-8cff-85446d763087 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:20.857910 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a2077-7efc-448c-92c9-319fdd9a009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:20.858724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a2077-7efc-448c-92c9-319fdd9a009c None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:20.859181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a2077-7efc-448c-92c9-319fdd9a009c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:20.859521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a2077-7efc-448c-92c9-319fdd9a009c None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac/users/4108d69e697a4a34aef42ade8e4521ac/roles/2838dfaf550b4ad68846863e49c6a7ae` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:20.861883 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a2077-7efc-448c-92c9-319fdd9a009c None admin] RBAC: Authorizing `identity:create_grant(project_id=c42f8c638d1645be870a7efafeb6b2ac, user_id=4108d69e697a4a34aef42ade8e4521ac, role_id=2838dfaf550b4ad68846863e49c6a7ae)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:20.864292 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a2077-7efc-448c-92c9-319fdd9a009c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:20.882351 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaa530-9b6e-41d8-93b5-6f58faeca027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:20.883161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaa530-9b6e-41d8-93b5-6f58faeca027 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:20.883382 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaa530-9b6e-41d8-93b5-6f58faeca027 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:20.883582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaa530-9b6e-41d8-93b5-6f58faeca027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:20.884386 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaa530-9b6e-41d8-93b5-6f58faeca027 None admin] RBAC: Adding query filter params (role.id=eef1174229014437a0db0fd8954bc25e, scope.project.id=c42f8c638d1645be870a7efafeb6b2ac, user.id=219a03f07bac42d1b262d74a9cd3c014) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:20.884703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaa530-9b6e-41d8-93b5-6f58faeca027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:20.886209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaa530-9b6e-41d8-93b5-6f58faeca027 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:20.892848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 79/155] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:20 2022] GET /identity/v3/role_assignments?user.id=219a03f07bac42d1b262d74a9cd3c014&scope.project.id=c42f8c638d1645be870a7efafeb6b2ac&role.id=eef1174229014437a0db0fd8954bc25e => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:20.893863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 77/156] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:35:20 2022] PUT /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac/users/4108d69e697a4a34aef42ade8e4521ac/roles/2838dfaf550b4ad68846863e49c6a7ae => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:35:22.173686 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94498b10-70cf-4d1a-9c3c-5dcf33546861 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:22.174244 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94498b10-70cf-4d1a-9c3c-5dcf33546861 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:22.174244 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94498b10-70cf-4d1a-9c3c-5dcf33546861 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:22.175991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 80/157] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:22.181373 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de80cf-44c2-4dc9-bbf4-0ecb977c9278 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:22.182242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de80cf-44c2-4dc9-bbf4-0ecb977c9278 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:22.182731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de80cf-44c2-4dc9-bbf4-0ecb977c9278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:22.206505 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b9de80cf-44c2-4dc9-bbf4-0ecb977c9278 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:22.208598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b9de80cf-44c2-4dc9-bbf4-0ecb977c9278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:22.248124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:22.289472 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863373e-5bcf-40f7-8eb1-a29d3cd3fe67 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:22.290139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863373e-5bcf-40f7-8eb1-a29d3cd3fe67 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:22.290718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863373e-5bcf-40f7-8eb1-a29d3cd3fe67 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:22.292456 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 81/158] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:35:22.304252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc946cd-beb8-490c-b651-4197ff88f161 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:22.304869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc946cd-beb8-490c-b651-4197ff88f161 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:22.305411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc946cd-beb8-490c-b651-4197ff88f161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:22.343130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 78/159] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:22.344459 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6cc946cd-beb8-490c-b651-4197ff88f161 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:22.345899 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6cc946cd-beb8-490c-b651-4197ff88f161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:22.388887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:22.435546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de80cf-44c2-4dc9-bbf4-0ecb977c9278 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:22.463569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 82/160] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:22.507526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc946cd-beb8-490c-b651-4197ff88f161 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:22.592433 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de80cf-44c2-4dc9-bbf4-0ecb977c9278 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:22.643594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef7d4d-522f-46bf-8ef4-48b8aa5d6cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:22.643594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef7d4d-522f-46bf-8ef4-48b8aa5d6cd7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:22.643594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef7d4d-522f-46bf-8ef4-48b8aa5d6cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:22.643594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef7d4d-522f-46bf-8ef4-48b8aa5d6cd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:22.664040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef7d4d-522f-46bf-8ef4-48b8aa5d6cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-67ef7d4d-522f-46bf-8ef4-48b8aa5d6cd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:22.669782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:22.670725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:22.671513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:22.671513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:22.671513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:22.671513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:22.671513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:22.671513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:22.671513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:22.671513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:22.671513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:22.671513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:22.671513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:22.671513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:22.671513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 79/161] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:35:22.678263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef7d4d-522f-46bf-8ef4-48b8aa5d6cd7 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:22.708991 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:22.721398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc946cd-beb8-490c-b651-4197ff88f161 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:22.818453 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394eb55-5c4f-45ab-aff1-dd828eb3eae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:22.820655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394eb55-5c4f-45ab-aff1-dd828eb3eae4 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:22.821143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394eb55-5c4f-45ab-aff1-dd828eb3eae4 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:22.822525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394eb55-5c4f-45ab-aff1-dd828eb3eae4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:22.851653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394eb55-5c4f-45ab-aff1-dd828eb3eae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-5394eb55-5c4f-45ab-aff1-dd828eb3eae4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:22.858887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:22.859949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:22.860959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:22.860959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:22.860959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:22.860959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:22.860959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:22.860959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:22.860959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:22.860959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:22.860959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:22.860959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:22.860959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:22.860959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:22.865719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 83/162] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:35:22.875333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394eb55-5c4f-45ab-aff1-dd828eb3eae4 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:22.910997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef7d4d-522f-46bf-8ef4-48b8aa5d6cd7 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:22.920389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:22.980319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb10fde-3cd8-4744-9399-9343f9e1606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:22.981187 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10fde-3cd8-4744-9399-9343f9e1606a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:22.981610 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10fde-3cd8-4744-9399-9343f9e1606a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:22.982025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10fde-3cd8-4744-9399-9343f9e1606a None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:22.982942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb10fde-3cd8-4744-9399-9343f9e1606a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:22.983491 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb10fde-3cd8-4744-9399-9343f9e1606a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:22.985033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb10fde-3cd8-4744-9399-9343f9e1606a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:23.005616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 80/163] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:23.006788 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c429ea-3d3c-49e8-b5db-a946ecc8274a None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:23.007084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c429ea-3d3c-49e8-b5db-a946ecc8274a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:23.007364 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c429ea-3d3c-49e8-b5db-a946ecc8274a None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:23.008686 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 81/164] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:23.020787 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0185-c217-43e0-913d-c301a73fcbd2 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:23.021077 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0185-c217-43e0-913d-c301a73fcbd2 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:23.021361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c0185-c217-43e0-913d-c301a73fcbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:23.063296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-de5c0185-c217-43e0-913d-c301a73fcbd2 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:23.063492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394eb55-5c4f-45ab-aff1-dd828eb3eae4 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:23.064524 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-de5c0185-c217-43e0-913d-c301a73fcbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:23.152552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbff1b1-3344-4698-a4bf-18d4871328a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:23.153186 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbff1b1-3344-4698-a4bf-18d4871328a5 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:23.153467 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbff1b1-3344-4698-a4bf-18d4871328a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:23.153746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbff1b1-3344-4698-a4bf-18d4871328a5 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:23.154507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbff1b1-3344-4698-a4bf-18d4871328a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:23.154815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbff1b1-3344-4698-a4bf-18d4871328a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:23.156218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbff1b1-3344-4698-a4bf-18d4871328a5 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:23.173832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 84/165] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:23.174478 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbff1b1-3344-4698-a4bf-18d4871328a5 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:23.260308 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 82/166] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:23.261115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c0185-c217-43e0-913d-c301a73fcbd2 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:23.308024 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:23.335496 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:23.350885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbff1b1-3344-4698-a4bf-18d4871328a5 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:23.423607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c0185-c217-43e0-913d-c301a73fcbd2 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:23.449621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d913267-f89f-41c0-ac18-9d1e13501a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:23.450316 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d913267-f89f-41c0-ac18-9d1e13501a0c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:23.450619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d913267-f89f-41c0-ac18-9d1e13501a0c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:23.450878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d913267-f89f-41c0-ac18-9d1e13501a0c None admin] PATH_INFO: `/v3/users/877c11b74f674bd1b8410ffe1d18db3e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:23.452064 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d913267-f89f-41c0-ac18-9d1e13501a0c None admin] RBAC: Authorizing `identity:get_user(user_id=877c11b74f674bd1b8410ffe1d18db3e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:23.453515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d913267-f89f-41c0-ac18-9d1e13501a0c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:23.455179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 85/167] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:23 2022] GET /identity/v3/users/877c11b74f674bd1b8410ffe1d18db3e => generated 247 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:23.455941 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d913267-f89f-41c0-ac18-9d1e13501a0c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:23.500027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f771e4-f08e-43d3-98a4-9dc07b3577dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:23.500929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f771e4-f08e-43d3-98a4-9dc07b3577dd None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:23.501213 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f771e4-f08e-43d3-98a4-9dc07b3577dd None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:23.501487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f771e4-f08e-43d3-98a4-9dc07b3577dd None admin] PATH_INFO: `/v3/users/219a03f07bac42d1b262d74a9cd3c014` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:23.503562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f771e4-f08e-43d3-98a4-9dc07b3577dd None admin] RBAC: Authorizing `identity:get_user(user_id=219a03f07bac42d1b262d74a9cd3c014)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:23.505150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f771e4-f08e-43d3-98a4-9dc07b3577dd None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:23.506981 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 83/168] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:23 2022] GET /identity/v3/users/219a03f07bac42d1b262d74a9cd3c014 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:23.508069 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f771e4-f08e-43d3-98a4-9dc07b3577dd None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:23.618744 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:23.650020 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f771e4-f08e-43d3-98a4-9dc07b3577dd None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:23.691433 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d913267-f89f-41c0-ac18-9d1e13501a0c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:23.701445 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ac226-80d2-4ab7-b9a7-266549a73359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:23.702129 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ac226-80d2-4ab7-b9a7-266549a73359 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:23.702557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ac226-80d2-4ab7-b9a7-266549a73359 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:23.702835 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ac226-80d2-4ab7-b9a7-266549a73359 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:23.732866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dd716-4dcf-43b8-a039-c498e7d6917a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:23.733514 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dd716-4dcf-43b8-a039-c498e7d6917a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:23.733826 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dd716-4dcf-43b8-a039-c498e7d6917a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:23.734058 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dd716-4dcf-43b8-a039-c498e7d6917a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:23.749748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998dd716-4dcf-43b8-a039-c498e7d6917a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-998dd716-4dcf-43b8-a039-c498e7d6917a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:23.755848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:23.756765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:23.757541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:23.757541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:23.757541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:23.757541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:23.757541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:23.757541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:23.757541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:23.757541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:23.757541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:23.757541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:23.757541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:23.757541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:23.761846 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 86/169] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:35:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:23.762736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dd716-4dcf-43b8-a039-c498e7d6917a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:23.780171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:23.808369 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ac226-80d2-4ab7-b9a7-266549a73359 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:23.811498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ac226-80d2-4ab7-b9a7-266549a73359 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:23.875776 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dd716-4dcf-43b8-a039-c498e7d6917a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:23.920148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278d090-3a8d-448f-a70f-31fa13ef83ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:23.920928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278d090-3a8d-448f-a70f-31fa13ef83ca None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:23.921387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278d090-3a8d-448f-a70f-31fa13ef83ca None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:23.921668 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278d090-3a8d-448f-a70f-31fa13ef83ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:23.940189 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:23.966423 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 84/170] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:23.968020 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c297f6-b6d6-4243-8624-28c76ae66421 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:23.968478 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c297f6-b6d6-4243-8624-28c76ae66421 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:23.968913 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c297f6-b6d6-4243-8624-28c76ae66421 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:23.970466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 85/171] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:23.976091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085cd2c-65c1-4272-839e-98fe62952597 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:23.977231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085cd2c-65c1-4272-839e-98fe62952597 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:23.977695 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085cd2c-65c1-4272-839e-98fe62952597 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:23.980066 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 86/172] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:23.981604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085cd2c-65c1-4272-839e-98fe62952597 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:24.026345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278d090-3a8d-448f-a70f-31fa13ef83ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:24.027956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278d090-3a8d-448f-a70f-31fa13ef83ca None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:24.047327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:24.112580 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085cd2c-65c1-4272-839e-98fe62952597 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:24.149148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 87/173] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:24.149148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278d090-3a8d-448f-a70f-31fa13ef83ca None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:24.156837 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c061cb-334b-4e80-9d4b-31259f8dcbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:24.157463 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c061cb-334b-4e80-9d4b-31259f8dcbc1 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:24.157744 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c061cb-334b-4e80-9d4b-31259f8dcbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:24.158019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c061cb-334b-4e80-9d4b-31259f8dcbc1 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:24.158786 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c061cb-334b-4e80-9d4b-31259f8dcbc1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:24.159092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c061cb-334b-4e80-9d4b-31259f8dcbc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:24.160556 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c061cb-334b-4e80-9d4b-31259f8dcbc1 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:24.168897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 87/174] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:35:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:24.169948 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277fd48-fd70-4e22-a68d-a6b7a0e3641a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:24.170266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277fd48-fd70-4e22-a68d-a6b7a0e3641a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:24.170542 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277fd48-fd70-4e22-a68d-a6b7a0e3641a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:24.189016 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-4277fd48-fd70-4e22-a68d-a6b7a0e3641a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:24.190242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4277fd48-fd70-4e22-a68d-a6b7a0e3641a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:24.237366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:24.261321 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278d090-3a8d-448f-a70f-31fa13ef83ca None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:24.266638 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 88/175] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:24.267906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f85059-8108-42df-9148-061ced942219 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:24.268193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f85059-8108-42df-9148-061ced942219 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:24.268471 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f85059-8108-42df-9148-061ced942219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:24.278576 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:24.293215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-24f85059-8108-42df-9148-061ced942219 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:24.294440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-24f85059-8108-42df-9148-061ced942219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:24.301549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5467106-032a-4da3-b352-c43437e74661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:24.302224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5467106-032a-4da3-b352-c43437e74661 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:24.302547 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5467106-032a-4da3-b352-c43437e74661 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:24.302830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5467106-032a-4da3-b352-c43437e74661 None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:24.304056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5467106-032a-4da3-b352-c43437e74661 None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:24.305530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5467106-032a-4da3-b352-c43437e74661 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:24.307269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 88/176] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:24 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:24.308542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81f191-17f1-4bb3-9c98-9e266b982f1e None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:24.308832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81f191-17f1-4bb3-9c98-9e266b982f1e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:24.309111 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81f191-17f1-4bb3-9c98-9e266b982f1e None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:24.312923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 89/177] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:24.312923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81f191-17f1-4bb3-9c98-9e266b982f1e None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:24.369716 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 89/178] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:24.371059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f85059-8108-42df-9148-061ced942219 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:24.427689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81f191-17f1-4bb3-9c98-9e266b982f1e None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:24.465064 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2d288-58cb-44c8-bd76-3fa938f644bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:24.465713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2d288-58cb-44c8-bd76-3fa938f644bd None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:24.465995 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2d288-58cb-44c8-bd76-3fa938f644bd None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:24.466301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2d288-58cb-44c8-bd76-3fa938f644bd None admin] PATH_INFO: `/v3/projects/41a3e603183f48f0b1354fca971ddd00` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:24.467462 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2d288-58cb-44c8-bd76-3fa938f644bd None admin] RBAC: Authorizing `identity:get_project(project_id=41a3e603183f48f0b1354fca971ddd00)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:24.468914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2d288-58cb-44c8-bd76-3fa938f644bd None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:24.470628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 90/179] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:24 2022] GET /identity/v3/projects/41a3e603183f48f0b1354fca971ddd00 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:24.475638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0cf9-2c0b-45c0-b865-0429d24f525d None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:24.475638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0cf9-2c0b-45c0-b865-0429d24f525d None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:24.475638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0cf9-2c0b-45c0-b865-0429d24f525d None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:24.475638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 91/180] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:24.475638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0cf9-2c0b-45c0-b865-0429d24f525d None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:24.475950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f85059-8108-42df-9148-061ced942219 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:24.484109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:24.512840 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae35ff3-d834-4bb7-b831-7df502d76f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:24.513588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35ff3-d834-4bb7-b831-7df502d76f01 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:24.513880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35ff3-d834-4bb7-b831-7df502d76f01 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:24.514159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35ff3-d834-4bb7-b831-7df502d76f01 None admin] PATH_INFO: `/v3/users/219a03f07bac42d1b262d74a9cd3c014` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:24.515384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae35ff3-d834-4bb7-b831-7df502d76f01 None admin] RBAC: Authorizing `identity:get_user(user_id=219a03f07bac42d1b262d74a9cd3c014)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:24.516838 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae35ff3-d834-4bb7-b831-7df502d76f01 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:24.518503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 90/181] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:24 2022] GET /identity/v3/users/219a03f07bac42d1b262d74a9cd3c014 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:24.520156 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae35ff3-d834-4bb7-b831-7df502d76f01 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:24.531639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:24.585191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0cf9-2c0b-45c0-b865-0429d24f525d None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:24.619445 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26243281-c3e8-49ff-aded-eac0fcf30b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:24.620086 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26243281-c3e8-49ff-aded-eac0fcf30b19 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:24.620369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26243281-c3e8-49ff-aded-eac0fcf30b19 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:24.620648 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26243281-c3e8-49ff-aded-eac0fcf30b19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:24.623124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae35ff3-d834-4bb7-b831-7df502d76f01 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:24.632095 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26243281-c3e8-49ff-aded-eac0fcf30b19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-26243281-c3e8-49ff-aded-eac0fcf30b19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:24.637152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:24.638047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:24.638886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:24.638886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:24.638886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:24.638886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:24.638886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:24.638886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:24.638886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:24.638886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:24.638886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:24.638886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:24.638886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:24.638886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:24.638886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 92/182] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:35:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:24.639542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4c0a4-3305-43fb-8b83-0586f794b14a None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:24.639871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4c0a4-3305-43fb-8b83-0586f794b14a None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:24.640127 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4c0a4-3305-43fb-8b83-0586f794b14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:24.658438 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-ccc4c0a4-3305-43fb-8b83-0586f794b14a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:24.659676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ccc4c0a4-3305-43fb-8b83-0586f794b14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:24.664065 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004cf6c-85ec-4cab-82f5-d8d085e09d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:24.664685 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004cf6c-85ec-4cab-82f5-d8d085e09d9d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:24.664964 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004cf6c-85ec-4cab-82f5-d8d085e09d9d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:24.665238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004cf6c-85ec-4cab-82f5-d8d085e09d9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:24.666039 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004cf6c-85ec-4cab-82f5-d8d085e09d9d None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=c42f8c638d1645be870a7efafeb6b2ac, user.id=877c11b74f674bd1b8410ffe1d18db3e) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:24.666382 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004cf6c-85ec-4cab-82f5-d8d085e09d9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:24.667810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004cf6c-85ec-4cab-82f5-d8d085e09d9d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:24.673606 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 91/183] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:24 2022] GET /identity/v3/role_assignments?user.id=877c11b74f674bd1b8410ffe1d18db3e&scope.project.id=c42f8c638d1645be870a7efafeb6b2ac&role.id=36208a24005e4ff98d827138292bea37 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:24.674405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004cf6c-85ec-4cab-82f5-d8d085e09d9d None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:24.720486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:24.754868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 93/184] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:24.755785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4c0a4-3305-43fb-8b83-0586f794b14a None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:24.803053 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:24.816692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004cf6c-85ec-4cab-82f5-d8d085e09d9d None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:24.859402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac98b51-55cb-419b-b4be-d4e6a64d8aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:24.860051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac98b51-55cb-419b-b4be-d4e6a64d8aa8 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:24.860337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac98b51-55cb-419b-b4be-d4e6a64d8aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:24.860611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac98b51-55cb-419b-b4be-d4e6a64d8aa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:24.881353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac98b51-55cb-419b-b4be-d4e6a64d8aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:24.885147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4c0a4-3305-43fb-8b83-0586f794b14a None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-aac98b51-55cb-419b-b4be-d4e6a64d8aa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:24.890784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:24.891879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:24.892816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:24.892816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:24.892816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:24.892816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:24.892816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:24.892816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:24.892816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:24.892816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:24.892816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:24.892816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:24.892816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:24.892816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:24.892816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 92/185] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:24.894872 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f898ec-00c0-4d7f-80f8-35b0aa38ebe7 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:24.895361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f898ec-00c0-4d7f-80f8-35b0aa38ebe7 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:24.895893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f898ec-00c0-4d7f-80f8-35b0aa38ebe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:24.921246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-a4f898ec-00c0-4d7f-80f8-35b0aa38ebe7 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:24.922492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a4f898ec-00c0-4d7f-80f8-35b0aa38ebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:24.930155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c218625-e738-4b01-80ec-c2589cc32044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:24.930813 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c218625-e738-4b01-80ec-c2589cc32044 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:24.931093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c218625-e738-4b01-80ec-c2589cc32044 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:24.931367 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c218625-e738-4b01-80ec-c2589cc32044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:24.932160 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c218625-e738-4b01-80ec-c2589cc32044 None admin] RBAC: Adding query filter params (role.id=eef1174229014437a0db0fd8954bc25e, scope.project.id=41a3e603183f48f0b1354fca971ddd00, user.id=219a03f07bac42d1b262d74a9cd3c014) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:24.932476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c218625-e738-4b01-80ec-c2589cc32044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:24.933924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c218625-e738-4b01-80ec-c2589cc32044 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:24.940047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 94/186] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:24 2022] GET /identity/v3/role_assignments?user.id=219a03f07bac42d1b262d74a9cd3c014&scope.project.id=41a3e603183f48f0b1354fca971ddd00&role.id=eef1174229014437a0db0fd8954bc25e => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:24.940826 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c218625-e738-4b01-80ec-c2589cc32044 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:24.998963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 93/187] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:24.999821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f898ec-00c0-4d7f-80f8-35b0aa38ebe7 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:25.043239 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:25.068994 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c218625-e738-4b01-80ec-c2589cc32044 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:25.071559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:25.109788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f541b7-0e9f-42ec-8662-f9d9ba85e9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:25.110624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f541b7-0e9f-42ec-8662-f9d9ba85e9ff None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:25.110906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f541b7-0e9f-42ec-8662-f9d9ba85e9ff None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:25.111187 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f541b7-0e9f-42ec-8662-f9d9ba85e9ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:25.134267 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f898ec-00c0-4d7f-80f8-35b0aa38ebe7 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:25.180831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c36512-4c2e-411e-bba3-d1ee5ead9320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:25.181469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c36512-4c2e-411e-bba3-d1ee5ead9320 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:25.181750 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c36512-4c2e-411e-bba3-d1ee5ead9320 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:25.182034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c36512-4c2e-411e-bba3-d1ee5ead9320 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:25.182825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c36512-4c2e-411e-bba3-d1ee5ead9320 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:25.183127 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c36512-4c2e-411e-bba3-d1ee5ead9320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:25.184509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c36512-4c2e-411e-bba3-d1ee5ead9320 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:25.187194 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f541b7-0e9f-42ec-8662-f9d9ba85e9ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:25.188662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f541b7-0e9f-42ec-8662-f9d9ba85e9ff None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:25.193864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 94/188] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:35:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:25.194555 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c36512-4c2e-411e-bba3-d1ee5ead9320 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:25.285574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:25.289782 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 95/189] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:25.290679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f541b7-0e9f-42ec-8662-f9d9ba85e9ff None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:25.294125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:25.302890 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c36512-4c2e-411e-bba3-d1ee5ead9320 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:25.337230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d9c31-2afd-495c-8f2d-de759e6efdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:25.338434 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9c31-2afd-495c-8f2d-de759e6efdbc None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:25.338434 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9c31-2afd-495c-8f2d-de759e6efdbc None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:25.338434 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d9c31-2afd-495c-8f2d-de759e6efdbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:25.339635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d9c31-2afd-495c-8f2d-de759e6efdbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:25.341048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d9c31-2afd-495c-8f2d-de759e6efdbc None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:25.342683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 95/190] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:35:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:25.343439 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d9c31-2afd-495c-8f2d-de759e6efdbc None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:25.395857 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f541b7-0e9f-42ec-8662-f9d9ba85e9ff None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:25.437912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72104e-e5bb-4f21-a7cb-96b4d9dfb3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:25.438932 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72104e-e5bb-4f21-a7cb-96b4d9dfb3fa None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:25.439687 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72104e-e5bb-4f21-a7cb-96b4d9dfb3fa None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:25.439900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72104e-e5bb-4f21-a7cb-96b4d9dfb3fa None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:25.441142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72104e-e5bb-4f21-a7cb-96b4d9dfb3fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:25.441637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72104e-e5bb-4f21-a7cb-96b4d9dfb3fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:25.444050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72104e-e5bb-4f21-a7cb-96b4d9dfb3fa None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:25.457084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 96/191] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:25.458372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72104e-e5bb-4f21-a7cb-96b4d9dfb3fa None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:25.465622 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d9c31-2afd-495c-8f2d-de759e6efdbc None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:25.502061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb632a-3f75-4a4c-b522-205a1f6458a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:25.502741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb632a-3f75-4a4c-b522-205a1f6458a4 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:25.503023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb632a-3f75-4a4c-b522-205a1f6458a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:25.503305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb632a-3f75-4a4c-b522-205a1f6458a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:25.513615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb632a-3f75-4a4c-b522-205a1f6458a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-abcb632a-3f75-4a4c-b522-205a1f6458a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:25.519611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:25.520752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:25.521753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:25.521753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:25.521753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:25.521753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:25.521753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:25.521753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:25.521753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:25.521753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:25.521753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:25.521753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:25.521753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:25.521753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:25.526850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 96/192] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:25.527627 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb632a-3f75-4a4c-b522-205a1f6458a4 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:25.529898 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:25.547039 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:25.566959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72104e-e5bb-4f21-a7cb-96b4d9dfb3fa None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:25.601005 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdb607-a9bc-4cbb-a23c-93eaeef35b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:25.601639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdb607-a9bc-4cbb-a23c-93eaeef35b07 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:25.601918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdb607-a9bc-4cbb-a23c-93eaeef35b07 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:25.602215 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdb607-a9bc-4cbb-a23c-93eaeef35b07 None admin] PATH_INFO: `/v3/users/bfe46447abd443e9b3bbfc2695d6334f` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:25.616551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdb607-a9bc-4cbb-a23c-93eaeef35b07 None admin] RBAC: Authorizing `identity:get_user(user_id=bfe46447abd443e9b3bbfc2695d6334f)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:25.618064 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdb607-a9bc-4cbb-a23c-93eaeef35b07 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:25.619823 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 97/193] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:25 2022] GET /identity/v3/users/bfe46447abd443e9b3bbfc2695d6334f => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:25.620676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdb607-a9bc-4cbb-a23c-93eaeef35b07 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:25.633949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb632a-3f75-4a4c-b522-205a1f6458a4 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:25.669391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66650e3-5a1e-4bf5-ba6e-4abb6540a9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:25.670038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66650e3-5a1e-4bf5-ba6e-4abb6540a9a0 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:25.670353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66650e3-5a1e-4bf5-ba6e-4abb6540a9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:25.670630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66650e3-5a1e-4bf5-ba6e-4abb6540a9a0 None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:25.671926 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66650e3-5a1e-4bf5-ba6e-4abb6540a9a0 None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:25.673678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66650e3-5a1e-4bf5-ba6e-4abb6540a9a0 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:25.675379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 97/194] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:25 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:25.676137 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66650e3-5a1e-4bf5-ba6e-4abb6540a9a0 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:25.723647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdb607-a9bc-4cbb-a23c-93eaeef35b07 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:25.746944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:25.758121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5bc10-2235-4e9a-8f8a-a90f9b17c7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:25.758772 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5bc10-2235-4e9a-8f8a-a90f9b17c7c0 None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:25.759049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5bc10-2235-4e9a-8f8a-a90f9b17c7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:25.759322 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5bc10-2235-4e9a-8f8a-a90f9b17c7c0 None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:25.760007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5bc10-2235-4e9a-8f8a-a90f9b17c7c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:25.761447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5bc10-2235-4e9a-8f8a-a90f9b17c7c0 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:25.766121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:25.785432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 98/195] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:35:25 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:35:25.786286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5bc10-2235-4e9a-8f8a-a90f9b17c7c0 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:25.786395 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66650e3-5a1e-4bf5-ba6e-4abb6540a9a0 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:25.830362 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e48f19-8fe0-45b7-b36c-6c64f0cb204b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:25.831362 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e48f19-8fe0-45b7-b36c-6c64f0cb204b None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:25.832392 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e48f19-8fe0-45b7-b36c-6c64f0cb204b None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:25.832774 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e48f19-8fe0-45b7-b36c-6c64f0cb204b None admin] PATH_INFO: `/v3/users/bfe46447abd443e9b3bbfc2695d6334f` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:25.834131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e48f19-8fe0-45b7-b36c-6c64f0cb204b None admin] RBAC: Authorizing `identity:get_user(user_id=bfe46447abd443e9b3bbfc2695d6334f)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:25.835699 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e48f19-8fe0-45b7-b36c-6c64f0cb204b None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:25.837521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 98/196] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:25 2022] GET /identity/v3/users/bfe46447abd443e9b3bbfc2695d6334f => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:25.838456 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e48f19-8fe0-45b7-b36c-6c64f0cb204b None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:25.915281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5bc10-2235-4e9a-8f8a-a90f9b17c7c0 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:25.955332 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12143bc-13fc-449c-ae9a-42365fe64b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:25.955971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12143bc-13fc-449c-ae9a-42365fe64b92 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:25.956256 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12143bc-13fc-449c-ae9a-42365fe64b92 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:25.956633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12143bc-13fc-449c-ae9a-42365fe64b92 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:25.957552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12143bc-13fc-449c-ae9a-42365fe64b92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:25.959615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12143bc-13fc-449c-ae9a-42365fe64b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:25.959840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12143bc-13fc-449c-ae9a-42365fe64b92 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:25.970041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 99/197] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:25.970822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12143bc-13fc-449c-ae9a-42365fe64b92 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:25.978467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e48f19-8fe0-45b7-b36c-6c64f0cb204b None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:26.024537 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378877b-aae3-4d0d-a63c-6d5c8074cc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:26.025622 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378877b-aae3-4d0d-a63c-6d5c8074cc93 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:26.026098 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378877b-aae3-4d0d-a63c-6d5c8074cc93 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:26.026440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378877b-aae3-4d0d-a63c-6d5c8074cc93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:26.033012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:26.057174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:26.108423 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12143bc-13fc-449c-ae9a-42365fe64b92 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:26.117309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378877b-aae3-4d0d-a63c-6d5c8074cc93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:26.119205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378877b-aae3-4d0d-a63c-6d5c8074cc93 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:26.155044 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f104c5-e996-4b5c-93cc-1f16d14fc5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:26.155685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f104c5-e996-4b5c-93cc-1f16d14fc5b4 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:26.155971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f104c5-e996-4b5c-93cc-1f16d14fc5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:26.156248 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f104c5-e996-4b5c-93cc-1f16d14fc5b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:26.157327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f104c5-e996-4b5c-93cc-1f16d14fc5b4 None admin] RBAC: Adding query filter params (role.id=fcaec44122534716b69d5e7f05160915, scope.project.id=c42f8c638d1645be870a7efafeb6b2ac, user.id=219a03f07bac42d1b262d74a9cd3c014) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:26.157641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f104c5-e996-4b5c-93cc-1f16d14fc5b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:26.160066 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f104c5-e996-4b5c-93cc-1f16d14fc5b4 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:26.167647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 100/198] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:25 2022] GET /identity/v3/role_assignments?user.id=219a03f07bac42d1b262d74a9cd3c014&scope.project.id=c42f8c638d1645be870a7efafeb6b2ac&role.id=fcaec44122534716b69d5e7f05160915 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:26.168475 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f104c5-e996-4b5c-93cc-1f16d14fc5b4 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:26.260022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 99/199] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:26.261296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378877b-aae3-4d0d-a63c-6d5c8074cc93 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:26.351332 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f104c5-e996-4b5c-93cc-1f16d14fc5b4 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:26.367492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:26.390558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:26.422504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa142a-fc79-4228-9f33-aa3d4a0ac80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:26.423135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa142a-fc79-4228-9f33-aa3d4a0ac80a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:26.423421 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa142a-fc79-4228-9f33-aa3d4a0ac80a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:26.423703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa142a-fc79-4228-9f33-aa3d4a0ac80a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:26.451492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378877b-aae3-4d0d-a63c-6d5c8074cc93 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:26.502870 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51d2d1-6547-4cb9-bcd3-7e5ca49b337d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:26.504365 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d2d1-6547-4cb9-bcd3-7e5ca49b337d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:26.504768 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d2d1-6547-4cb9-bcd3-7e5ca49b337d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:26.505857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d2d1-6547-4cb9-bcd3-7e5ca49b337d None admin] PATH_INFO: `/v3/users/4108d69e697a4a34aef42ade8e4521ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:26.507597 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51d2d1-6547-4cb9-bcd3-7e5ca49b337d None admin] RBAC: Authorizing `identity:get_user(user_id=4108d69e697a4a34aef42ade8e4521ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:26.509988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51d2d1-6547-4cb9-bcd3-7e5ca49b337d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:26.510430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa142a-fc79-4228-9f33-aa3d4a0ac80a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:26.512198 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa142a-fc79-4228-9f33-aa3d4a0ac80a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:26.512396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 100/200] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:26 2022] GET /identity/v3/users/4108d69e697a4a34aef42ade8e4521ac => generated 289 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:26.513184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51d2d1-6547-4cb9-bcd3-7e5ca49b337d None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:26.632194 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 101/201] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:26.633188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa142a-fc79-4228-9f33-aa3d4a0ac80a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:26.641868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:26.651717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51d2d1-6547-4cb9-bcd3-7e5ca49b337d None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:26.681861 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:26.691306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e2e1f-f397-4b4b-9109-cf3a940426a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:26.692113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2e1f-f397-4b4b-9109-cf3a940426a3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:26.692496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2e1f-f397-4b4b-9109-cf3a940426a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:26.692870 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e2e1f-f397-4b4b-9109-cf3a940426a3 None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:26.694324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e2e1f-f397-4b4b-9109-cf3a940426a3 None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:26.695985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e2e1f-f397-4b4b-9109-cf3a940426a3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:26.698303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 101/202] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:26 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:26.699040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e2e1f-f397-4b4b-9109-cf3a940426a3 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:26.744486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa142a-fc79-4228-9f33-aa3d4a0ac80a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:26.785231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc86302-2a1b-43fe-9c2a-941f48545725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:26.786161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc86302-2a1b-43fe-9c2a-941f48545725 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:26.786651 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc86302-2a1b-43fe-9c2a-941f48545725 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:26.787104 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc86302-2a1b-43fe-9c2a-941f48545725 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:26.816661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e2e1f-f397-4b4b-9109-cf3a940426a3 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:26.852661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d9bbf-9caf-4d2f-acab-f1434e7c17fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:26.853318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d9bbf-9caf-4d2f-acab-f1434e7c17fd None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:26.853863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d9bbf-9caf-4d2f-acab-f1434e7c17fd None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:26.853863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d9bbf-9caf-4d2f-acab-f1434e7c17fd None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:26.855151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d9bbf-9caf-4d2f-acab-f1434e7c17fd None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:26.856612 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d9bbf-9caf-4d2f-acab-f1434e7c17fd None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:26.858558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 102/203] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:26 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:26.859301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d9bbf-9caf-4d2f-acab-f1434e7c17fd None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:26.862937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc86302-2a1b-43fe-9c2a-941f48545725 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:26.864834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc86302-2a1b-43fe-9c2a-941f48545725 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:26.884077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:26.932807 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:26.979199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 102/204] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:26.980373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc86302-2a1b-43fe-9c2a-941f48545725 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:26.980587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d9bbf-9caf-4d2f-acab-f1434e7c17fd None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:27.018778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64310503-228e-4bb7-85bd-76f878b565ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:27.020036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64310503-228e-4bb7-85bd-76f878b565ea None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:27.020410 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64310503-228e-4bb7-85bd-76f878b565ea None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:27.020694 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64310503-228e-4bb7-85bd-76f878b565ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:27.021495 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64310503-228e-4bb7-85bd-76f878b565ea None admin] RBAC: Adding query filter params (role.id=fcaec44122534716b69d5e7f05160915, scope.project.id=e80ed515f9014a95b587cb8122d54787, user.id=bfe46447abd443e9b3bbfc2695d6334f) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:27.021809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64310503-228e-4bb7-85bd-76f878b565ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:27.023384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64310503-228e-4bb7-85bd-76f878b565ea None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:27.034214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 103/205] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:26 2022] GET /identity/v3/role_assignments?user.id=bfe46447abd443e9b3bbfc2695d6334f&scope.project.id=e80ed515f9014a95b587cb8122d54787&role.id=fcaec44122534716b69d5e7f05160915 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:27.034214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64310503-228e-4bb7-85bd-76f878b565ea None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:27.137899 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc86302-2a1b-43fe-9c2a-941f48545725 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:27.162688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:27.195743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45369d-45fa-48a6-b056-3d92b3eb22c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:27.196391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45369d-45fa-48a6-b056-3d92b3eb22c0 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:27.196673 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45369d-45fa-48a6-b056-3d92b3eb22c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:27.196948 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45369d-45fa-48a6-b056-3d92b3eb22c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:27.197756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45369d-45fa-48a6-b056-3d92b3eb22c0 None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=e80ed515f9014a95b587cb8122d54787, user.id=bfe46447abd443e9b3bbfc2695d6334f) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:27.198068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45369d-45fa-48a6-b056-3d92b3eb22c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:27.199566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45369d-45fa-48a6-b056-3d92b3eb22c0 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:27.206759 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 103/206] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:26 2022] GET /identity/v3/role_assignments?user.id=bfe46447abd443e9b3bbfc2695d6334f&scope.project.id=e80ed515f9014a95b587cb8122d54787&role.id=36208a24005e4ff98d827138292bea37 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:27.250325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64310503-228e-4bb7-85bd-76f878b565ea None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:27.293293 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:27.296982 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c8326-a57f-4c8f-b8c5-c9582d9728ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:27.297912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c8326-a57f-4c8f-b8c5-c9582d9728ec None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:27.298417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c8326-a57f-4c8f-b8c5-c9582d9728ec None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:27.298905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c8326-a57f-4c8f-b8c5-c9582d9728ec None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:27.300381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c8326-a57f-4c8f-b8c5-c9582d9728ec None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:27.302093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c8326-a57f-4c8f-b8c5-c9582d9728ec None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:27.304348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 104/207] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:27 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:27.310943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45369d-45fa-48a6-b056-3d92b3eb22c0 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:27.455320 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45369d-45fa-48a6-b056-3d92b3eb22c0 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:27.508786 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80819228-f86f-45a1-9716-c7d69bea0834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:27.509418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819228-f86f-45a1-9716-c7d69bea0834 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:27.509696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819228-f86f-45a1-9716-c7d69bea0834 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:27.509969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819228-f86f-45a1-9716-c7d69bea0834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:27.510868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80819228-f86f-45a1-9716-c7d69bea0834 None admin] RBAC: Adding query filter params (role.id=2838dfaf550b4ad68846863e49c6a7ae, scope.project.id=c42f8c638d1645be870a7efafeb6b2ac, user.id=4108d69e697a4a34aef42ade8e4521ac) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:27.511179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80819228-f86f-45a1-9716-c7d69bea0834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:27.512616 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80819228-f86f-45a1-9716-c7d69bea0834 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:27.523119 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 104/208] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:27 2022] GET /identity/v3/role_assignments?user.id=4108d69e697a4a34aef42ade8e4521ac&scope.project.id=c42f8c638d1645be870a7efafeb6b2ac&role.id=2838dfaf550b4ad68846863e49c6a7ae => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:28.212901 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42686ef-c3fe-4a7b-afa0-7fb8833bb540 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:28.213406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42686ef-c3fe-4a7b-afa0-7fb8833bb540 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:28.213406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42686ef-c3fe-4a7b-afa0-7fb8833bb540 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:28.214987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 105/209] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:28.220339 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5876cf-e285-4f7b-bf0e-25a6b27eccd0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:28.220624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5876cf-e285-4f7b-bf0e-25a6b27eccd0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:28.220901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5876cf-e285-4f7b-bf0e-25a6b27eccd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:28.240314 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-3f5876cf-e285-4f7b-bf0e-25a6b27eccd0 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:28.241497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3f5876cf-e285-4f7b-bf0e-25a6b27eccd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:28.268605 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:28.313654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 105/210] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:28.322216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2906a-0780-4170-b184-48bccd149fa3 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:28.322216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2906a-0780-4170-b184-48bccd149fa3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:28.322216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2906a-0780-4170-b184-48bccd149fa3 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:28.322216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 106/211] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:28.324264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38078651-8f5d-4246-9868-d5d691205bae None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:28.324555 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38078651-8f5d-4246-9868-d5d691205bae None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:28.324832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38078651-8f5d-4246-9868-d5d691205bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:28.337581 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2906a-0780-4170-b184-48bccd149fa3 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:28.344705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-38078651-8f5d-4246-9868-d5d691205bae None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:28.345910 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-38078651-8f5d-4246-9868-d5d691205bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:28.437169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 106/212] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:28.461377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38078651-8f5d-4246-9868-d5d691205bae None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:28.477210 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2906a-0780-4170-b184-48bccd149fa3 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:28.530093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f4fc2-29b7-4542-8513-d5a89afc46cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:28.531136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f4fc2-29b7-4542-8513-d5a89afc46cd None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:28.531655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f4fc2-29b7-4542-8513-d5a89afc46cd None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:28.532746 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f4fc2-29b7-4542-8513-d5a89afc46cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:28.547957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f4fc2-29b7-4542-8513-d5a89afc46cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-6c8f4fc2-29b7-4542-8513-d5a89afc46cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:28.556381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:28.557332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:28.558143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:28.558143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:28.558143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:28.558143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:28.558143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:28.558143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:28.558143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:28.558143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:28.558143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:28.558143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:28.558143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:28.558143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:28.559654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 107/213] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:28.565636 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f4fc2-29b7-4542-8513-d5a89afc46cd None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:28.583785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:28.592971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38078651-8f5d-4246-9868-d5d691205bae None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:28.621021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:28.637137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e3f8d-96d7-4231-89f7-45517e7619ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:28.638327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e3f8d-96d7-4231-89f7-45517e7619ec None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:28.638836 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e3f8d-96d7-4231-89f7-45517e7619ec None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:28.639312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e3f8d-96d7-4231-89f7-45517e7619ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:28.640889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e3f8d-96d7-4231-89f7-45517e7619ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:28.642688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e3f8d-96d7-4231-89f7-45517e7619ec None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:28.649655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 107/214] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:35:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:28.651003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e3f8d-96d7-4231-89f7-45517e7619ec None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:28.678239 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f4fc2-29b7-4542-8513-d5a89afc46cd None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:28.717321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef30c3-47e3-45ae-befc-bdbb4bd3424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:28.718517 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef30c3-47e3-45ae-befc-bdbb4bd3424e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:28.718799 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef30c3-47e3-45ae-befc-bdbb4bd3424e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:28.719393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef30c3-47e3-45ae-befc-bdbb4bd3424e None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:28.720373 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef30c3-47e3-45ae-befc-bdbb4bd3424e None admin] RBAC: Adding query filter params (name=member) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:28.720977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef30c3-47e3-45ae-befc-bdbb4bd3424e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:28.723146 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef30c3-47e3-45ae-befc-bdbb4bd3424e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:28.738478 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 108/215] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:28.739616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef30c3-47e3-45ae-befc-bdbb4bd3424e None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:28.772024 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e3f8d-96d7-4231-89f7-45517e7619ec None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:28.815491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d837e-1053-4677-bc6f-ced53df3d742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:28.817551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d837e-1053-4677-bc6f-ced53df3d742 None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:28.818169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d837e-1053-4677-bc6f-ced53df3d742 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:28.818766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d837e-1053-4677-bc6f-ced53df3d742 None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:28.820300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d837e-1053-4677-bc6f-ced53df3d742 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:28.822857 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d837e-1053-4677-bc6f-ced53df3d742 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:28.849712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 108/216] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:35:28 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:35:28.858436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef30c3-47e3-45ae-befc-bdbb4bd3424e None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:28.868961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:28.895578 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38eb182-6d65-40b1-b934-d732ec6f38c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:28.896262 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38eb182-6d65-40b1-b934-d732ec6f38c9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:28.896545 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38eb182-6d65-40b1-b934-d732ec6f38c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:28.896824 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38eb182-6d65-40b1-b934-d732ec6f38c9 None admin] PATH_INFO: `/v3/users/344efe38a40b4fe8afc4f835d16e6365` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:28.913966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38eb182-6d65-40b1-b934-d732ec6f38c9 None admin] RBAC: Authorizing `identity:get_user(user_id=344efe38a40b4fe8afc4f835d16e6365)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:28.915563 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38eb182-6d65-40b1-b934-d732ec6f38c9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:28.917748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 109/217] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:28 2022] GET /identity/v3/users/344efe38a40b4fe8afc4f835d16e6365 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:28.924004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d837e-1053-4677-bc6f-ced53df3d742 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:28.950126 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:29.058459 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d837e-1053-4677-bc6f-ced53df3d742 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:29.098544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501204e6-f2ce-4e4c-a3c3-8b4b3b122b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:29.099536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501204e6-f2ce-4e4c-a3c3-8b4b3b122b18 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:29.100067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501204e6-f2ce-4e4c-a3c3-8b4b3b122b18 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:29.100569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501204e6-f2ce-4e4c-a3c3-8b4b3b122b18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:29.179148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501204e6-f2ce-4e4c-a3c3-8b4b3b122b18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:29.181143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501204e6-f2ce-4e4c-a3c3-8b4b3b122b18 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:29.202160 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:29.299220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 109/218] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:29.306043 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38eb182-6d65-40b1-b934-d732ec6f38c9 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:29.391476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace82cf0-2216-4514-a672-5c223b561d35 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:29.392173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace82cf0-2216-4514-a672-5c223b561d35 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:29.392651 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace82cf0-2216-4514-a672-5c223b561d35 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:29.395151 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 110/219] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:29.404300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7245d-2b06-47a1-9dc6-0104630df704 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:29.404675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7245d-2b06-47a1-9dc6-0104630df704 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:29.405035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7245d-2b06-47a1-9dc6-0104630df704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:29.451185 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-3ca7245d-2b06-47a1-9dc6-0104630df704 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:29.452737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3ca7245d-2b06-47a1-9dc6-0104630df704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:29.465340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38eb182-6d65-40b1-b934-d732ec6f38c9 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:29.514300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a3ec2-62e7-42c6-aa33-19c986613aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:29.515406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a3ec2-62e7-42c6-aa33-19c986613aa1 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:29.515969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a3ec2-62e7-42c6-aa33-19c986613aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:29.516542 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a3ec2-62e7-42c6-aa33-19c986613aa1 None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:29.518019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a3ec2-62e7-42c6-aa33-19c986613aa1 None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:29.521001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a3ec2-62e7-42c6-aa33-19c986613aa1 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:29.523157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 110/220] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:29 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:29.524654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eb5ac-93d2-4f3d-bfe0-b01b09e6d620 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:29.525134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eb5ac-93d2-4f3d-bfe0-b01b09e6d620 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:29.525617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eb5ac-93d2-4f3d-bfe0-b01b09e6d620 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:29.527463 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 111/221] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:29.529599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5eb5ac-93d2-4f3d-bfe0-b01b09e6d620 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:29.535001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 111/222] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:29.536844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5176-feb3-4e72-91ae-2b6651f07f7c None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:29.537135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5176-feb3-4e72-91ae-2b6651f07f7c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:29.537410 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5176-feb3-4e72-91ae-2b6651f07f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:29.568406 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-c5ab5176-feb3-4e72-91ae-2b6651f07f7c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:29.569888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c5ab5176-feb3-4e72-91ae-2b6651f07f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:29.596009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:29.626012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:29.655397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 112/223] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:29.656720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab5176-feb3-4e72-91ae-2b6651f07f7c None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:29.676368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5eb5ac-93d2-4f3d-bfe0-b01b09e6d620 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:29.713961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ee3e5-d008-4017-9155-510c6798784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:29.714687 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee3e5-d008-4017-9155-510c6798784f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:29.714972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee3e5-d008-4017-9155-510c6798784f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:29.715247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ee3e5-d008-4017-9155-510c6798784f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:29.716057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ee3e5-d008-4017-9155-510c6798784f None admin] RBAC: Adding query filter params (role.id=eef1174229014437a0db0fd8954bc25e, scope.project.id=e80ed515f9014a95b587cb8122d54787, user.id=344efe38a40b4fe8afc4f835d16e6365) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:29.716368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ee3e5-d008-4017-9155-510c6798784f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:29.717885 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ee3e5-d008-4017-9155-510c6798784f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:29.724032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 112/224] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:29 2022] GET /identity/v3/role_assignments?user.id=344efe38a40b4fe8afc4f835d16e6365&scope.project.id=e80ed515f9014a95b587cb8122d54787&role.id=eef1174229014437a0db0fd8954bc25e => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:29.724930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ee3e5-d008-4017-9155-510c6798784f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:29.780604 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab5176-feb3-4e72-91ae-2b6651f07f7c None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:29.832391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7edf7-feb4-4eee-a1b3-9b58a8269e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:29.833710 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7edf7-feb4-4eee-a1b3-9b58a8269e99 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:29.834264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7edf7-feb4-4eee-a1b3-9b58a8269e99 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:29.835088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7edf7-feb4-4eee-a1b3-9b58a8269e99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:29.838759 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ee3e5-d008-4017-9155-510c6798784f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:29.840705 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:29.855941 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7edf7-feb4-4eee-a1b3-9b58a8269e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-47f7edf7-feb4-4eee-a1b3-9b58a8269e99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:29.863473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:29.864441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:29.865235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:29.865235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:29.865235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:29.865235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:29.865235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:29.865235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:29.865235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:29.865235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:29.865235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:29.865235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:29.865235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:29.865235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:29.870352 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 113/225] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:35:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:29.879028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7edf7-feb4-4eee-a1b3-9b58a8269e99 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:29.897511 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f618a-c9b2-46c9-a65b-ec6e476459c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:29.898578 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f618a-c9b2-46c9-a65b-ec6e476459c9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:29.899082 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f618a-c9b2-46c9-a65b-ec6e476459c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:29.900167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f618a-c9b2-46c9-a65b-ec6e476459c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:29.914122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f618a-c9b2-46c9-a65b-ec6e476459c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-8f6f618a-c9b2-46c9-a65b-ec6e476459c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:29.921624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:29.922645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:29.923443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:29.923443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:29.923443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:29.923443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:29.923443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:29.923443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:29.923443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:29.923443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:29.923443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:29.923443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:29.923443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:29.923443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:29.926495 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 113/226] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:35:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:29.932451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f618a-c9b2-46c9-a65b-ec6e476459c9 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:29.996009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:30.068804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f618a-c9b2-46c9-a65b-ec6e476459c9 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:30.091786 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7edf7-feb4-4eee-a1b3-9b58a8269e99 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:30.111497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda4ecd-4636-4f3e-a087-50bb285214c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:30.113099 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda4ecd-4636-4f3e-a087-50bb285214c3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:30.113731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda4ecd-4636-4f3e-a087-50bb285214c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:30.114229 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda4ecd-4636-4f3e-a087-50bb285214c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:30.115472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda4ecd-4636-4f3e-a087-50bb285214c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:30.116003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda4ecd-4636-4f3e-a087-50bb285214c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:30.117953 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda4ecd-4636-4f3e-a087-50bb285214c3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:30.129243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 114/227] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:30.134822 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda4ecd-4636-4f3e-a087-50bb285214c3 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:30.168289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ced947-21f4-4f54-8219-c771852f4fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:30.168891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ced947-21f4-4f54-8219-c771852f4fc0 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:30.169176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ced947-21f4-4f54-8219-c771852f4fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:30.169449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ced947-21f4-4f54-8219-c771852f4fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:30.170259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ced947-21f4-4f54-8219-c771852f4fc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:30.170574 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ced947-21f4-4f54-8219-c771852f4fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:30.171962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ced947-21f4-4f54-8219-c771852f4fc0 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:30.188898 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 114/228] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:35:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:30.189632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:30.195647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ced947-21f4-4f54-8219-c771852f4fc0 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:30.318504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:30.322473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ced947-21f4-4f54-8219-c771852f4fc0 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:30.380256 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed6ee0-0a40-4f52-8f4d-4b75414c3f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:30.380927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed6ee0-0a40-4f52-8f4d-4b75414c3f9c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:30.381208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed6ee0-0a40-4f52-8f4d-4b75414c3f9c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:30.381481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed6ee0-0a40-4f52-8f4d-4b75414c3f9c None admin] PATH_INFO: `/v3/users/bfe46447abd443e9b3bbfc2695d6334f` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:30.386475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda4ecd-4636-4f3e-a087-50bb285214c3 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:30.387142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed6ee0-0a40-4f52-8f4d-4b75414c3f9c None admin] RBAC: Authorizing `identity:get_user(user_id=bfe46447abd443e9b3bbfc2695d6334f)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:30.388729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed6ee0-0a40-4f52-8f4d-4b75414c3f9c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:30.394366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 115/229] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:30 2022] GET /identity/v3/users/bfe46447abd443e9b3bbfc2695d6334f => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:30.398200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed6ee0-0a40-4f52-8f4d-4b75414c3f9c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:30.468087 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca4d61-6be2-4f9a-b155-b9171425cd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:30.468673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca4d61-6be2-4f9a-b155-b9171425cd5d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:30.468959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca4d61-6be2-4f9a-b155-b9171425cd5d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:30.469229 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca4d61-6be2-4f9a-b155-b9171425cd5d None admin] PATH_INFO: `/v3/users/bfe46447abd443e9b3bbfc2695d6334f` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:30.470514 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca4d61-6be2-4f9a-b155-b9171425cd5d None admin] RBAC: Authorizing `identity:get_user(user_id=bfe46447abd443e9b3bbfc2695d6334f)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:30.472045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca4d61-6be2-4f9a-b155-b9171425cd5d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:30.474018 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 115/230] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:30 2022] GET /identity/v3/users/bfe46447abd443e9b3bbfc2695d6334f => generated 283 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:30.479654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca4d61-6be2-4f9a-b155-b9171425cd5d None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:30.593392 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed6ee0-0a40-4f52-8f4d-4b75414c3f9c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:30.648802 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6b35a-1b31-4c98-a2bb-9ceb28301bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:30.649460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6b35a-1b31-4c98-a2bb-9ceb28301bb7 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:30.649750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6b35a-1b31-4c98-a2bb-9ceb28301bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:30.650119 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6b35a-1b31-4c98-a2bb-9ceb28301bb7 None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:30.651339 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6b35a-1b31-4c98-a2bb-9ceb28301bb7 None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:30.653310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6b35a-1b31-4c98-a2bb-9ceb28301bb7 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:30.654538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:30.655669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 116/231] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:30 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:30.667957 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6b35a-1b31-4c98-a2bb-9ceb28301bb7 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:30.669078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca4d61-6be2-4f9a-b155-b9171425cd5d None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:30.730839 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24114ec4-b268-4b4d-a07a-8db1c4b63589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:30.732234 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24114ec4-b268-4b4d-a07a-8db1c4b63589 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:30.732522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24114ec4-b268-4b4d-a07a-8db1c4b63589 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:30.732799 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24114ec4-b268-4b4d-a07a-8db1c4b63589 None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:30.734655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24114ec4-b268-4b4d-a07a-8db1c4b63589 None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:30.736351 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24114ec4-b268-4b4d-a07a-8db1c4b63589 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:30.738945 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 116/232] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:30 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:30.745247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24114ec4-b268-4b4d-a07a-8db1c4b63589 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:30.746538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:30.868311 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6b35a-1b31-4c98-a2bb-9ceb28301bb7 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:30.903628 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24114ec4-b268-4b4d-a07a-8db1c4b63589 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:30.942495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b0cf5-6aa8-42b1-b5a3-127e39d44af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:30.943236 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b0cf5-6aa8-42b1-b5a3-127e39d44af8 None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:30.943522 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b0cf5-6aa8-42b1-b5a3-127e39d44af8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:30.943795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b0cf5-6aa8-42b1-b5a3-127e39d44af8 None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787/users/bfe46447abd443e9b3bbfc2695d6334f/roles/fcaec44122534716b69d5e7f05160915` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:30.946003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b0cf5-6aa8-42b1-b5a3-127e39d44af8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e80ed515f9014a95b587cb8122d54787, user_id=bfe46447abd443e9b3bbfc2695d6334f, role_id=fcaec44122534716b69d5e7f05160915)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:30.947489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b0cf5-6aa8-42b1-b5a3-127e39d44af8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:30.963378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 117/233] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:35:30 2022] PUT /identity/v3/projects/e80ed515f9014a95b587cb8122d54787/users/bfe46447abd443e9b3bbfc2695d6334f/roles/fcaec44122534716b69d5e7f05160915 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:35:30.984190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8516b-7c72-4daf-a3a8-867c7718a4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:30.984808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8516b-7c72-4daf-a3a8-867c7718a4ee None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:30.985094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8516b-7c72-4daf-a3a8-867c7718a4ee None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:30.985369 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8516b-7c72-4daf-a3a8-867c7718a4ee None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787/users/bfe46447abd443e9b3bbfc2695d6334f/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:30.987476 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8516b-7c72-4daf-a3a8-867c7718a4ee None admin] RBAC: Authorizing `identity:create_grant(project_id=e80ed515f9014a95b587cb8122d54787, user_id=bfe46447abd443e9b3bbfc2695d6334f, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:30.989148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8516b-7c72-4daf-a3a8-867c7718a4ee None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:31.013142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 117/234] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:35:30 2022] PUT /identity/v3/projects/e80ed515f9014a95b587cb8122d54787/users/bfe46447abd443e9b3bbfc2695d6334f/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:35:31.539937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c9d80-cf90-4c20-bc5c-41d570741437 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:31.540660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c9d80-cf90-4c20-bc5c-41d570741437 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:31.541141 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c9d80-cf90-4c20-bc5c-41d570741437 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:31.543037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 118/235] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:31.548655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38873a8a-cc11-472e-be9e-2bf683472f98 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:31.549521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38873a8a-cc11-472e-be9e-2bf683472f98 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:31.550636 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38873a8a-cc11-472e-be9e-2bf683472f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:31.579641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-38873a8a-cc11-472e-be9e-2bf683472f98 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:31.581836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-38873a8a-cc11-472e-be9e-2bf683472f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:31.607537 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:31.641883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea53c2-67b7-4e95-9899-4856f833e5fc None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:31.642464 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea53c2-67b7-4e95-9899-4856f833e5fc None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:31.642674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea53c2-67b7-4e95-9899-4856f833e5fc None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:31.645804 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 119/236] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:31.650011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cfe0f-46d1-4e5d-bde9-d81f84482141 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:31.650326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cfe0f-46d1-4e5d-bde9-d81f84482141 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:31.650603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cfe0f-46d1-4e5d-bde9-d81f84482141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:31.669450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-f59cfe0f-46d1-4e5d-bde9-d81f84482141 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:31.673786 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f59cfe0f-46d1-4e5d-bde9-d81f84482141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:31.694602 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 118/237] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:31.721283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38873a8a-cc11-472e-be9e-2bf683472f98 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:31.788653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 120/238] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:31.824860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cfe0f-46d1-4e5d-bde9-d81f84482141 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:31.837340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38873a8a-cc11-472e-be9e-2bf683472f98 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:31.873481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:31.875596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3358b0-be4d-45fd-9a27-ee30e4db4de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:31.876416 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3358b0-be4d-45fd-9a27-ee30e4db4de6 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:31.876801 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3358b0-be4d-45fd-9a27-ee30e4db4de6 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:31.877458 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3358b0-be4d-45fd-9a27-ee30e4db4de6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:31.890515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3358b0-be4d-45fd-9a27-ee30e4db4de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-ff3358b0-be4d-45fd-9a27-ee30e4db4de6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:31.897446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:31.898752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:31.899577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:31.899577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:31.899577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:31.899577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:31.899577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:31.899577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:31.899577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:31.899577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:31.899577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:31.899577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:31.899577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:31.899577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:31.899577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 119/239] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:31.903457 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3358b0-be4d-45fd-9a27-ee30e4db4de6 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:31.917645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:32.014167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3358b0-be4d-45fd-9a27-ee30e4db4de6 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:32.051360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db841aa5-8a1a-4f58-965b-154861cef4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:32.051988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db841aa5-8a1a-4f58-965b-154861cef4d3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:32.052271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db841aa5-8a1a-4f58-965b-154861cef4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:32.052547 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db841aa5-8a1a-4f58-965b-154861cef4d3 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:32.053278 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db841aa5-8a1a-4f58-965b-154861cef4d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:32.053586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db841aa5-8a1a-4f58-965b-154861cef4d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:32.055014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db841aa5-8a1a-4f58-965b-154861cef4d3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:32.056955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cfe0f-46d1-4e5d-bde9-d81f84482141 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:32.064475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 120/240] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:32.070717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db841aa5-8a1a-4f58-965b-154861cef4d3 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:32.136778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f265e-4187-43d6-9876-2b2676f967a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:32.137448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f265e-4187-43d6-9876-2b2676f967a9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:32.137737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f265e-4187-43d6-9876-2b2676f967a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:32.138009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f265e-4187-43d6-9876-2b2676f967a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:32.139256 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f265e-4187-43d6-9876-2b2676f967a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:32.140702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f265e-4187-43d6-9876-2b2676f967a9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:32.142540 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 121/241] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:35:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:32.148008 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f265e-4187-43d6-9876-2b2676f967a9 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:32.197446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:32.256622 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db841aa5-8a1a-4f58-965b-154861cef4d3 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:32.308854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c0afd-85e2-4e11-a247-d92633866bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:32.309622 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c0afd-85e2-4e11-a247-d92633866bf5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:32.310177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c0afd-85e2-4e11-a247-d92633866bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:32.310516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c0afd-85e2-4e11-a247-d92633866bf5 None admin] PATH_INFO: `/v3/users/9b0c9254fa534014ac4a12968274f315` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:32.320020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:32.326339 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c0afd-85e2-4e11-a247-d92633866bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=9b0c9254fa534014ac4a12968274f315)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:32.328007 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c0afd-85e2-4e11-a247-d92633866bf5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:32.329262 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f265e-4187-43d6-9876-2b2676f967a9 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:32.330337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 121/242] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:32 2022] GET /identity/v3/users/9b0c9254fa534014ac4a12968274f315 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:32.332587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052507a-56bf-4f0e-b810-6d69556b4c86 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:32.332869 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052507a-56bf-4f0e-b810-6d69556b4c86 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:32.333169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052507a-56bf-4f0e-b810-6d69556b4c86 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:32.344536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 122/243] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:32 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:32.345647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052507a-56bf-4f0e-b810-6d69556b4c86 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:32.395018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e9fc6-f8d9-4f11-a606-1ae52342009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:32.395567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e9fc6-f8d9-4f11-a606-1ae52342009c None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:32.395846 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e9fc6-f8d9-4f11-a606-1ae52342009c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:32.396117 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e9fc6-f8d9-4f11-a606-1ae52342009c None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:32.396803 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e9fc6-f8d9-4f11-a606-1ae52342009c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:32.398275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e9fc6-f8d9-4f11-a606-1ae52342009c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:32.427284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 122/244] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:35:32 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:35:32.429154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a275a-941a-4b21-9f9d-2b3595095b5f None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:32.429659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a275a-941a-4b21-9f9d-2b3595095b5f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:32.429766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a275a-941a-4b21-9f9d-2b3595095b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:32.454558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-3d8a275a-941a-4b21-9f9d-2b3595095b5f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:32.456543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3d8a275a-941a-4b21-9f9d-2b3595095b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:32.478830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052507a-56bf-4f0e-b810-6d69556b4c86 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:32.518141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:32.526432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eab88-da6c-408f-a5ac-40131d414f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:32.527513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eab88-da6c-408f-a5ac-40131d414f55 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:32.528005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eab88-da6c-408f-a5ac-40131d414f55 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:32.528531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eab88-da6c-408f-a5ac-40131d414f55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:32.552983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 123/245] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:32.579152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a275a-941a-4b21-9f9d-2b3595095b5f None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:32.671739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11eab88-da6c-408f-a5ac-40131d414f55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:32.673302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11eab88-da6c-408f-a5ac-40131d414f55 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:32.694682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:32.722572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a275a-941a-4b21-9f9d-2b3595095b5f None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:32.770507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b1f80-f10f-4417-9f56-a50df6eee7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:32.772908 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b1f80-f10f-4417-9f56-a50df6eee7d0 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:32.772908 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b1f80-f10f-4417-9f56-a50df6eee7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:32.772908 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b1f80-f10f-4417-9f56-a50df6eee7d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:32.784814 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b1f80-f10f-4417-9f56-a50df6eee7d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-047b1f80-f10f-4417-9f56-a50df6eee7d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:32.790049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:32.791020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:32.791887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:32.791887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:32.791887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:32.791887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:32.791887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:32.791887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:32.791887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:32.791887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:32.791887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:32.791887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:32.791887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:32.791887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:32.791887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 124/246] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:35:32.797621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b1f80-f10f-4417-9f56-a50df6eee7d0 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:32.830596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 123/247] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:32.837152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eab88-da6c-408f-a5ac-40131d414f55 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:32.878551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:32.931777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b1f80-f10f-4417-9f56-a50df6eee7d0 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:32.971442 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9bc47-5d93-42bf-9022-ce308474e57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:32.972267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9bc47-5d93-42bf-9022-ce308474e57e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:32.972769 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9bc47-5d93-42bf-9022-ce308474e57e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:32.973074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9bc47-5d93-42bf-9022-ce308474e57e None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:32.975171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9bc47-5d93-42bf-9022-ce308474e57e None admin] RBAC: Adding query filter params (name=member) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:32.975171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9bc47-5d93-42bf-9022-ce308474e57e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:32.975629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9bc47-5d93-42bf-9022-ce308474e57e None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:32.986296 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 125/248] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:32.993197 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9bc47-5d93-42bf-9022-ce308474e57e None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:32.995983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:33.033595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eab88-da6c-408f-a5ac-40131d414f55 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:33.104787 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd57e6-4117-4cea-bd11-47961a215d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:33.105827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd57e6-4117-4cea-bd11-47961a215d2e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:33.106288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd57e6-4117-4cea-bd11-47961a215d2e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:33.106799 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd57e6-4117-4cea-bd11-47961a215d2e None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:33.108290 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd57e6-4117-4cea-bd11-47961a215d2e None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:33.110323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd57e6-4117-4cea-bd11-47961a215d2e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:33.113071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 124/249] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:32 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:33.116688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9bc47-5d93-42bf-9022-ce308474e57e None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:33.119483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd57e6-4117-4cea-bd11-47961a215d2e None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:33.156305 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d53bb-c076-4da2-b1e1-0a257ead40ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:33.156968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d53bb-c076-4da2-b1e1-0a257ead40ea None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:33.157252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d53bb-c076-4da2-b1e1-0a257ead40ea None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:33.157528 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d53bb-c076-4da2-b1e1-0a257ead40ea None admin] PATH_INFO: `/v3/users/344efe38a40b4fe8afc4f835d16e6365` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:33.158915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d53bb-c076-4da2-b1e1-0a257ead40ea None admin] RBAC: Authorizing `identity:get_user(user_id=344efe38a40b4fe8afc4f835d16e6365)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:33.161013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d53bb-c076-4da2-b1e1-0a257ead40ea None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:33.163125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 126/250] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:32 2022] GET /identity/v3/users/344efe38a40b4fe8afc4f835d16e6365 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:33.169634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d53bb-c076-4da2-b1e1-0a257ead40ea None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:33.248363 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:33.253597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:33.253915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd57e6-4117-4cea-bd11-47961a215d2e None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:33.289177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d53bb-c076-4da2-b1e1-0a257ead40ea None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:33.295300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409260b-be73-4ce7-a2bf-5e1da3100e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:33.296265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409260b-be73-4ce7-a2bf-5e1da3100e2c None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:33.296743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409260b-be73-4ce7-a2bf-5e1da3100e2c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:33.297212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409260b-be73-4ce7-a2bf-5e1da3100e2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:33.298365 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409260b-be73-4ce7-a2bf-5e1da3100e2c None admin] RBAC: Adding query filter params (role.id=2838dfaf550b4ad68846863e49c6a7ae, scope.project.id=e80ed515f9014a95b587cb8122d54787, user.id=9b0c9254fa534014ac4a12968274f315) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:33.298906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409260b-be73-4ce7-a2bf-5e1da3100e2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:33.301192 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409260b-be73-4ce7-a2bf-5e1da3100e2c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:33.308645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 125/251] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:33 2022] GET /identity/v3/role_assignments?user.id=9b0c9254fa534014ac4a12968274f315&scope.project.id=e80ed515f9014a95b587cb8122d54787&role.id=2838dfaf550b4ad68846863e49c6a7ae => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:33.347522 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94290a-4da6-45bc-b1ed-4814ea584524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:33.348625 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94290a-4da6-45bc-b1ed-4814ea584524 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:33.349124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94290a-4da6-45bc-b1ed-4814ea584524 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:33.349597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94290a-4da6-45bc-b1ed-4814ea584524 None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:33.351246 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94290a-4da6-45bc-b1ed-4814ea584524 None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:33.353034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94290a-4da6-45bc-b1ed-4814ea584524 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:33.355510 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 127/252] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:33 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:33.361035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409260b-be73-4ce7-a2bf-5e1da3100e2c None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:33.500185 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409260b-be73-4ce7-a2bf-5e1da3100e2c None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:33.552072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45ad5a-9f70-4d2e-8313-db687f3364b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:33.553142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45ad5a-9f70-4d2e-8313-db687f3364b7 None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:33.553643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45ad5a-9f70-4d2e-8313-db687f3364b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:33.554131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45ad5a-9f70-4d2e-8313-db687f3364b7 None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787/users/344efe38a40b4fe8afc4f835d16e6365/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:33.556455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45ad5a-9f70-4d2e-8313-db687f3364b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e80ed515f9014a95b587cb8122d54787, user_id=344efe38a40b4fe8afc4f835d16e6365, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:33.558202 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45ad5a-9f70-4d2e-8313-db687f3364b7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:33.579721 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 126/253] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:35:33 2022] PUT /identity/v3/projects/e80ed515f9014a95b587cb8122d54787/users/344efe38a40b4fe8afc4f835d16e6365/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:35:33.733585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bf096-c4eb-4a8a-95b6-380a12a8dbc2 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:33.734614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bf096-c4eb-4a8a-95b6-380a12a8dbc2 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:33.735150 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bf096-c4eb-4a8a-95b6-380a12a8dbc2 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:33.737196 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 128/254] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:33.748207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02442f-d291-471e-9806-6217602e1230 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:33.749242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02442f-d291-471e-9806-6217602e1230 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:33.749745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02442f-d291-471e-9806-6217602e1230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:33.778166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-aa02442f-d291-471e-9806-6217602e1230 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:33.779772 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-aa02442f-d291-471e-9806-6217602e1230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:33.806394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:33.881328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 127/255] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:33.948170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bf096-c4eb-4a8a-95b6-380a12a8dbc2 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:33.965471 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb3192-a1b0-4f48-bd8f-f14b60ed62bd None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:33.965985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb3192-a1b0-4f48-bd8f-f14b60ed62bd None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:33.967093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb3192-a1b0-4f48-bd8f-f14b60ed62bd None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:33.968668 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 128/256] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:35:33.975917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2af40-ca0e-4d41-8138-11794efacf8c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:33.976538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2af40-ca0e-4d41-8138-11794efacf8c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:33.977534 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2af40-ca0e-4d41-8138-11794efacf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:34.011239 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-acc2af40-ca0e-4d41-8138-11794efacf8c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:34.012816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-acc2af40-ca0e-4d41-8138-11794efacf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:34.175005 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bf096-c4eb-4a8a-95b6-380a12a8dbc2 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:34.215546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 129/257] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:34.239835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec01b4-5903-4905-885b-5e220fb7b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:34.240519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec01b4-5903-4905-885b-5e220fb7b480 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:34.240799 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec01b4-5903-4905-885b-5e220fb7b480 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:34.241072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec01b4-5903-4905-885b-5e220fb7b480 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:34.257203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2af40-ca0e-4d41-8138-11794efacf8c None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:34.261440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec01b4-5903-4905-885b-5e220fb7b480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-eaec01b4-5903-4905-885b-5e220fb7b480 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:34.269969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:34.270942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:34.271712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:34.271712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:34.271712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:34.271712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:34.271712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:34.271712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:34.271712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:34.271712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:34.271712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:34.271712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:34.271712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:34.271712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:34.271712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:34.278530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 129/258] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:35:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:35:34.278530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec01b4-5903-4905-885b-5e220fb7b480 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:34.464166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:34.507967 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2af40-ca0e-4d41-8138-11794efacf8c None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:34.568561 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec01b4-5903-4905-885b-5e220fb7b480 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:34.587056 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67544157-cdf6-480e-915d-3ee2029184cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:34.587739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67544157-cdf6-480e-915d-3ee2029184cc None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:34.588019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67544157-cdf6-480e-915d-3ee2029184cc None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:34.588291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67544157-cdf6-480e-915d-3ee2029184cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:34.614410 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67544157-cdf6-480e-915d-3ee2029184cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-67544157-cdf6-480e-915d-3ee2029184cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:34.620291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:34.621184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:34.622443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:34.622443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:34.622443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:34.622443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:34.622443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:34.622443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:34.622443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:34.622443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:34.622443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:34.622443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:34.622443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:34.622443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:34.622443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 130/259] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:35:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:35:34.630680 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67544157-cdf6-480e-915d-3ee2029184cc None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:34.654973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efde53-c9f2-4c05-a590-e14cf168d2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:34.655628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efde53-c9f2-4c05-a590-e14cf168d2dc None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:34.655919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efde53-c9f2-4c05-a590-e14cf168d2dc None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:34.656201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efde53-c9f2-4c05-a590-e14cf168d2dc None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:34.656946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efde53-c9f2-4c05-a590-e14cf168d2dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:34.657261 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efde53-c9f2-4c05-a590-e14cf168d2dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:34.658697 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efde53-c9f2-4c05-a590-e14cf168d2dc None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:34.676904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 130/260] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:35:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:34.683722 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efde53-c9f2-4c05-a590-e14cf168d2dc None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:34.832130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:34.837202 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67544157-cdf6-480e-915d-3ee2029184cc None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:34.899132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7c4a7-4601-4d25-a3ee-f0d8b01f5bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:34.899793 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7c4a7-4601-4d25-a3ee-f0d8b01f5bf8 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:34.900488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7c4a7-4601-4d25-a3ee-f0d8b01f5bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:34.900488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7c4a7-4601-4d25-a3ee-f0d8b01f5bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:34.901236 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7c4a7-4601-4d25-a3ee-f0d8b01f5bf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:34.901548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7c4a7-4601-4d25-a3ee-f0d8b01f5bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:34.903075 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7c4a7-4601-4d25-a3ee-f0d8b01f5bf8 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:34.913372 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 131/261] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:34.919406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7c4a7-4601-4d25-a3ee-f0d8b01f5bf8 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:34.923924 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:34.980527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efde53-c9f2-4c05-a590-e14cf168d2dc None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:35.067028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7c4a7-4601-4d25-a3ee-f0d8b01f5bf8 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:35.084526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766a8df-c1ca-409f-ada5-e89a138eed5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:35.085108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766a8df-c1ca-409f-ada5-e89a138eed5a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:35.085394 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766a8df-c1ca-409f-ada5-e89a138eed5a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:35.085673 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766a8df-c1ca-409f-ada5-e89a138eed5a None admin] PATH_INFO: `/v3/users/bfe46447abd443e9b3bbfc2695d6334f` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:35.091017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766a8df-c1ca-409f-ada5-e89a138eed5a None admin] RBAC: Authorizing `identity:get_user(user_id=bfe46447abd443e9b3bbfc2695d6334f)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:35.092522 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766a8df-c1ca-409f-ada5-e89a138eed5a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:35.094644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 131/262] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:34 2022] GET /identity/v3/users/bfe46447abd443e9b3bbfc2695d6334f => generated 283 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:35.108065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766a8df-c1ca-409f-ada5-e89a138eed5a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:35.109913 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac5fba-d356-4740-9886-3fd2ef404907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:35.110596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac5fba-d356-4740-9886-3fd2ef404907 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:35.110877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac5fba-d356-4740-9886-3fd2ef404907 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:35.111156 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac5fba-d356-4740-9886-3fd2ef404907 None admin] PATH_INFO: `/v3/users/bfe46447abd443e9b3bbfc2695d6334f` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:35.115063 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac5fba-d356-4740-9886-3fd2ef404907 None admin] RBAC: Authorizing `identity:get_user(user_id=bfe46447abd443e9b3bbfc2695d6334f)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:35.116874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac5fba-d356-4740-9886-3fd2ef404907 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:35.118921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 132/263] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:34 2022] GET /identity/v3/users/bfe46447abd443e9b3bbfc2695d6334f => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:35.125006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac5fba-d356-4740-9886-3fd2ef404907 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:35.272334 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:35.344240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac5fba-d356-4740-9886-3fd2ef404907 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:35.383607 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766a8df-c1ca-409f-ada5-e89a138eed5a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:35.438570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:35.458970 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1367d-ea59-4764-8dce-c0560527b911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:35.459628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1367d-ea59-4764-8dce-c0560527b911 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:35.459919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1367d-ea59-4764-8dce-c0560527b911 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:35.460203 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1367d-ea59-4764-8dce-c0560527b911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:35.474470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19964a7b-7e17-41ab-8715-aa397fa6309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:35.475562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19964a7b-7e17-41ab-8715-aa397fa6309b None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:35.476058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19964a7b-7e17-41ab-8715-aa397fa6309b None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:35.476416 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19964a7b-7e17-41ab-8715-aa397fa6309b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:35.589509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1367d-ea59-4764-8dce-c0560527b911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:35.591075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1367d-ea59-4764-8dce-c0560527b911 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:35.675599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19964a7b-7e17-41ab-8715-aa397fa6309b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:35.677090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19964a7b-7e17-41ab-8715-aa397fa6309b None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:35.801397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 132/264] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 10:35:35.807882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1367d-ea59-4764-8dce-c0560527b911 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:35.867895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:35.903779 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:35.999653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 133/265] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 875 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:36.000927 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd302fd9-47df-4711-9443-6981383c3fec None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:36.001218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd302fd9-47df-4711-9443-6981383c3fec None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:36.001499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd302fd9-47df-4711-9443-6981383c3fec None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:36.003545 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 134/266] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:36.008465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd302fd9-47df-4711-9443-6981383c3fec None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:36.012848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1367d-ea59-4764-8dce-c0560527b911 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:36.073310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1c163-1427-48da-91c6-72c90da78aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:36.073958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1c163-1427-48da-91c6-72c90da78aca None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:36.074440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1c163-1427-48da-91c6-72c90da78aca None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:36.074851 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1c163-1427-48da-91c6-72c90da78aca None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:36.076274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1c163-1427-48da-91c6-72c90da78aca None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:36.077942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1c163-1427-48da-91c6-72c90da78aca None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:36.081600 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 133/267] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:35 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:36.083222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234ed78-8b43-4d09-9ebe-5963a6521954 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:36.083639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234ed78-8b43-4d09-9ebe-5963a6521954 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:36.084082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234ed78-8b43-4d09-9ebe-5963a6521954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:36.105138 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-e234ed78-8b43-4d09-9ebe-5963a6521954 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:36.106653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-e234ed78-8b43-4d09-9ebe-5963a6521954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:36.161843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd302fd9-47df-4711-9443-6981383c3fec None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:36.204567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abe05b-bcc2-4583-b014-68db1432be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:36.205591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe05b-bcc2-4583-b014-68db1432be4a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:36.206827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe05b-bcc2-4583-b014-68db1432be4a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:36.207600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe05b-bcc2-4583-b014-68db1432be4a None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:36.209206 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abe05b-bcc2-4583-b014-68db1432be4a None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:36.210909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abe05b-bcc2-4583-b014-68db1432be4a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:36.214402 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 134/269] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:36.216558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a26133-b8ed-44e2-8850-fd3dd55bdb10 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:36.217107 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a26133-b8ed-44e2-8850-fd3dd55bdb10 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:36.217602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a26133-b8ed-44e2-8850-fd3dd55bdb10 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:36.218232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 135/269] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:36 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:36.219184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abe05b-bcc2-4583-b014-68db1432be4a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:36.220760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 135/270] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:36.227554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a26133-b8ed-44e2-8850-fd3dd55bdb10 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:36.272384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:36.288070 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:36.370592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abe05b-bcc2-4583-b014-68db1432be4a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:36.418780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a26133-b8ed-44e2-8850-fd3dd55bdb10 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:36.419040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f753f-f2ff-4726-87cf-f6dc7d9b95f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:36.419488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f753f-f2ff-4726-87cf-f6dc7d9b95f8 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:36.419771 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f753f-f2ff-4726-87cf-f6dc7d9b95f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:36.420046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f753f-f2ff-4726-87cf-f6dc7d9b95f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:36.420852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f753f-f2ff-4726-87cf-f6dc7d9b95f8 None admin] RBAC: Adding query filter params (role.id=fcaec44122534716b69d5e7f05160915, scope.project.id=e80ed515f9014a95b587cb8122d54787, user.id=bfe46447abd443e9b3bbfc2695d6334f) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:36.421360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f753f-f2ff-4726-87cf-f6dc7d9b95f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:36.422877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f753f-f2ff-4726-87cf-f6dc7d9b95f8 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:36.437243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 136/271] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:36 2022] GET /identity/v3/role_assignments?user.id=bfe46447abd443e9b3bbfc2695d6334f&scope.project.id=e80ed515f9014a95b587cb8122d54787&role.id=fcaec44122534716b69d5e7f05160915 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:36.437243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3372eb5-434c-4c47-9ef6-1fa46260156a None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:36.437243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3372eb5-434c-4c47-9ef6-1fa46260156a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:36.437243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3372eb5-434c-4c47-9ef6-1fa46260156a None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:36.437243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 137/272] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:36.437243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c0c3-38e6-4a36-aeef-0fc47b62e1db None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:36.438125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c0c3-38e6-4a36-aeef-0fc47b62e1db None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:36.438125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c0c3-38e6-4a36-aeef-0fc47b62e1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:36.460013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-d1e4c0c3-38e6-4a36-aeef-0fc47b62e1db None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:36.461704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d1e4c0c3-38e6-4a36-aeef-0fc47b62e1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:36.483027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57da462-b952-46b4-9bfd-3d745ad29265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:36.484425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57da462-b952-46b4-9bfd-3d745ad29265 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:36.485123 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57da462-b952-46b4-9bfd-3d745ad29265 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:36.485828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57da462-b952-46b4-9bfd-3d745ad29265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:36.487254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57da462-b952-46b4-9bfd-3d745ad29265 None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=e80ed515f9014a95b587cb8122d54787, user.id=bfe46447abd443e9b3bbfc2695d6334f) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:36.487785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57da462-b952-46b4-9bfd-3d745ad29265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:36.490087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57da462-b952-46b4-9bfd-3d745ad29265 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:36.499569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 136/273] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:36 2022] GET /identity/v3/role_assignments?user.id=bfe46447abd443e9b3bbfc2695d6334f&scope.project.id=e80ed515f9014a95b587cb8122d54787&role.id=36208a24005e4ff98d827138292bea37 => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:36.510241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57da462-b952-46b4-9bfd-3d745ad29265 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:36.597996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 138/274] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:36.599711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde1e8b-5c0f-4846-99e1-afcb7741ea11 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:36.599898 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde1e8b-5c0f-4846-99e1-afcb7741ea11 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:36.600153 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde1e8b-5c0f-4846-99e1-afcb7741ea11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:36.647418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-4dde1e8b-5c0f-4846-99e1-afcb7741ea11 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:36.648919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4dde1e8b-5c0f-4846-99e1-afcb7741ea11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:36.663188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:36.675886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57da462-b952-46b4-9bfd-3d745ad29265 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:36.696198 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:36.718769 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ff120-ed71-4063-88a7-a072b4e6f4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:36.719445 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ff120-ed71-4063-88a7-a072b4e6f4c9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:36.719731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ff120-ed71-4063-88a7-a072b4e6f4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:36.720010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ff120-ed71-4063-88a7-a072b4e6f4c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:36.736504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ff120-ed71-4063-88a7-a072b4e6f4c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-872ff120-ed71-4063-88a7-a072b4e6f4c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:36.744411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:36.745381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:36.746177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:36.746177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:36.746177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:36.746177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:36.746177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:36.746177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:36.746177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:36.746177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:36.746177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:36.746177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:36.746177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:36.746177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:36.746177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 137/275] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:36.746880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ff120-ed71-4063-88a7-a072b4e6f4c9 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:36.765406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 139/276] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:36.766619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde1e8b-5c0f-4846-99e1-afcb7741ea11 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:36.896894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ff120-ed71-4063-88a7-a072b4e6f4c9 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:36.934563 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde1e8b-5c0f-4846-99e1-afcb7741ea11 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:36.941991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e90d92-0724-45a1-b019-eda6956b8ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:36.943023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e90d92-0724-45a1-b019-eda6956b8ac3 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:36.943508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e90d92-0724-45a1-b019-eda6956b8ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:36.943954 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e90d92-0724-45a1-b019-eda6956b8ac3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:36.945386 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e90d92-0724-45a1-b019-eda6956b8ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:36.947066 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e90d92-0724-45a1-b019-eda6956b8ac3 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:36.948887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 138/277] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:35:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:36.949860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e90d92-0724-45a1-b019-eda6956b8ac3 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:36.973322 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:36.980529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322c33a-23e0-4025-9d7a-ac47c148cc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:36.981161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322c33a-23e0-4025-9d7a-ac47c148cc7e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:36.981457 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322c33a-23e0-4025-9d7a-ac47c148cc7e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:36.981728 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322c33a-23e0-4025-9d7a-ac47c148cc7e None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:36.982697 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322c33a-23e0-4025-9d7a-ac47c148cc7e None admin] RBAC: Adding query filter params (name=member) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:36.983014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322c33a-23e0-4025-9d7a-ac47c148cc7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:36.984413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322c33a-23e0-4025-9d7a-ac47c148cc7e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:36.995607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 140/278] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:36.996370 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322c33a-23e0-4025-9d7a-ac47c148cc7e None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:37.027632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:37.116925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322c33a-23e0-4025-9d7a-ac47c148cc7e None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:37.123565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e90d92-0724-45a1-b019-eda6956b8ac3 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:37.153520 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd39b54-df72-463a-a36d-20107c4c527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:37.154148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39b54-df72-463a-a36d-20107c4c527a None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:37.154656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39b54-df72-463a-a36d-20107c4c527a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:37.154998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39b54-df72-463a-a36d-20107c4c527a None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:37.155646 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd39b54-df72-463a-a36d-20107c4c527a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:37.157122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd39b54-df72-463a-a36d-20107c4c527a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:37.183214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 141/279] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:35:36 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:35:37.183982 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd39b54-df72-463a-a36d-20107c4c527a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:37.196159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cf0ff-9b8c-4a2b-af7c-d1e33fbdeebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:37.197311 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cf0ff-9b8c-4a2b-af7c-d1e33fbdeebc None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:37.198345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cf0ff-9b8c-4a2b-af7c-d1e33fbdeebc None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:37.198956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cf0ff-9b8c-4a2b-af7c-d1e33fbdeebc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:37.217490 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cf0ff-9b8c-4a2b-af7c-d1e33fbdeebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-098cf0ff-9b8c-4a2b-af7c-d1e33fbdeebc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:37.226904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:37.227869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:37.228661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:37.228661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:37.228661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:37.228661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:37.228661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:37.228661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:37.228661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:37.228661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:37.228661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:37.228661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:37.228661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:37.228661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:37.232471 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 139/280] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:37.239146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cf0ff-9b8c-4a2b-af7c-d1e33fbdeebc None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:37.304683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:37.331960 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd39b54-df72-463a-a36d-20107c4c527a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:37.343264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:37.369907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cf0ff-9b8c-4a2b-af7c-d1e33fbdeebc None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:37.371932 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4abbb7-4b51-4896-a0bc-2e7faf412fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:37.372609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4abbb7-4b51-4896-a0bc-2e7faf412fb3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:37.372888 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4abbb7-4b51-4896-a0bc-2e7faf412fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:37.373163 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4abbb7-4b51-4896-a0bc-2e7faf412fb3 None admin] PATH_INFO: `/v3/users/38fd8e2a3efa4e248d3bee77305f1d91` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:37.391397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4abbb7-4b51-4896-a0bc-2e7faf412fb3 None admin] RBAC: Authorizing `identity:get_user(user_id=38fd8e2a3efa4e248d3bee77305f1d91)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:37.392856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4abbb7-4b51-4896-a0bc-2e7faf412fb3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:37.395332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 142/281] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:37 2022] GET /identity/v3/users/38fd8e2a3efa4e248d3bee77305f1d91 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:37.396700 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5c429-6608-4481-9a48-1e757ba8f372 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:37.397007 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5c429-6608-4481-9a48-1e757ba8f372 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:37.397272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5c429-6608-4481-9a48-1e757ba8f372 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:37.398811 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 143/282] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:37.401020 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5c429-6608-4481-9a48-1e757ba8f372 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:37.423113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dfba8-34fc-4e64-90b3-fce1191af65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:37.424013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dfba8-34fc-4e64-90b3-fce1191af65e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:37.424299 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dfba8-34fc-4e64-90b3-fce1191af65e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:37.424754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dfba8-34fc-4e64-90b3-fce1191af65e None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:37.425669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dfba8-34fc-4e64-90b3-fce1191af65e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:37.425983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dfba8-34fc-4e64-90b3-fce1191af65e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:37.427456 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dfba8-34fc-4e64-90b3-fce1191af65e None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:37.437769 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 140/283] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:37.444075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f4c6-03b7-49d4-9eca-796971173701 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:37.444365 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f4c6-03b7-49d4-9eca-796971173701 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:37.445575 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f4c6-03b7-49d4-9eca-796971173701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:37.464984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-9da2f4c6-03b7-49d4-9eca-796971173701 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:37.466225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9da2f4c6-03b7-49d4-9eca-796971173701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:37.557269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5c429-6608-4481-9a48-1e757ba8f372 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:37.574721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 141/284] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:37.575630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2f4c6-03b7-49d4-9eca-796971173701 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:37.614057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174faf8a-4b90-496f-a02e-0e7123dab1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:37.614831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174faf8a-4b90-496f-a02e-0e7123dab1f2 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:37.615109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174faf8a-4b90-496f-a02e-0e7123dab1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:37.615378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174faf8a-4b90-496f-a02e-0e7123dab1f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:37.616412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174faf8a-4b90-496f-a02e-0e7123dab1f2 None admin] RBAC: Adding query filter params (role.id=eef1174229014437a0db0fd8954bc25e, user.id=38fd8e2a3efa4e248d3bee77305f1d91, scope.system=all) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:37.617340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174faf8a-4b90-496f-a02e-0e7123dab1f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:37.619554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174faf8a-4b90-496f-a02e-0e7123dab1f2 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:37.626916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 144/285] 10.222.0.43 () {56 vars in 1308 bytes} [Wed Jul 27 10:35:37 2022] GET /identity/v3/role_assignments?user.id=38fd8e2a3efa4e248d3bee77305f1d91&scope.system=all&role.id=eef1174229014437a0db0fd8954bc25e => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:37.627857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174faf8a-4b90-496f-a02e-0e7123dab1f2 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:37.636014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:37.720120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:37.805319 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2f4c6-03b7-49d4-9eca-796971173701 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:37.863880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbde81-1cae-4d51-b143-24d4824df20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:37.864550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbde81-1cae-4d51-b143-24d4824df20a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:37.864833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbde81-1cae-4d51-b143-24d4824df20a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:37.865109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbde81-1cae-4d51-b143-24d4824df20a None admin] PATH_INFO: `/v3/users/9b0c9254fa534014ac4a12968274f315` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:37.866383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbde81-1cae-4d51-b143-24d4824df20a None admin] RBAC: Authorizing `identity:get_user(user_id=9b0c9254fa534014ac4a12968274f315)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:37.867975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbde81-1cae-4d51-b143-24d4824df20a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:37.870087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 142/286] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:37 2022] GET /identity/v3/users/9b0c9254fa534014ac4a12968274f315 => generated 297 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:37.876695 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbde81-1cae-4d51-b143-24d4824df20a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:37.880568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174faf8a-4b90-496f-a02e-0e7123dab1f2 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:37.952249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5db46-bca0-48d3-88bd-d0bfc31b61a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:37.952999 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5db46-bca0-48d3-88bd-d0bfc31b61a0 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:37.953230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5db46-bca0-48d3-88bd-d0bfc31b61a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:37.953506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5db46-bca0-48d3-88bd-d0bfc31b61a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:37.967420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5db46-bca0-48d3-88bd-d0bfc31b61a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-b5b5db46-bca0-48d3-88bd-d0bfc31b61a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:37.974398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:37.975312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:37.976109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:37.976109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:37.976109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:37.976109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:37.976109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:37.976109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:37.976109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:37.976109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:37.976109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:37.976109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:37.976109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:37.976109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:37.976109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 145/287] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:37.983699 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5db46-bca0-48d3-88bd-d0bfc31b61a0 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:38.111805 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:38.119856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbde81-1cae-4d51-b143-24d4824df20a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:38.186552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b62bad-d593-4282-bd2a-f4e7adbb3583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:38.187229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b62bad-d593-4282-bd2a-f4e7adbb3583 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:38.187511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b62bad-d593-4282-bd2a-f4e7adbb3583 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:38.187787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b62bad-d593-4282-bd2a-f4e7adbb3583 None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:38.189082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b62bad-d593-4282-bd2a-f4e7adbb3583 None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:38.191421 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b62bad-d593-4282-bd2a-f4e7adbb3583 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:38.193135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 143/288] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:37 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:38.203340 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b62bad-d593-4282-bd2a-f4e7adbb3583 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:38.210107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5db46-bca0-48d3-88bd-d0bfc31b61a0 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:38.219534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:38.261970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a69bd5-dfd4-4870-9911-ee9115d3ba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:38.262584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a69bd5-dfd4-4870-9911-ee9115d3ba97 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:38.262869 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a69bd5-dfd4-4870-9911-ee9115d3ba97 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:38.263148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a69bd5-dfd4-4870-9911-ee9115d3ba97 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:38.263914 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a69bd5-dfd4-4870-9911-ee9115d3ba97 None admin] RBAC: Adding query filter params (name=member) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:38.264228 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a69bd5-dfd4-4870-9911-ee9115d3ba97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:38.265655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a69bd5-dfd4-4870-9911-ee9115d3ba97 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:38.276415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 146/289] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:38.283341 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a69bd5-dfd4-4870-9911-ee9115d3ba97 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:38.362254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b62bad-d593-4282-bd2a-f4e7adbb3583 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:38.399300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfca06-aa3e-4dcc-9e8f-ad3e1a98f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:38.399983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfca06-aa3e-4dcc-9e8f-ad3e1a98f791 None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:38.400269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfca06-aa3e-4dcc-9e8f-ad3e1a98f791 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:38.400550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfca06-aa3e-4dcc-9e8f-ad3e1a98f791 None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787/users/9b0c9254fa534014ac4a12968274f315/roles/2838dfaf550b4ad68846863e49c6a7ae` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:38.402721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfca06-aa3e-4dcc-9e8f-ad3e1a98f791 None admin] RBAC: Authorizing `identity:create_grant(project_id=e80ed515f9014a95b587cb8122d54787, user_id=9b0c9254fa534014ac4a12968274f315, role_id=2838dfaf550b4ad68846863e49c6a7ae)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:38.404334 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfca06-aa3e-4dcc-9e8f-ad3e1a98f791 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:38.421101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 144/290] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:35:38 2022] PUT /identity/v3/projects/e80ed515f9014a95b587cb8122d54787/users/9b0c9254fa534014ac4a12968274f315/roles/2838dfaf550b4ad68846863e49c6a7ae => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:35:38.444361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a69bd5-dfd4-4870-9911-ee9115d3ba97 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:38.483329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:38.495423 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb13b3-6258-4b7d-a771-214d7042bae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:38.496083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb13b3-6258-4b7d-a771-214d7042bae8 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:38.496367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb13b3-6258-4b7d-a771-214d7042bae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:38.496645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb13b3-6258-4b7d-a771-214d7042bae8 None admin] PATH_INFO: `/v3/users/344efe38a40b4fe8afc4f835d16e6365` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:38.503289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb13b3-6258-4b7d-a771-214d7042bae8 None admin] RBAC: Authorizing `identity:get_user(user_id=344efe38a40b4fe8afc4f835d16e6365)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:38.504836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb13b3-6258-4b7d-a771-214d7042bae8 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:38.507055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 147/291] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:38 2022] GET /identity/v3/users/344efe38a40b4fe8afc4f835d16e6365 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:38.512512 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfca06-aa3e-4dcc-9e8f-ad3e1a98f791 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:38.626009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:38.673740 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfca06-aa3e-4dcc-9e8f-ad3e1a98f791 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:38.715357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240d86b-20e7-4f0b-a4aa-eb300435cc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:38.716009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240d86b-20e7-4f0b-a4aa-eb300435cc7c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:38.716294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240d86b-20e7-4f0b-a4aa-eb300435cc7c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:38.716573 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240d86b-20e7-4f0b-a4aa-eb300435cc7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:38.792587 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240d86b-20e7-4f0b-a4aa-eb300435cc7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:38.793983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240d86b-20e7-4f0b-a4aa-eb300435cc7c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:38.864347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:38.902235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 145/292] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:38.907766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb13b3-6258-4b7d-a771-214d7042bae8 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:39.066017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb13b3-6258-4b7d-a771-214d7042bae8 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:39.102612 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d394ac-0761-4c68-9688-40cefb78978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:39.103317 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d394ac-0761-4c68-9688-40cefb78978a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:39.103602 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d394ac-0761-4c68-9688-40cefb78978a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:39.103959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d394ac-0761-4c68-9688-40cefb78978a None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:39.105267 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d394ac-0761-4c68-9688-40cefb78978a None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:39.106762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d394ac-0761-4c68-9688-40cefb78978a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:39.108785 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 148/293] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:38 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:39.117067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240d86b-20e7-4f0b-a4aa-eb300435cc7c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:39.276432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240d86b-20e7-4f0b-a4aa-eb300435cc7c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:39.324185 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedcb5b-5a52-4d2c-9e75-0d1ae03d089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:39.324733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedcb5b-5a52-4d2c-9e75-0d1ae03d089f None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:39.325017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedcb5b-5a52-4d2c-9e75-0d1ae03d089f None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:39.325294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedcb5b-5a52-4d2c-9e75-0d1ae03d089f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:39.326104 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedcb5b-5a52-4d2c-9e75-0d1ae03d089f None admin] RBAC: Adding query filter params (role.id=eef1174229014437a0db0fd8954bc25e, scope.project.id=e80ed515f9014a95b587cb8122d54787, user.id=344efe38a40b4fe8afc4f835d16e6365) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:39.326443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedcb5b-5a52-4d2c-9e75-0d1ae03d089f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:39.327915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedcb5b-5a52-4d2c-9e75-0d1ae03d089f None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:39.339420 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 146/294] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:39 2022] GET /identity/v3/role_assignments?user.id=344efe38a40b4fe8afc4f835d16e6365&scope.project.id=e80ed515f9014a95b587cb8122d54787&role.id=eef1174229014437a0db0fd8954bc25e => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:39.818604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190870-0e0b-437f-9594-9a26d4564f6c None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:39.819007 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190870-0e0b-437f-9594-9a26d4564f6c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:39.819177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190870-0e0b-437f-9594-9a26d4564f6c None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:39.820836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 149/295] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:39.826317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8713cb-80e5-4fa4-b5c3-0e98bcf4d9b6 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:39.826609 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8713cb-80e5-4fa4-b5c3-0e98bcf4d9b6 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:39.826886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8713cb-80e5-4fa4-b5c3-0e98bcf4d9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:39.850174 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-2b8713cb-80e5-4fa4-b5c3-0e98bcf4d9b6 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:39.851450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2b8713cb-80e5-4fa4-b5c3-0e98bcf4d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:39.883107 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:39.936514 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 147/296] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:39.960582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61190870-0e0b-437f-9594-9a26d4564f6c None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:40.041584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:40.073716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326f81a-6483-4638-b05f-dff18d31345e None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:40.074358 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326f81a-6483-4638-b05f-dff18d31345e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:40.074830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326f81a-6483-4638-b05f-dff18d31345e None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:40.076686 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 148/297] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:35:40.082332 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f903f1d-1887-4d7f-ba3b-b97087ae7eec None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:40.083026 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f903f1d-1887-4d7f-ba3b-b97087ae7eec None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:40.083500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f903f1d-1887-4d7f-ba3b-b97087ae7eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:40.093859 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61190870-0e0b-437f-9594-9a26d4564f6c None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:40.105901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-0f903f1d-1887-4d7f-ba3b-b97087ae7eec None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:40.107504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0f903f1d-1887-4d7f-ba3b-b97087ae7eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:40.140432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34070e9e-c899-4243-8fd1-0709a64ed9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:40.141443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070e9e-c899-4243-8fd1-0709a64ed9cd None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:40.141926 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070e9e-c899-4243-8fd1-0709a64ed9cd None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:40.142431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070e9e-c899-4243-8fd1-0709a64ed9cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:40.163004 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34070e9e-c899-4243-8fd1-0709a64ed9cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-34070e9e-c899-4243-8fd1-0709a64ed9cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:40.172208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:40.173139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:40.173940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:40.173940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:40.173940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:40.173940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:40.173940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:40.173940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:40.173940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:40.173940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:40.173940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:40.173940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:40.173940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:40.173940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:40.176323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 150/298] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:40.182413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34070e9e-c899-4243-8fd1-0709a64ed9cd None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:40.229866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 149/299] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:40.231376 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffa0b1-9c94-472d-8686-b45be5334cf6 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:40.231661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffa0b1-9c94-472d-8686-b45be5334cf6 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:40.231929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffa0b1-9c94-472d-8686-b45be5334cf6 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:40.233337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 150/300] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:40.239415 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edef2a0-f53e-4020-b3b1-5cdbf5e1294a None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:40.239689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edef2a0-f53e-4020-b3b1-5cdbf5e1294a None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:40.239960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edef2a0-f53e-4020-b3b1-5cdbf5e1294a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:40.259868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-3edef2a0-f53e-4020-b3b1-5cdbf5e1294a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:40.261076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3edef2a0-f53e-4020-b3b1-5cdbf5e1294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:40.321704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34070e9e-c899-4243-8fd1-0709a64ed9cd None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:40.349583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:40.352800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 151/301] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:40.353509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edef2a0-f53e-4020-b3b1-5cdbf5e1294a None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:40.374950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab8ec4-c2e8-452c-afb9-f6bf4b6331a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:40.375955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab8ec4-c2e8-452c-afb9-f6bf4b6331a3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:40.376555 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab8ec4-c2e8-452c-afb9-f6bf4b6331a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:40.377043 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab8ec4-c2e8-452c-afb9-f6bf4b6331a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:40.378814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab8ec4-c2e8-452c-afb9-f6bf4b6331a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:40.379372 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab8ec4-c2e8-452c-afb9-f6bf4b6331a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:40.380935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:40.382094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab8ec4-c2e8-452c-afb9-f6bf4b6331a3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:40.394120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 151/302] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:40.395465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab8ec4-c2e8-452c-afb9-f6bf4b6331a3 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:40.486348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edef2a0-f53e-4020-b3b1-5cdbf5e1294a None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:40.524644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab8ec4-c2e8-452c-afb9-f6bf4b6331a3 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:40.526224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3f507-7e75-4cd4-8aa3-fd0f47b89701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:40.526969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3f507-7e75-4cd4-8aa3-fd0f47b89701 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:40.527259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3f507-7e75-4cd4-8aa3-fd0f47b89701 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:40.527555 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3f507-7e75-4cd4-8aa3-fd0f47b89701 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:40.528744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3f507-7e75-4cd4-8aa3-fd0f47b89701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:40.530226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3f507-7e75-4cd4-8aa3-fd0f47b89701 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:40.531885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 152/303] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:35:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:40.532682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3f507-7e75-4cd4-8aa3-fd0f47b89701 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:40.578448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572f652-0d3a-4cf6-8c95-739da459ce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:40.579540 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572f652-0d3a-4cf6-8c95-739da459ce1e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:40.580021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572f652-0d3a-4cf6-8c95-739da459ce1e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:40.580971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572f652-0d3a-4cf6-8c95-739da459ce1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:40.602081 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572f652-0d3a-4cf6-8c95-739da459ce1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-f572f652-0d3a-4cf6-8c95-739da459ce1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:40.608600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:40.609562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:40.610400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:40.610400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:40.610400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:40.610400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:40.610400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:40.610400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:40.610400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:40.610400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:40.610400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:40.610400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:40.610400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:40.610400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:40.610400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 152/304] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:40.611165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572f652-0d3a-4cf6-8c95-739da459ce1e None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:40.657702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:40.668301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:40.671936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3f507-7e75-4cd4-8aa3-fd0f47b89701 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:40.710540 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fda33-e941-4f01-864e-35df2faa1727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:40.711191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fda33-e941-4f01-864e-35df2faa1727 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:40.711469 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fda33-e941-4f01-864e-35df2faa1727 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:40.711739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fda33-e941-4f01-864e-35df2faa1727 None admin] PATH_INFO: `/v3/users/52231cb558c24ba2ae5841c14b573c9d` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:40.727045 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fda33-e941-4f01-864e-35df2faa1727 None admin] RBAC: Authorizing `identity:get_user(user_id=52231cb558c24ba2ae5841c14b573c9d)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:40.728948 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fda33-e941-4f01-864e-35df2faa1727 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:40.729147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572f652-0d3a-4cf6-8c95-739da459ce1e None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:40.730843 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 153/305] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:40 2022] GET /identity/v3/users/52231cb558c24ba2ae5841c14b573c9d => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:40.731632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fda33-e941-4f01-864e-35df2faa1727 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:40.773252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c30c7-1ac2-47b5-b250-d22ba33db8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:40.773880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c30c7-1ac2-47b5-b250-d22ba33db8fc None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:40.774157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c30c7-1ac2-47b5-b250-d22ba33db8fc None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:40.774457 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c30c7-1ac2-47b5-b250-d22ba33db8fc None admin] PATH_INFO: `/v3/groups` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:40.775129 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c30c7-1ac2-47b5-b250-d22ba33db8fc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:40.776595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c30c7-1ac2-47b5-b250-d22ba33db8fc None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:40.795917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 153/306] 10.222.0.43 () {60 vars in 1134 bytes} [Wed Jul 27 10:35:40 2022] POST /identity/v3/groups => generated 229 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:35:40.796708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c30c7-1ac2-47b5-b250-d22ba33db8fc None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:40.917426 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fda33-e941-4f01-864e-35df2faa1727 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:40.992326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c30c7-1ac2-47b5-b250-d22ba33db8fc None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:40.993345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26f6db-be77-412a-9017-cfe88c515b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:40.993994 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f6db-be77-412a-9017-cfe88c515b5a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:40.994317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f6db-be77-412a-9017-cfe88c515b5a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:40.994595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f6db-be77-412a-9017-cfe88c515b5a None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:40.995579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26f6db-be77-412a-9017-cfe88c515b5a None admin] RBAC: Adding query filter params (name=member) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:40.995888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26f6db-be77-412a-9017-cfe88c515b5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:40.996766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:40.998331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26f6db-be77-412a-9017-cfe88c515b5a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:41.022463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 154/307] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:41.031264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6096d2-34cb-4ae8-8895-770b71c8c2cc None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:41.031643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6096d2-34cb-4ae8-8895-770b71c8c2cc None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:41.031884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6096d2-34cb-4ae8-8895-770b71c8c2cc None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:41.033465 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 155/308] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:41.038291 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6096d2-34cb-4ae8-8895-770b71c8c2cc None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:41.042756 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b875d-9cfd-463d-8102-da662fe3ac5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:41.043407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b875d-9cfd-463d-8102-da662fe3ac5c None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:41.043695 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b875d-9cfd-463d-8102-da662fe3ac5c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:41.043975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b875d-9cfd-463d-8102-da662fe3ac5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:41.044797 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b875d-9cfd-463d-8102-da662fe3ac5c None admin] RBAC: Adding query filter params (role.id=2838dfaf550b4ad68846863e49c6a7ae, user.id=52231cb558c24ba2ae5841c14b573c9d, scope.system=all) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:41.045110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b875d-9cfd-463d-8102-da662fe3ac5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:41.046612 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b875d-9cfd-463d-8102-da662fe3ac5c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:41.051561 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:41.053331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 154/309] 10.222.0.43 () {56 vars in 1308 bytes} [Wed Jul 27 10:35:40 2022] GET /identity/v3/role_assignments?user.id=52231cb558c24ba2ae5841c14b573c9d&scope.system=all&role.id=2838dfaf550b4ad68846863e49c6a7ae => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:41.054530 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f89ca8-f134-4b9e-8c36-dbe34f9273a4 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:41.054820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f89ca8-f134-4b9e-8c36-dbe34f9273a4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:41.055104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f89ca8-f134-4b9e-8c36-dbe34f9273a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:41.078644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b4f89ca8-f134-4b9e-8c36-dbe34f9273a4 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:41.079954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b4f89ca8-f134-4b9e-8c36-dbe34f9273a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:41.179694 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 155/310] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:41.212359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f89ca8-f134-4b9e-8c36-dbe34f9273a4 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:41.226075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6096d2-34cb-4ae8-8895-770b71c8c2cc None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:41.301815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af7d5f-37ed-4f3e-a3de-4d62381f8361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:41.303418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af7d5f-37ed-4f3e-a3de-4d62381f8361 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:41.304020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af7d5f-37ed-4f3e-a3de-4d62381f8361 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:41.305171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af7d5f-37ed-4f3e-a3de-4d62381f8361 None admin] PATH_INFO: `/v3/users/38fd8e2a3efa4e248d3bee77305f1d91` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:41.307396 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af7d5f-37ed-4f3e-a3de-4d62381f8361 None admin] RBAC: Authorizing `identity:get_user(user_id=38fd8e2a3efa4e248d3bee77305f1d91)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:41.311030 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af7d5f-37ed-4f3e-a3de-4d62381f8361 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:41.312991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 156/311] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:41 2022] GET /identity/v3/users/38fd8e2a3efa4e248d3bee77305f1d91 => generated 293 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:41.321036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af7d5f-37ed-4f3e-a3de-4d62381f8361 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:41.378110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:41.382497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f89ca8-f134-4b9e-8c36-dbe34f9273a4 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:41.424024 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c167e-c226-49a4-8651-81c55cdee511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:41.425415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c167e-c226-49a4-8651-81c55cdee511 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:41.425700 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c167e-c226-49a4-8651-81c55cdee511 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:41.425979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c167e-c226-49a4-8651-81c55cdee511 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:41.433049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:41.440755 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c167e-c226-49a4-8651-81c55cdee511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-ba5c167e-c226-49a4-8651-81c55cdee511 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:41.446205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:41.447319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:41.448132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:41.448132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:41.448132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:41.448132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:41.448132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:41.448132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:41.448132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:41.448132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:41.448132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:41.448132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:41.448132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:41.448132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:41.448737 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 156/312] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:41.455291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c167e-c226-49a4-8651-81c55cdee511 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:41.469144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af7d5f-37ed-4f3e-a3de-4d62381f8361 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:41.516948 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d344949-f927-40c3-a56d-c5f5a10df62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:41.517884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d344949-f927-40c3-a56d-c5f5a10df62d None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:41.518475 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d344949-f927-40c3-a56d-c5f5a10df62d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:41.518984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d344949-f927-40c3-a56d-c5f5a10df62d None admin] PATH_INFO: `/v3/system/users/38fd8e2a3efa4e248d3bee77305f1d91/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:41.521223 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d344949-f927-40c3-a56d-c5f5a10df62d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=38fd8e2a3efa4e248d3bee77305f1d91, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:41.522817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d344949-f927-40c3-a56d-c5f5a10df62d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:41.542356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 157/313] 10.222.0.43 () {58 vars in 1334 bytes} [Wed Jul 27 10:35:41 2022] PUT /identity/v3/system/users/38fd8e2a3efa4e248d3bee77305f1d91/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:35:41.617977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c167e-c226-49a4-8651-81c55cdee511 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:41.662353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3953e-8f4c-4f14-83d1-1aa4cf231014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:41.663471 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3953e-8f4c-4f14-83d1-1aa4cf231014 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:41.663988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3953e-8f4c-4f14-83d1-1aa4cf231014 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:41.664465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3953e-8f4c-4f14-83d1-1aa4cf231014 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:41.665439 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3953e-8f4c-4f14-83d1-1aa4cf231014 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:41.665959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3953e-8f4c-4f14-83d1-1aa4cf231014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:41.667657 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3953e-8f4c-4f14-83d1-1aa4cf231014 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:41.679075 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 157/314] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:41.686266 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d344949-f927-40c3-a56d-c5f5a10df62d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:41.829177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d344949-f927-40c3-a56d-c5f5a10df62d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:41.870271 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d73c2f-35e0-4b45-b8bf-1f0873324b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:41.871665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d73c2f-35e0-4b45-b8bf-1f0873324b34 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:41.872196 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d73c2f-35e0-4b45-b8bf-1f0873324b34 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:41.872785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d73c2f-35e0-4b45-b8bf-1f0873324b34 None admin] PATH_INFO: `/v3/users/9b0c9254fa534014ac4a12968274f315` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:41.874419 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d73c2f-35e0-4b45-b8bf-1f0873324b34 None admin] RBAC: Authorizing `identity:get_user(user_id=9b0c9254fa534014ac4a12968274f315)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:41.876543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d73c2f-35e0-4b45-b8bf-1f0873324b34 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:41.878876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 158/315] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:41 2022] GET /identity/v3/users/9b0c9254fa534014ac4a12968274f315 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:41.885913 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3953e-8f4c-4f14-83d1-1aa4cf231014 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:41.923274 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:42.022949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3953e-8f4c-4f14-83d1-1aa4cf231014 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:42.060461 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5bf99-6707-4ff4-838d-dda4a774386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:42.061476 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5bf99-6707-4ff4-838d-dda4a774386c None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:42.061982 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5bf99-6707-4ff4-838d-dda4a774386c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:42.062474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5bf99-6707-4ff4-838d-dda4a774386c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:42.150476 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5bf99-6707-4ff4-838d-dda4a774386c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:42.152321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5bf99-6707-4ff4-838d-dda4a774386c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:42.177137 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:42.275511 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 158/316] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:42.285649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d73c2f-35e0-4b45-b8bf-1f0873324b34 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:42.306041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:42.459885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d73c2f-35e0-4b45-b8bf-1f0873324b34 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:42.496148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c676b6-dde9-442e-8b60-a323a4ebc5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:42.496809 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c676b6-dde9-442e-8b60-a323a4ebc5e2 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:42.497094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c676b6-dde9-442e-8b60-a323a4ebc5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:42.497383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c676b6-dde9-442e-8b60-a323a4ebc5e2 None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:42.498645 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c676b6-dde9-442e-8b60-a323a4ebc5e2 None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:42.500104 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c676b6-dde9-442e-8b60-a323a4ebc5e2 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:42.502104 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 159/317] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:42 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:42.513428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5bf99-6707-4ff4-838d-dda4a774386c None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:42.703678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5bf99-6707-4ff4-838d-dda4a774386c None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:42.726826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:42.758072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49ac0c-8ab8-4c43-9aef-9a9e2907f6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:42.759515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ac0c-8ab8-4c43-9aef-9a9e2907f6e7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:42.760269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ac0c-8ab8-4c43-9aef-9a9e2907f6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:42.760954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ac0c-8ab8-4c43-9aef-9a9e2907f6e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:42.762845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49ac0c-8ab8-4c43-9aef-9a9e2907f6e7 None admin] RBAC: Adding query filter params (role.id=2838dfaf550b4ad68846863e49c6a7ae, scope.project.id=e80ed515f9014a95b587cb8122d54787, user.id=9b0c9254fa534014ac4a12968274f315) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:42.763645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49ac0c-8ab8-4c43-9aef-9a9e2907f6e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:42.766686 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49ac0c-8ab8-4c43-9aef-9a9e2907f6e7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:42.780512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 159/318] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:35:42 2022] GET /identity/v3/role_assignments?user.id=9b0c9254fa534014ac4a12968274f315&scope.project.id=e80ed515f9014a95b587cb8122d54787&role.id=2838dfaf550b4ad68846863e49c6a7ae => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:43.232333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ef000-a75d-4639-90f9-d177cd8007e1 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:43.232609 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ef000-a75d-4639-90f9-d177cd8007e1 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:43.233049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ef000-a75d-4639-90f9-d177cd8007e1 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:43.234653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 160/319] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:43.240784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4afb77-e3cb-4d52-982e-b29941aa959d None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:43.241078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4afb77-e3cb-4d52-982e-b29941aa959d None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:43.241596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4afb77-e3cb-4d52-982e-b29941aa959d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:43.261967 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-bf4afb77-e3cb-4d52-982e-b29941aa959d None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:43.263305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-bf4afb77-e3cb-4d52-982e-b29941aa959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:43.347863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 160/320] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:43.374938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ef000-a75d-4639-90f9-d177cd8007e1 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:43.420704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6f56b-1278-4f23-a685-a0225e7ea092 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:43.420993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6f56b-1278-4f23-a685-a0225e7ea092 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:43.421464 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6f56b-1278-4f23-a685-a0225e7ea092 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:43.423007 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 161/321] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:35:43.429053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9875-7818-472e-afd1-c32f3bb5bfe6 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:43.429572 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9875-7818-472e-afd1-c32f3bb5bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:43.429832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9875-7818-472e-afd1-c32f3bb5bfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:43.452004 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-3adb9875-7818-472e-afd1-c32f3bb5bfe6 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:43.454165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3adb9875-7818-472e-afd1-c32f3bb5bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:43.506266 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:43.544324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ef000-a75d-4639-90f9-d177cd8007e1 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:43.559219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 162/322] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:43.586760 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb9875-7818-472e-afd1-c32f3bb5bfe6 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:43.601936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fa90f-d38c-4e4e-bc9a-4fb1150c1c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:43.602631 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fa90f-d38c-4e4e-bc9a-4fb1150c1c56 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:43.602919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fa90f-d38c-4e4e-bc9a-4fb1150c1c56 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:43.603186 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fa90f-d38c-4e4e-bc9a-4fb1150c1c56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:43.604366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fa90f-d38c-4e4e-bc9a-4fb1150c1c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:43.605839 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fa90f-d38c-4e4e-bc9a-4fb1150c1c56 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:43.614501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 161/323] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:35:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:43.617373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fa90f-d38c-4e4e-bc9a-4fb1150c1c56 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:43.644590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:43.729396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb9875-7818-472e-afd1-c32f3bb5bfe6 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:43.780171 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b0713-8b53-43f9-8dd2-8c9c90d8770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:43.780741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b0713-8b53-43f9-8dd2-8c9c90d8770e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:43.781007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fa90f-d38c-4e4e-bc9a-4fb1150c1c56 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:43.781162 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b0713-8b53-43f9-8dd2-8c9c90d8770e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:43.781296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b0713-8b53-43f9-8dd2-8c9c90d8770e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:43.802697 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b0713-8b53-43f9-8dd2-8c9c90d8770e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-ee5b0713-8b53-43f9-8dd2-8c9c90d8770e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:43.813003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:43.814402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:43.815650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:43.815650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:43.815650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:43.815650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:43.815650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:43.815650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:43.815650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:43.815650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:43.815650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:43.815650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:43.815650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:43.815650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:43.817462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 163/324] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:43.818889 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9dad5-7448-4518-a448-965ca20d61c6 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:43.819400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9dad5-7448-4518-a448-965ca20d61c6 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:43.819993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9dad5-7448-4518-a448-965ca20d61c6 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:43.821486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29282452-66ea-420a-af3b-eba5509db4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:43.822154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29282452-66ea-420a-af3b-eba5509db4ad None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:43.822714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 164/325] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:43.822968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29282452-66ea-420a-af3b-eba5509db4ad None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:43.823196 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29282452-66ea-420a-af3b-eba5509db4ad None admin] PATH_INFO: `/v3/groups` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:43.823689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29282452-66ea-420a-af3b-eba5509db4ad None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:43.824063 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9dad5-7448-4518-a448-965ca20d61c6 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:43.825216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29282452-66ea-420a-af3b-eba5509db4ad None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:43.849188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 162/326] 10.222.0.43 () {60 vars in 1134 bytes} [Wed Jul 27 10:35:43 2022] POST /identity/v3/groups => generated 226 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:35:43.852232 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c083d-3b0f-4082-afa9-c9ba6fe8f1cd None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:43.852232 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c083d-3b0f-4082-afa9-c9ba6fe8f1cd None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:43.852232 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c083d-3b0f-4082-afa9-c9ba6fe8f1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:43.866089 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:43.888669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-0d3c083d-3b0f-4082-afa9-c9ba6fe8f1cd None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:43.892636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0d3c083d-3b0f-4082-afa9-c9ba6fe8f1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:44.007353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9dad5-7448-4518-a448-965ca20d61c6 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:44.008102 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 163/327] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:44.014085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:44.031640 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c083d-3b0f-4082-afa9-c9ba6fe8f1cd None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:44.074109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb851fa9-aeab-45c6-974c-85fe2096ee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:44.075172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851fa9-aeab-45c6-974c-85fe2096ee92 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:44.075652 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851fa9-aeab-45c6-974c-85fe2096ee92 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:44.077082 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851fa9-aeab-45c6-974c-85fe2096ee92 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:44.077531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb851fa9-aeab-45c6-974c-85fe2096ee92 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:44.078073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb851fa9-aeab-45c6-974c-85fe2096ee92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:44.081258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb851fa9-aeab-45c6-974c-85fe2096ee92 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:44.098613 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 165/328] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:44.104423 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb851fa9-aeab-45c6-974c-85fe2096ee92 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:44.201122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c083d-3b0f-4082-afa9-c9ba6fe8f1cd None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:44.271285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00ef13-709c-4b45-b296-15b2128bae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:44.276552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00ef13-709c-4b45-b296-15b2128bae56 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:44.276552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00ef13-709c-4b45-b296-15b2128bae56 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:44.276552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00ef13-709c-4b45-b296-15b2128bae56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:44.278872 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:44.301439 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00ef13-709c-4b45-b296-15b2128bae56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:44.307544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb851fa9-aeab-45c6-974c-85fe2096ee92 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-5d00ef13-709c-4b45-b296-15b2128bae56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:44.312159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:44.313901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:44.316849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:44.316849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:44.316849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:44.316849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:44.316849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:44.316849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:44.316849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:44.316849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:44.316849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:44.316849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:44.316849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:44.316849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:44.316849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 164/329] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:35:44.323383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00ef13-709c-4b45-b296-15b2128bae56 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:44.384705 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b04da-1f40-46f5-a5b7-c4af121ef9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:44.386233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b04da-1f40-46f5-a5b7-c4af121ef9be None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:44.386848 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b04da-1f40-46f5-a5b7-c4af121ef9be None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:44.387283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b04da-1f40-46f5-a5b7-c4af121ef9be None admin] PATH_INFO: `/v3/users/52231cb558c24ba2ae5841c14b573c9d` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:44.389107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b04da-1f40-46f5-a5b7-c4af121ef9be None admin] RBAC: Authorizing `identity:get_user(user_id=52231cb558c24ba2ae5841c14b573c9d)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:44.390919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b04da-1f40-46f5-a5b7-c4af121ef9be None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:44.393809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 166/330] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:44 2022] GET /identity/v3/users/52231cb558c24ba2ae5841c14b573c9d => generated 293 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:44.399515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b04da-1f40-46f5-a5b7-c4af121ef9be None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:44.443851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:44.489181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00ef13-709c-4b45-b296-15b2128bae56 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:44.529694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a8523-7d7e-4866-9c58-583bd3931a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:44.531260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a8523-7d7e-4866-9c58-583bd3931a6e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:44.531749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a8523-7d7e-4866-9c58-583bd3931a6e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:44.532228 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a8523-7d7e-4866-9c58-583bd3931a6e None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:44.533211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a8523-7d7e-4866-9c58-583bd3931a6e None admin] RBAC: Adding query filter params (name=member) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:44.534387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a8523-7d7e-4866-9c58-583bd3931a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:44.536014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a8523-7d7e-4866-9c58-583bd3931a6e None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:44.545654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 165/331] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:44.552928 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b04da-1f40-46f5-a5b7-c4af121ef9be None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:44.562082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a8523-7d7e-4866-9c58-583bd3931a6e None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:44.592854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec0b55-96f1-41f8-9ae5-a2c9a66bc438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:44.593532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec0b55-96f1-41f8-9ae5-a2c9a66bc438 None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:44.593822 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec0b55-96f1-41f8-9ae5-a2c9a66bc438 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:44.594102 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec0b55-96f1-41f8-9ae5-a2c9a66bc438 None admin] PATH_INFO: `/v3/system/users/52231cb558c24ba2ae5841c14b573c9d/roles/2838dfaf550b4ad68846863e49c6a7ae` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:44.595737 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec0b55-96f1-41f8-9ae5-a2c9a66bc438 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=52231cb558c24ba2ae5841c14b573c9d, role_id=2838dfaf550b4ad68846863e49c6a7ae)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:44.598388 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec0b55-96f1-41f8-9ae5-a2c9a66bc438 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:44.610886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 167/332] 10.222.0.43 () {58 vars in 1334 bytes} [Wed Jul 27 10:35:44 2022] PUT /identity/v3/system/users/52231cb558c24ba2ae5841c14b573c9d/roles/2838dfaf550b4ad68846863e49c6a7ae => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:35:44.640864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:44.703130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a8523-7d7e-4866-9c58-583bd3931a6e None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:44.746103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c703e6-01ce-4c17-b8fe-dc1dc628d009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:44.746815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c703e6-01ce-4c17-b8fe-dc1dc628d009 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:44.747101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c703e6-01ce-4c17-b8fe-dc1dc628d009 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:44.747379 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c703e6-01ce-4c17-b8fe-dc1dc628d009 None admin] PATH_INFO: `/v3/users/38fd8e2a3efa4e248d3bee77305f1d91` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:44.748802 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c703e6-01ce-4c17-b8fe-dc1dc628d009 None admin] RBAC: Authorizing `identity:get_user(user_id=38fd8e2a3efa4e248d3bee77305f1d91)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:44.750356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c703e6-01ce-4c17-b8fe-dc1dc628d009 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:44.753051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 166/333] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:44 2022] GET /identity/v3/users/38fd8e2a3efa4e248d3bee77305f1d91 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:44.759778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec0b55-96f1-41f8-9ae5-a2c9a66bc438 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:44.912111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:44.917167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec0b55-96f1-41f8-9ae5-a2c9a66bc438 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:44.963957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f58b0-e447-426e-a808-44016383682f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:44.965031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f58b0-e447-426e-a808-44016383682f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:44.965517 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f58b0-e447-426e-a808-44016383682f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:44.965988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f58b0-e447-426e-a808-44016383682f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:44.967073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f58b0-e447-426e-a808-44016383682f None admin] RBAC: Adding query filter params (role.id=eef1174229014437a0db0fd8954bc25e, user.id=38fd8e2a3efa4e248d3bee77305f1d91, scope.system=all) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:44.967472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f58b0-e447-426e-a808-44016383682f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:44.968866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f58b0-e447-426e-a808-44016383682f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:44.984335 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 168/334] 10.222.0.43 () {56 vars in 1308 bytes} [Wed Jul 27 10:35:44 2022] GET /identity/v3/role_assignments?user.id=38fd8e2a3efa4e248d3bee77305f1d91&scope.system=all&role.id=eef1174229014437a0db0fd8954bc25e => generated 510 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:46.516249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a1b25-a32b-4507-a540-e37a36a29c05 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:46.516808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a1b25-a32b-4507-a540-e37a36a29c05 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:46.516808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a1b25-a32b-4507-a540-e37a36a29c05 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:46.518777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 167/335] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:46.524796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d458d-1ab2-4cf7-a396-96ca46aaf327 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:46.525282 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d458d-1ab2-4cf7-a396-96ca46aaf327 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:46.525353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d458d-1ab2-4cf7-a396-96ca46aaf327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:46.549931 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-638d458d-1ab2-4cf7-a396-96ca46aaf327 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:46.551352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-638d458d-1ab2-4cf7-a396-96ca46aaf327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:46.653283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 169/336] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:46.697328 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a1b25-a32b-4507-a540-e37a36a29c05 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:46.842967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a1b25-a32b-4507-a540-e37a36a29c05 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:46.874639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:46.885782 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1051fa-e67a-4880-9510-8066fb9531a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:46.886472 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1051fa-e67a-4880-9510-8066fb9531a5 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:46.886758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1051fa-e67a-4880-9510-8066fb9531a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:46.887034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1051fa-e67a-4880-9510-8066fb9531a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:46.905369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1051fa-e67a-4880-9510-8066fb9531a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-6b1051fa-e67a-4880-9510-8066fb9531a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:46.911742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:46.912674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:46.913476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:46.913476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:46.913476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:46.913476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:46.913476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:46.913476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:46.913476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:46.913476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:46.913476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:46.913476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:46.913476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:46.913476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:46.914580 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 168/337] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:46.919256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d458d-1ab2-4cf7-a396-96ca46aaf327 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:47.055446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:47.080253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d458d-1ab2-4cf7-a396-96ca46aaf327 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:47.132635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4230cb0-5fbe-4306-9df3-23c0c1777029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:47.133436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4230cb0-5fbe-4306-9df3-23c0c1777029 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:47.133727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4230cb0-5fbe-4306-9df3-23c0c1777029 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:47.134010 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4230cb0-5fbe-4306-9df3-23c0c1777029 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:47.134821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4230cb0-5fbe-4306-9df3-23c0c1777029 None admin] RBAC: Adding query filter params (name=member) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:47.135147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4230cb0-5fbe-4306-9df3-23c0c1777029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:47.137019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4230cb0-5fbe-4306-9df3-23c0c1777029 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:47.151783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 170/338] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:47.157434 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1051fa-e67a-4880-9510-8066fb9531a5 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:47.182595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb06d3-fc91-4820-8583-35d17c99038b None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:47.182904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb06d3-fc91-4820-8583-35d17c99038b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:47.183155 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb06d3-fc91-4820-8583-35d17c99038b None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:47.188551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 171/339] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:35:47.196847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff01a6-fd5e-4cc4-ab11-e316bdf7a20f None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:47.197145 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff01a6-fd5e-4cc4-ab11-e316bdf7a20f None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:47.197409 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff01a6-fd5e-4cc4-ab11-e316bdf7a20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:47.233678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b4ff01a6-fd5e-4cc4-ab11-e316bdf7a20f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:47.234965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b4ff01a6-fd5e-4cc4-ab11-e316bdf7a20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:47.379166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 172/340] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:47.383320 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1051fa-e67a-4880-9510-8066fb9531a5 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:47.419204 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff01a6-fd5e-4cc4-ab11-e316bdf7a20f None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:47.449074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8356b-13dc-4c9b-9222-28e557a31f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:47.449721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8356b-13dc-4c9b-9222-28e557a31f87 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:47.450008 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8356b-13dc-4c9b-9222-28e557a31f87 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:47.450307 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8356b-13dc-4c9b-9222-28e557a31f87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:47.530499 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:47.569712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8356b-13dc-4c9b-9222-28e557a31f87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:47.571626 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8356b-13dc-4c9b-9222-28e557a31f87 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:47.575768 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:47.636393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff01a6-fd5e-4cc4-ab11-e316bdf7a20f None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:47.711990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5988e2-2e93-4bdd-9040-c8c8f839c05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:47.712660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5988e2-2e93-4bdd-9040-c8c8f839c05a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:47.712967 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5988e2-2e93-4bdd-9040-c8c8f839c05a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:47.713214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5988e2-2e93-4bdd-9040-c8c8f839c05a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:47.747288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5988e2-2e93-4bdd-9040-c8c8f839c05a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-8a5988e2-2e93-4bdd-9040-c8c8f839c05a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:47.753188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:47.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:47.756591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:47.756591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:47.756591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:47.756591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:47.756591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:47.756591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:47.756591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:47.756591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:47.756591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:47.756591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:47.756591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:47.756591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:47.758903 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 173/341] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:35:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:35:47.762254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b42bb-3cc3-4b0b-a15b-9da98e24bbab None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:47.762254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b42bb-3cc3-4b0b-a15b-9da98e24bbab None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:47.762254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b42bb-3cc3-4b0b-a15b-9da98e24bbab None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:47.763027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 174/342] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:47.768676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b2110-8543-4148-bd9b-929dfce5b188 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:47.769051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b2110-8543-4148-bd9b-929dfce5b188 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:47.769226 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b2110-8543-4148-bd9b-929dfce5b188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:47.807283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-4c5b2110-8543-4148-bd9b-929dfce5b188 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:47.808557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4c5b2110-8543-4148-bd9b-929dfce5b188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:47.810169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 169/343] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:47.812263 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8356b-13dc-4c9b-9222-28e557a31f87 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:47.946142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 175/344] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:47.948626 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b2110-8543-4148-bd9b-929dfce5b188 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:48.025247 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:48.051496 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8356b-13dc-4c9b-9222-28e557a31f87 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:48.081041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:48.107963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4bc57-ed71-42f5-b1da-eb9d71865b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:48.109000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4bc57-ed71-42f5-b1da-eb9d71865b49 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:48.109429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4bc57-ed71-42f5-b1da-eb9d71865b49 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:48.109850 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4bc57-ed71-42f5-b1da-eb9d71865b49 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:48.110995 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4bc57-ed71-42f5-b1da-eb9d71865b49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:48.111527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4bc57-ed71-42f5-b1da-eb9d71865b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:48.113417 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4bc57-ed71-42f5-b1da-eb9d71865b49 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:48.123249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 170/345] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:35:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:48.124469 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4bc57-ed71-42f5-b1da-eb9d71865b49 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:48.135900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b2110-8543-4148-bd9b-929dfce5b188 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:48.193566 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba436f-c38c-4ef7-8b3e-6f20fa354ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:48.194829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba436f-c38c-4ef7-8b3e-6f20fa354ddf None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:48.195546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba436f-c38c-4ef7-8b3e-6f20fa354ddf None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:48.196504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba436f-c38c-4ef7-8b3e-6f20fa354ddf None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:48.198573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba436f-c38c-4ef7-8b3e-6f20fa354ddf None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:48.201698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba436f-c38c-4ef7-8b3e-6f20fa354ddf None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:48.205758 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 176/346] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:47 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:48.212900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37538c7d-1715-4cad-bebf-191e7572b00d None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:48.213478 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37538c7d-1715-4cad-bebf-191e7572b00d None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:48.213992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37538c7d-1715-4cad-bebf-191e7572b00d None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:48.216629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 177/347] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:48.222253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37538c7d-1715-4cad-bebf-191e7572b00d None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:48.258928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4bc57-ed71-42f5-b1da-eb9d71865b49 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:48.315741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47697c67-2328-4c5b-8436-3f644cb7b140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:48.316634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47697c67-2328-4c5b-8436-3f644cb7b140 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:48.316923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47697c67-2328-4c5b-8436-3f644cb7b140 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:48.317307 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47697c67-2328-4c5b-8436-3f644cb7b140 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:48.329829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47697c67-2328-4c5b-8436-3f644cb7b140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-47697c67-2328-4c5b-8436-3f644cb7b140 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:48.336378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:48.337430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:48.338317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:48.338317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:48.338317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:48.338317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:48.338317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:48.338317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:48.338317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:48.338317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:48.338317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:48.338317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:48.338317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 10:35:48.338317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:48.338317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 171/348] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:48.347188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1defa-a9a5-403a-99b7-1c9fc1208d6d None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:48.347485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1defa-a9a5-403a-99b7-1c9fc1208d6d None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:48.347823 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1defa-a9a5-403a-99b7-1c9fc1208d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:48.366601 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:48.370179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-16c1defa-a9a5-403a-99b7-1c9fc1208d6d None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:48.371855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-16c1defa-a9a5-403a-99b7-1c9fc1208d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:48.386523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37538c7d-1715-4cad-bebf-191e7572b00d None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:48.443739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fba2b-a8c4-445d-b08b-0e9c09ae46ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:48.444380 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fba2b-a8c4-445d-b08b-0e9c09ae46ea None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:48.444663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fba2b-a8c4-445d-b08b-0e9c09ae46ea None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:48.444931 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fba2b-a8c4-445d-b08b-0e9c09ae46ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:48.452778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:48.495414 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 172/349] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:48.496844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1defa-a9a5-403a-99b7-1c9fc1208d6d None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:48.540396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fba2b-a8c4-445d-b08b-0e9c09ae46ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:48.541900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fba2b-a8c4-445d-b08b-0e9c09ae46ea None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:48.701809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 178/350] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:48.703721 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fba2b-a8c4-445d-b08b-0e9c09ae46ea None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:48.729884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1defa-a9a5-403a-99b7-1c9fc1208d6d None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:48.748040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:48.776701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2e1bf-8977-480b-b383-cacdb444e765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:48.777694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2e1bf-8977-480b-b383-cacdb444e765 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:48.778158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2e1bf-8977-480b-b383-cacdb444e765 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:48.778646 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2e1bf-8977-480b-b383-cacdb444e765 None admin] PATH_INFO: `/v3/groups/94e958c60dff4b998bd2060f7b69f84b` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:48.783514 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:48.787210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2e1bf-8977-480b-b383-cacdb444e765 None admin] RBAC: Authorizing `identity:get_group(group_id=94e958c60dff4b998bd2060f7b69f84b)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:48.789427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2e1bf-8977-480b-b383-cacdb444e765 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:48.797062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 173/351] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:35:48 2022] GET /identity/v3/groups/94e958c60dff4b998bd2060f7b69f84b => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:48.797062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2e1bf-8977-480b-b383-cacdb444e765 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:48.852050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fba2b-a8c4-445d-b08b-0e9c09ae46ea None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:48.904735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d8697-87fe-446e-b83d-9dae37818b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:48.905598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d8697-87fe-446e-b83d-9dae37818b1c None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:48.905776 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d8697-87fe-446e-b83d-9dae37818b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:48.906141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d8697-87fe-446e-b83d-9dae37818b1c None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:48.907619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d8697-87fe-446e-b83d-9dae37818b1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:48.907761 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d8697-87fe-446e-b83d-9dae37818b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:48.909219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d8697-87fe-446e-b83d-9dae37818b1c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:48.920513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 179/352] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:48.921188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d8697-87fe-446e-b83d-9dae37818b1c None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:48.932122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2e1bf-8977-480b-b383-cacdb444e765 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:48.975135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d9a79-135b-47ab-99f4-845be7b0bfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:48.976099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d9a79-135b-47ab-99f4-845be7b0bfa5 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:48.976549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d9a79-135b-47ab-99f4-845be7b0bfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:48.976842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d9a79-135b-47ab-99f4-845be7b0bfa5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:48.997008 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d9a79-135b-47ab-99f4-845be7b0bfa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-b99d9a79-135b-47ab-99f4-845be7b0bfa5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:49.006854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:49.008018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:49.009081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:49.009081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:49.009081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:49.009081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:49.009081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:49.009081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:49.009081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:49.009081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:49.009081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:49.009081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:49.009081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:49.009081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:49.009081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 174/353] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:49.009831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159e467-d53c-4ced-8dd6-b2045e652098 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:49.009831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159e467-d53c-4ced-8dd6-b2045e652098 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:49.010142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159e467-d53c-4ced-8dd6-b2045e652098 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:49.016778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 175/354] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:49.017920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159e467-d53c-4ced-8dd6-b2045e652098 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:49.090360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:49.097431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d8697-87fe-446e-b83d-9dae37818b1c None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:49.121062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:49.154911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197f19c-9e97-4c83-a761-9acd8855441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:49.155576 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f19c-9e97-4c83-a761-9acd8855441f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:49.155868 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f19c-9e97-4c83-a761-9acd8855441f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:49.156145 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f19c-9e97-4c83-a761-9acd8855441f None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:49.157395 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197f19c-9e97-4c83-a761-9acd8855441f None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:49.160050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197f19c-9e97-4c83-a761-9acd8855441f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:49.161849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 180/355] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:48 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:49.163562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197f19c-9e97-4c83-a761-9acd8855441f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:49.190611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159e467-d53c-4ced-8dd6-b2045e652098 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:49.235201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef585a-89a7-447a-a392-57bf5a85390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:49.235740 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef585a-89a7-447a-a392-57bf5a85390b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:49.236021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef585a-89a7-447a-a392-57bf5a85390b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:49.236343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef585a-89a7-447a-a392-57bf5a85390b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:49.237156 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef585a-89a7-447a-a392-57bf5a85390b None admin] RBAC: Adding query filter params (group.id=94e958c60dff4b998bd2060f7b69f84b, role.id=eef1174229014437a0db0fd8954bc25e, scope.project.id=c42f8c638d1645be870a7efafeb6b2ac) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:49.237466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef585a-89a7-447a-a392-57bf5a85390b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:49.238983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef585a-89a7-447a-a392-57bf5a85390b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:49.247803 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 176/356] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jul 27 10:35:49 2022] GET /identity/v3/role_assignments?group.id=94e958c60dff4b998bd2060f7b69f84b&scope.project.id=c42f8c638d1645be870a7efafeb6b2ac&role.id=eef1174229014437a0db0fd8954bc25e => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:49.248848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f256c1-a479-4393-a2c0-b54db0795bbc None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:49.249116 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f256c1-a479-4393-a2c0-b54db0795bbc None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:49.249679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f256c1-a479-4393-a2c0-b54db0795bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:49.288030 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-05f256c1-a479-4393-a2c0-b54db0795bbc None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:49.289400 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-05f256c1-a479-4393-a2c0-b54db0795bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:49.345727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197f19c-9e97-4c83-a761-9acd8855441f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:49.409518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed70bb9-2b60-44ad-95ec-fdcfc97b7529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:49.410912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed70bb9-2b60-44ad-95ec-fdcfc97b7529 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:49.410912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed70bb9-2b60-44ad-95ec-fdcfc97b7529 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:49.410912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed70bb9-2b60-44ad-95ec-fdcfc97b7529 None admin] PATH_INFO: `/v3/users/52231cb558c24ba2ae5841c14b573c9d` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:49.412145 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed70bb9-2b60-44ad-95ec-fdcfc97b7529 None admin] RBAC: Authorizing `identity:get_user(user_id=52231cb558c24ba2ae5841c14b573c9d)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:49.413667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed70bb9-2b60-44ad-95ec-fdcfc97b7529 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:49.415590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 181/357] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:35:49 2022] GET /identity/v3/users/52231cb558c24ba2ae5841c14b573c9d => generated 293 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:49.420781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 177/358] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:49.420781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409818de-4e84-4760-a619-f81bfa245ea3 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:49.420781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409818de-4e84-4760-a619-f81bfa245ea3 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:49.420781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409818de-4e84-4760-a619-f81bfa245ea3 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:49.420781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 178/359] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:49.420781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409818de-4e84-4760-a619-f81bfa245ea3 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:49.422948 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed70bb9-2b60-44ad-95ec-fdcfc97b7529 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:49.482574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:49.509798 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:49.575038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed70bb9-2b60-44ad-95ec-fdcfc97b7529 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:49.581637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409818de-4e84-4760-a619-f81bfa245ea3 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:49.625555 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851c8b2-7d95-4693-85ae-57da3d497187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:49.625555 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c8b2-7d95-4693-85ae-57da3d497187 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:49.625555 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c8b2-7d95-4693-85ae-57da3d497187 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:49.625555 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851c8b2-7d95-4693-85ae-57da3d497187 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:49.626159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851c8b2-7d95-4693-85ae-57da3d497187 None admin] RBAC: Adding query filter params (name=member) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:49.626159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851c8b2-7d95-4693-85ae-57da3d497187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:49.626726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851c8b2-7d95-4693-85ae-57da3d497187 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:49.629782 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905e0e9-e212-4d07-8f14-22b91bf140b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:49.630497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905e0e9-e212-4d07-8f14-22b91bf140b8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:49.630780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905e0e9-e212-4d07-8f14-22b91bf140b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:49.631057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905e0e9-e212-4d07-8f14-22b91bf140b8 None admin] PATH_INFO: `/v3/groups/94e958c60dff4b998bd2060f7b69f84b` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:49.632259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905e0e9-e212-4d07-8f14-22b91bf140b8 None admin] RBAC: Authorizing `identity:get_group(group_id=94e958c60dff4b998bd2060f7b69f84b)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:49.633704 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905e0e9-e212-4d07-8f14-22b91bf140b8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:49.639323 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 179/360] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:35:49 2022] GET /identity/v3/groups/94e958c60dff4b998bd2060f7b69f84b => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:49.639323 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905e0e9-e212-4d07-8f14-22b91bf140b8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:49.639630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 182/361] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:49.639630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c416937-dbab-4abe-8be9-93fc7b0057f4 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:49.639630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c416937-dbab-4abe-8be9-93fc7b0057f4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:49.639630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c416937-dbab-4abe-8be9-93fc7b0057f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:49.663252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-7c416937-dbab-4abe-8be9-93fc7b0057f4 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:49.663940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-7c416937-dbab-4abe-8be9-93fc7b0057f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:49.783133 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 183/362] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:49.785189 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c416937-dbab-4abe-8be9-93fc7b0057f4 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:49.799621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905e0e9-e212-4d07-8f14-22b91bf140b8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:49.835084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:49.841825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:49.856962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b628c7-04eb-4764-b54b-2c5985bd3b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:49.858404 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b628c7-04eb-4764-b54b-2c5985bd3b9f None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:49.858689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b628c7-04eb-4764-b54b-2c5985bd3b9f None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:49.858966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b628c7-04eb-4764-b54b-2c5985bd3b9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:49.859779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b628c7-04eb-4764-b54b-2c5985bd3b9f None admin] RBAC: Adding query filter params (role.id=2838dfaf550b4ad68846863e49c6a7ae, user.id=52231cb558c24ba2ae5841c14b573c9d, scope.system=all) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:49.860093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b628c7-04eb-4764-b54b-2c5985bd3b9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:49.864555 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b628c7-04eb-4764-b54b-2c5985bd3b9f None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:49.885637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 180/363] 10.222.0.43 () {56 vars in 1308 bytes} [Wed Jul 27 10:35:49 2022] GET /identity/v3/role_assignments?user.id=52231cb558c24ba2ae5841c14b573c9d&scope.system=all&role.id=2838dfaf550b4ad68846863e49c6a7ae => generated 510 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:49.885637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b628c7-04eb-4764-b54b-2c5985bd3b9f None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:49.954648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c416937-dbab-4abe-8be9-93fc7b0057f4 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:50.002880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba74f49-bc3b-441c-9de3-14a7b91caf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:50.004001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba74f49-bc3b-441c-9de3-14a7b91caf08 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:50.004001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba74f49-bc3b-441c-9de3-14a7b91caf08 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:50.004210 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba74f49-bc3b-441c-9de3-14a7b91caf08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:50.019573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba74f49-bc3b-441c-9de3-14a7b91caf08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-8ba74f49-bc3b-441c-9de3-14a7b91caf08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:50.024543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:50.025709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:50.026712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:50.026712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:50.026712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:50.026712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:50.026712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:50.026712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:50.026712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:50.026712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:50.026712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:50.026712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:50.026712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:50.026712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:50.026712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 184/364] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:35:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:50.026712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba74f49-bc3b-441c-9de3-14a7b91caf08 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:50.038983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b628c7-04eb-4764-b54b-2c5985bd3b9f None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:50.090322 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d55dca-3e59-4b87-a34a-468759d46242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:50.092032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d55dca-3e59-4b87-a34a-468759d46242 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:50.092485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d55dca-3e59-4b87-a34a-468759d46242 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:50.092913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d55dca-3e59-4b87-a34a-468759d46242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:50.168203 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:50.168726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:50.194852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba74f49-bc3b-441c-9de3-14a7b91caf08 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:50.203834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d55dca-3e59-4b87-a34a-468759d46242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:50.206588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d55dca-3e59-4b87-a34a-468759d46242 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:50.244787 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9146b-9444-4e86-96fd-d9e1d76f99bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:50.245590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9146b-9444-4e86-96fd-d9e1d76f99bf None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:50.245874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9146b-9444-4e86-96fd-d9e1d76f99bf None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:50.246567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9146b-9444-4e86-96fd-d9e1d76f99bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:50.247387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9146b-9444-4e86-96fd-d9e1d76f99bf None admin] RBAC: Adding query filter params (group.id=94e958c60dff4b998bd2060f7b69f84b, role.id=fcaec44122534716b69d5e7f05160915, scope.project.id=c42f8c638d1645be870a7efafeb6b2ac) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:50.247697 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9146b-9444-4e86-96fd-d9e1d76f99bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:50.249147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9146b-9444-4e86-96fd-d9e1d76f99bf None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:50.256141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 185/365] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jul 27 10:35:50 2022] GET /identity/v3/role_assignments?group.id=94e958c60dff4b998bd2060f7b69f84b&scope.project.id=c42f8c638d1645be870a7efafeb6b2ac&role.id=fcaec44122534716b69d5e7f05160915 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:50.257841 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9146b-9444-4e86-96fd-d9e1d76f99bf None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:50.405773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 181/366] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:50.407768 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d55dca-3e59-4b87-a34a-468759d46242 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:50.474717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9146b-9444-4e86-96fd-d9e1d76f99bf None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:50.529982 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a6198-fe8b-4f33-83de-4655441cad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:50.530727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6198-fe8b-4f33-83de-4655441cad14 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:50.531009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6198-fe8b-4f33-83de-4655441cad14 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:50.531290 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6198-fe8b-4f33-83de-4655441cad14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:50.546527 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a6198-fe8b-4f33-83de-4655441cad14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-785a6198-fe8b-4f33-83de-4655441cad14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:50.553002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:50.554757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:50.556294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:50.556294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:50.556294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:50.556294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:50.556294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:50.556294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:50.556294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:50.556294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:50.556294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:50.556294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:50.556294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:50.556294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:50.556294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 186/367] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:35:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:50.556294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a6198-fe8b-4f33-83de-4655441cad14 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:50.566938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:50.575166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:50.600606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d55dca-3e59-4b87-a34a-468759d46242 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:50.652711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0d7ed-ba75-48e6-8f01-6b99f6991183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:50.653735 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0d7ed-ba75-48e6-8f01-6b99f6991183 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:50.654159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0d7ed-ba75-48e6-8f01-6b99f6991183 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:50.654625 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0d7ed-ba75-48e6-8f01-6b99f6991183 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:50.655529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0d7ed-ba75-48e6-8f01-6b99f6991183 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:50.656198 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0d7ed-ba75-48e6-8f01-6b99f6991183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:50.659855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0d7ed-ba75-48e6-8f01-6b99f6991183 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:50.670819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 182/368] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:35:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:50.671913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0d7ed-ba75-48e6-8f01-6b99f6991183 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:50.713989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a6198-fe8b-4f33-83de-4655441cad14 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:50.761312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75596ca3-31e0-48fe-9aad-47ddfa91f84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:50.762808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596ca3-31e0-48fe-9aad-47ddfa91f84e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:50.763207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596ca3-31e0-48fe-9aad-47ddfa91f84e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:50.763589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596ca3-31e0-48fe-9aad-47ddfa91f84e None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:50.765204 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75596ca3-31e0-48fe-9aad-47ddfa91f84e None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:50.770588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75596ca3-31e0-48fe-9aad-47ddfa91f84e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:50.770588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 187/369] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:50 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:50.771089 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75596ca3-31e0-48fe-9aad-47ddfa91f84e None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:50.812715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0d7ed-ba75-48e6-8f01-6b99f6991183 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:50.855178 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252d610-0e58-4f32-b71a-22c90cfee45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:50.856055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252d610-0e58-4f32-b71a-22c90cfee45c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:50.856503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252d610-0e58-4f32-b71a-22c90cfee45c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:50.856918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252d610-0e58-4f32-b71a-22c90cfee45c None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:50.857869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252d610-0e58-4f32-b71a-22c90cfee45c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:50.858359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252d610-0e58-4f32-b71a-22c90cfee45c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:50.859976 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252d610-0e58-4f32-b71a-22c90cfee45c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:50.885092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 183/370] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:50.885978 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252d610-0e58-4f32-b71a-22c90cfee45c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:50.886313 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:50.896742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:50.918277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75596ca3-31e0-48fe-9aad-47ddfa91f84e None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:50.983881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e53526-979e-4967-b54f-5add4dd5b277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:50.984883 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e53526-979e-4967-b54f-5add4dd5b277 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:50.985399 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e53526-979e-4967-b54f-5add4dd5b277 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:50.985877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e53526-979e-4967-b54f-5add4dd5b277 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:51.082870 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e53526-979e-4967-b54f-5add4dd5b277 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:51.084712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e53526-979e-4967-b54f-5add4dd5b277 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:51.084829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252d610-0e58-4f32-b71a-22c90cfee45c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:51.145487 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460843f-ac79-456f-84e9-0a8341c515e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:51.146593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460843f-ac79-456f-84e9-0a8341c515e6 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:51.147083 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460843f-ac79-456f-84e9-0a8341c515e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:51.147554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460843f-ac79-456f-84e9-0a8341c515e6 None admin] PATH_INFO: `/v3/groups/94e958c60dff4b998bd2060f7b69f84b` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:51.149237 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460843f-ac79-456f-84e9-0a8341c515e6 None admin] RBAC: Authorizing `identity:get_group(group_id=94e958c60dff4b998bd2060f7b69f84b)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:51.151570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460843f-ac79-456f-84e9-0a8341c515e6 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:51.153614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 184/371] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:35:50 2022] GET /identity/v3/groups/94e958c60dff4b998bd2060f7b69f84b => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:51.154783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460843f-ac79-456f-84e9-0a8341c515e6 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:51.204480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:51.232392 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 188/372] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:51.233596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e53526-979e-4967-b54f-5add4dd5b277 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:51.259292 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:51.295328 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460843f-ac79-456f-84e9-0a8341c515e6 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:51.335944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc4f24-0def-4e53-b5fb-cfac185aee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:51.337024 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc4f24-0def-4e53-b5fb-cfac185aee43 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:51.337253 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc4f24-0def-4e53-b5fb-cfac185aee43 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:51.337537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc4f24-0def-4e53-b5fb-cfac185aee43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:51.355240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e53526-979e-4967-b54f-5add4dd5b277 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:51.395989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf55be-a498-41de-874a-dea454138f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:51.396974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf55be-a498-41de-874a-dea454138f19 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:51.397457 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf55be-a498-41de-874a-dea454138f19 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:51.397953 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf55be-a498-41de-874a-dea454138f19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:51.399048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf55be-a498-41de-874a-dea454138f19 None admin] RBAC: Adding query filter params (group.id=94e958c60dff4b998bd2060f7b69f84b, role.id=eef1174229014437a0db0fd8954bc25e, scope.project.id=e80ed515f9014a95b587cb8122d54787) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:51.399573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf55be-a498-41de-874a-dea454138f19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:51.401223 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf55be-a498-41de-874a-dea454138f19 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:51.407586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 189/373] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jul 27 10:35:51 2022] GET /identity/v3/role_assignments?group.id=94e958c60dff4b998bd2060f7b69f84b&scope.project.id=e80ed515f9014a95b587cb8122d54787&role.id=eef1174229014437a0db0fd8954bc25e => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:51.409355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf55be-a498-41de-874a-dea454138f19 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:51.428443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc4f24-0def-4e53-b5fb-cfac185aee43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:51.429944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc4f24-0def-4e53-b5fb-cfac185aee43 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:51.461159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:51.531661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf55be-a498-41de-874a-dea454138f19 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:51.575616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768021f-8bed-480d-bf1d-b4125621eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:51.576639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768021f-8bed-480d-bf1d-b4125621eefe None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:51.577162 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768021f-8bed-480d-bf1d-b4125621eefe None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:51.577548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768021f-8bed-480d-bf1d-b4125621eefe None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:51.580474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768021f-8bed-480d-bf1d-b4125621eefe None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:51.581982 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768021f-8bed-480d-bf1d-b4125621eefe None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:51.584130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 190/374] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:51 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:51.590377 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768021f-8bed-480d-bf1d-b4125621eefe None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:51.619597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:51.727629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768021f-8bed-480d-bf1d-b4125621eefe None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:51.735571 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 185/375] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:51.739806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1526cb3-194c-4b6b-966e-479cb6d38768 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:51.740142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1526cb3-194c-4b6b-966e-479cb6d38768 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:51.740371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1526cb3-194c-4b6b-966e-479cb6d38768 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:51.742480 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 186/376] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:51.743566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1526cb3-194c-4b6b-966e-479cb6d38768 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:51.746010 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:51.782583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125a6de-34e5-4b2f-9583-0665eb69ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:51.783273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125a6de-34e5-4b2f-9583-0665eb69ac51 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:51.783553 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125a6de-34e5-4b2f-9583-0665eb69ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:51.783828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125a6de-34e5-4b2f-9583-0665eb69ac51 None admin] PATH_INFO: `/v3/groups/94e958c60dff4b998bd2060f7b69f84b` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:51.785087 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125a6de-34e5-4b2f-9583-0665eb69ac51 None admin] RBAC: Authorizing `identity:get_group(group_id=94e958c60dff4b998bd2060f7b69f84b)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:51.786616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125a6de-34e5-4b2f-9583-0665eb69ac51 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:51.788586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 191/377] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:35:51 2022] GET /identity/v3/groups/94e958c60dff4b998bd2060f7b69f84b => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:51.789792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b1a9-89db-4963-9860-55808593d091 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:51.790082 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b1a9-89db-4963-9860-55808593d091 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:51.790391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172b1a9-89db-4963-9860-55808593d091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:51.816207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-5172b1a9-89db-4963-9860-55808593d091 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:51.818019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5172b1a9-89db-4963-9860-55808593d091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:51.890555 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1526cb3-194c-4b6b-966e-479cb6d38768 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:51.909315 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 192/378] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:51.911189 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172b1a9-89db-4963-9860-55808593d091 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:51.962864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc34fac-2082-4765-bf84-b96b0b528d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:51.963608 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc34fac-2082-4765-bf84-b96b0b528d11 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:51.963892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc34fac-2082-4765-bf84-b96b0b528d11 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:51.964236 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc34fac-2082-4765-bf84-b96b0b528d11 None admin] PATH_INFO: `/v3/projects/4c0fb163aada45c0be9fae56f3795bdd` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:51.966032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc34fac-2082-4765-bf84-b96b0b528d11 None admin] RBAC: Authorizing `identity:get_project(project_id=4c0fb163aada45c0be9fae56f3795bdd)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:51.967242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc34fac-2082-4765-bf84-b96b0b528d11 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:51.970518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 187/379] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:51 2022] GET /identity/v3/projects/4c0fb163aada45c0be9fae56f3795bdd => generated 344 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:51.971942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc34fac-2082-4765-bf84-b96b0b528d11 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:52.035593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:52.060810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172b1a9-89db-4963-9860-55808593d091 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:52.073736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:52.106130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe821246-3a42-4ba5-b1dd-41087bbfbbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:52.107174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe821246-3a42-4ba5-b1dd-41087bbfbbdb None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:52.107652 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe821246-3a42-4ba5-b1dd-41087bbfbbdb None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:52.108171 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe821246-3a42-4ba5-b1dd-41087bbfbbdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:52.109189 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe821246-3a42-4ba5-b1dd-41087bbfbbdb None admin] RBAC: Adding query filter params (group.id=94e958c60dff4b998bd2060f7b69f84b, role.id=fcaec44122534716b69d5e7f05160915, scope.project.id=e80ed515f9014a95b587cb8122d54787) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:52.109732 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe821246-3a42-4ba5-b1dd-41087bbfbbdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:52.111740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe821246-3a42-4ba5-b1dd-41087bbfbbdb None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:52.118786 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 193/380] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jul 27 10:35:51 2022] GET /identity/v3/role_assignments?group.id=94e958c60dff4b998bd2060f7b69f84b&scope.project.id=e80ed515f9014a95b587cb8122d54787&role.id=fcaec44122534716b69d5e7f05160915 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:52.120007 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe821246-3a42-4ba5-b1dd-41087bbfbbdb None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:52.131867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc34fac-2082-4765-bf84-b96b0b528d11 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:52.200763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4038950-b82f-48e5-875b-18de09aa92a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:52.201455 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4038950-b82f-48e5-875b-18de09aa92a1 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:52.201741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4038950-b82f-48e5-875b-18de09aa92a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:52.202010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4038950-b82f-48e5-875b-18de09aa92a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:52.219271 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4038950-b82f-48e5-875b-18de09aa92a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-d4038950-b82f-48e5-875b-18de09aa92a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:52.227077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:52.228029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:52.228825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:52.228825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:52.228825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:52.228825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:52.228825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:52.228825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:52.228825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:52.228825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:52.228825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:52.228825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:52.228825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:52.228825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:52.228825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 188/381] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:52.237239 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4038950-b82f-48e5-875b-18de09aa92a1 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:52.312750 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe821246-3a42-4ba5-b1dd-41087bbfbbdb None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:52.366245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be108b6-f9b0-4c46-97d5-cfd8ebda0d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:52.367464 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be108b6-f9b0-4c46-97d5-cfd8ebda0d56 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:52.367918 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be108b6-f9b0-4c46-97d5-cfd8ebda0d56 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:52.368357 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be108b6-f9b0-4c46-97d5-cfd8ebda0d56 None admin] PATH_INFO: `/v3/groups/f14715c16f104cc1a68ab92390923729` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:52.376343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be108b6-f9b0-4c46-97d5-cfd8ebda0d56 None admin] RBAC: Authorizing `identity:get_group(group_id=f14715c16f104cc1a68ab92390923729)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:52.379757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be108b6-f9b0-4c46-97d5-cfd8ebda0d56 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:52.382418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 194/382] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:35:52 2022] GET /identity/v3/groups/f14715c16f104cc1a68ab92390923729 => generated 229 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:52.388046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be108b6-f9b0-4c46-97d5-cfd8ebda0d56 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:52.403984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:52.409781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4038950-b82f-48e5-875b-18de09aa92a1 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:52.456593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:52.486962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1b664-8f8e-4055-b5af-dc822a6ca319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:52.487609 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1b664-8f8e-4055-b5af-dc822a6ca319 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:52.487905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1b664-8f8e-4055-b5af-dc822a6ca319 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:52.488191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1b664-8f8e-4055-b5af-dc822a6ca319 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:52.488964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1b664-8f8e-4055-b5af-dc822a6ca319 None admin] RBAC: Adding query filter params (name=member) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:52.489242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1b664-8f8e-4055-b5af-dc822a6ca319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:52.490726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1b664-8f8e-4055-b5af-dc822a6ca319 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:52.506279 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 189/383] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:52.514343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1b664-8f8e-4055-b5af-dc822a6ca319 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:52.612610 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be108b6-f9b0-4c46-97d5-cfd8ebda0d56 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:52.652631 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1b664-8f8e-4055-b5af-dc822a6ca319 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:52.697993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef8051-f023-41eb-8b3a-480029b270e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:52.698672 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8051-f023-41eb-8b3a-480029b270e6 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:52.698951 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8051-f023-41eb-8b3a-480029b270e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:52.699226 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef8051-f023-41eb-8b3a-480029b270e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:52.700053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef8051-f023-41eb-8b3a-480029b270e6 None admin] RBAC: Adding query filter params (group.id=f14715c16f104cc1a68ab92390923729, role.id=36208a24005e4ff98d827138292bea37, scope.project.id=4c0fb163aada45c0be9fae56f3795bdd) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:52.700364 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef8051-f023-41eb-8b3a-480029b270e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:52.701875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef8051-f023-41eb-8b3a-480029b270e6 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:52.707357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ceb36-19c5-4d9b-adaa-437d686db586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:52.708034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ceb36-19c5-4d9b-adaa-437d686db586 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:52.708317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ceb36-19c5-4d9b-adaa-437d686db586 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:52.708594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ceb36-19c5-4d9b-adaa-437d686db586 None admin] PATH_INFO: `/v3/groups/94e958c60dff4b998bd2060f7b69f84b` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:52.711853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ceb36-19c5-4d9b-adaa-437d686db586 None admin] RBAC: Authorizing `identity:get_group(group_id=94e958c60dff4b998bd2060f7b69f84b)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:52.713330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ceb36-19c5-4d9b-adaa-437d686db586 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:52.718637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 190/384] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:35:52 2022] GET /identity/v3/groups/94e958c60dff4b998bd2060f7b69f84b => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:52.718946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 195/385] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jul 27 10:35:52 2022] GET /identity/v3/role_assignments?group.id=f14715c16f104cc1a68ab92390923729&scope.project.id=4c0fb163aada45c0be9fae56f3795bdd&role.id=36208a24005e4ff98d827138292bea37 => generated 260 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:52.721600 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ceb36-19c5-4d9b-adaa-437d686db586 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:52.770361 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:52.822761 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cb231-961e-455a-9f00-0b42292b89aa None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:52.823125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cb231-961e-455a-9f00-0b42292b89aa None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:52.823356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cb231-961e-455a-9f00-0b42292b89aa None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:52.825964 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 196/386] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:35:52.833641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600cb1b-7e48-4ae7-8ddf-2e43d5a466bf None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:52.833935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600cb1b-7e48-4ae7-8ddf-2e43d5a466bf None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:52.834217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600cb1b-7e48-4ae7-8ddf-2e43d5a466bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:52.860958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-a600cb1b-7e48-4ae7-8ddf-2e43d5a466bf None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:52.862348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a600cb1b-7e48-4ae7-8ddf-2e43d5a466bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:52.873394 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ceb36-19c5-4d9b-adaa-437d686db586 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:52.957063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff815b54-8dec-48c8-a75c-0196b6bb278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:52.957853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff815b54-8dec-48c8-a75c-0196b6bb278d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:52.958132 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff815b54-8dec-48c8-a75c-0196b6bb278d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:52.958474 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff815b54-8dec-48c8-a75c-0196b6bb278d None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:52.964725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff815b54-8dec-48c8-a75c-0196b6bb278d None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:52.967135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff815b54-8dec-48c8-a75c-0196b6bb278d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:52.971229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 191/387] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:52 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:52.979673 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff815b54-8dec-48c8-a75c-0196b6bb278d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:53.023966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 197/388] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:53.060762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600cb1b-7e48-4ae7-8ddf-2e43d5a466bf None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:53.102881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:53.197530 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600cb1b-7e48-4ae7-8ddf-2e43d5a466bf None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:53.212852 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:53.224496 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff815b54-8dec-48c8-a75c-0196b6bb278d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:53.249397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39ee34-1e16-4570-88bd-7f11cf68f77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:53.250067 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39ee34-1e16-4570-88bd-7f11cf68f77a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:53.250376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39ee34-1e16-4570-88bd-7f11cf68f77a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:53.250655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39ee34-1e16-4570-88bd-7f11cf68f77a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:53.269503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39ee34-1e16-4570-88bd-7f11cf68f77a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-dd39ee34-1e16-4570-88bd-7f11cf68f77a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:53.276019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:53.277977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:53.279500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:53.279500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:53.279500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:53.279500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:53.279500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:53.279500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:53.279500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:53.279500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:53.279500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:53.279500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:53.279500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:53.279500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:53.279500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 198/389] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:35:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:35:53.284990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39ee34-1e16-4570-88bd-7f11cf68f77a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:53.330421 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c320c-5ad6-407c-8457-edbf2efbde09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:53.331792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c320c-5ad6-407c-8457-edbf2efbde09 None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:53.332289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c320c-5ad6-407c-8457-edbf2efbde09 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:53.332772 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c320c-5ad6-407c-8457-edbf2efbde09 None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac/groups/94e958c60dff4b998bd2060f7b69f84b/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:53.335383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c320c-5ad6-407c-8457-edbf2efbde09 None admin] RBAC: Authorizing `identity:create_grant(project_id=c42f8c638d1645be870a7efafeb6b2ac, group_id=94e958c60dff4b998bd2060f7b69f84b, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:53.346214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c320c-5ad6-407c-8457-edbf2efbde09 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:53.383715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 192/390] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Jul 27 10:35:52 2022] PUT /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac/groups/94e958c60dff4b998bd2060f7b69f84b/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:35:53.405743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:53.419878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39ee34-1e16-4570-88bd-7f11cf68f77a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:53.461203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46885ab0-3ca1-4a79-84d3-dbd95b892df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:53.461746 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46885ab0-3ca1-4a79-84d3-dbd95b892df7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:53.462101 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46885ab0-3ca1-4a79-84d3-dbd95b892df7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:53.462405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46885ab0-3ca1-4a79-84d3-dbd95b892df7 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:53.463246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46885ab0-3ca1-4a79-84d3-dbd95b892df7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:53.463558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46885ab0-3ca1-4a79-84d3-dbd95b892df7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:53.465099 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46885ab0-3ca1-4a79-84d3-dbd95b892df7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:53.476725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 199/391] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:35:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:53.482886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c320c-5ad6-407c-8457-edbf2efbde09 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:53.605852 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c320c-5ad6-407c-8457-edbf2efbde09 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:53.647882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c5c75-17f9-4f74-9bac-84d79b4c60c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:53.648561 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5c75-17f9-4f74-9bac-84d79b4c60c1 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:53.648848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5c75-17f9-4f74-9bac-84d79b4c60c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:53.649124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5c75-17f9-4f74-9bac-84d79b4c60c1 None admin] PATH_INFO: `/v3/groups/94e958c60dff4b998bd2060f7b69f84b` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:53.650590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c5c75-17f9-4f74-9bac-84d79b4c60c1 None admin] RBAC: Authorizing `identity:get_group(group_id=94e958c60dff4b998bd2060f7b69f84b)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:53.652205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c5c75-17f9-4f74-9bac-84d79b4c60c1 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:53.653968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 193/392] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:35:53 2022] GET /identity/v3/groups/94e958c60dff4b998bd2060f7b69f84b => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:53.660300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46885ab0-3ca1-4a79-84d3-dbd95b892df7 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:53.811231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46885ab0-3ca1-4a79-84d3-dbd95b892df7 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:53.883642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dafe61-03ef-4534-82c4-dff8317748d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:53.884771 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dafe61-03ef-4534-82c4-dff8317748d7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:53.885376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dafe61-03ef-4534-82c4-dff8317748d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:53.885943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dafe61-03ef-4534-82c4-dff8317748d7 None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:53.891440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dafe61-03ef-4534-82c4-dff8317748d7 None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:53.893196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dafe61-03ef-4534-82c4-dff8317748d7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:53.896614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 200/393] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:53 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:53.903005 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c5c75-17f9-4f74-9bac-84d79b4c60c1 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:53.942095 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:54.045391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c5c75-17f9-4f74-9bac-84d79b4c60c1 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:54.092725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3304e61-e70d-4925-bb92-35bf4f668337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:54.093388 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304e61-e70d-4925-bb92-35bf4f668337 None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:54.093707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304e61-e70d-4925-bb92-35bf4f668337 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:54.093983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304e61-e70d-4925-bb92-35bf4f668337 None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac/groups/94e958c60dff4b998bd2060f7b69f84b/roles/fcaec44122534716b69d5e7f05160915` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:54.096348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3304e61-e70d-4925-bb92-35bf4f668337 None admin] RBAC: Authorizing `identity:create_grant(project_id=c42f8c638d1645be870a7efafeb6b2ac, group_id=94e958c60dff4b998bd2060f7b69f84b, role_id=fcaec44122534716b69d5e7f05160915)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:54.097802 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3304e61-e70d-4925-bb92-35bf4f668337 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:54.117343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 194/394] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Jul 27 10:35:53 2022] PUT /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac/groups/94e958c60dff4b998bd2060f7b69f84b/roles/fcaec44122534716b69d5e7f05160915 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:35:54.524746 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4cf8e-636d-409c-898b-751187aa9ab4 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:54.525442 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4cf8e-636d-409c-898b-751187aa9ab4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:54.525442 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4cf8e-636d-409c-898b-751187aa9ab4 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:54.526980 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 201/395] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:54.533360 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852ebd1-30f5-488e-adec-800ab0db4842 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:54.533989 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852ebd1-30f5-488e-adec-800ab0db4842 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:54.534503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852ebd1-30f5-488e-adec-800ab0db4842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:54.559959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-7852ebd1-30f5-488e-adec-800ab0db4842 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:54.561570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7852ebd1-30f5-488e-adec-800ab0db4842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:54.641543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 195/396] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:54.664563 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4cf8e-636d-409c-898b-751187aa9ab4 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:54.719422 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:54.844973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df8ca3-bee3-4eb8-8f50-29fae1594090 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:54.846024 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df8ca3-bee3-4eb8-8f50-29fae1594090 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:54.846849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df8ca3-bee3-4eb8-8f50-29fae1594090 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:54.858885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 196/397] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:54 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:35:54.865798 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89074f-276e-4ea1-9142-a8d3c6c5d708 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:54.866746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89074f-276e-4ea1-9142-a8d3c6c5d708 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:54.867535 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89074f-276e-4ea1-9142-a8d3c6c5d708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:54.887237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4cf8e-636d-409c-898b-751187aa9ab4 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:54.919967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-0c89074f-276e-4ea1-9142-a8d3c6c5d708 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:54.922003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0c89074f-276e-4ea1-9142-a8d3c6c5d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:54.955206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:54.980057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2bb4f-aebc-4394-95ec-4c26eac9266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:54.981012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2bb4f-aebc-4394-95ec-4c26eac9266d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:54.981302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2bb4f-aebc-4394-95ec-4c26eac9266d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:54.981580 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2bb4f-aebc-4394-95ec-4c26eac9266d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:55.007978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2bb4f-aebc-4394-95ec-4c26eac9266d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-24e2bb4f-aebc-4394-95ec-4c26eac9266d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:55.013663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:55.014645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:55.015459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:55.015459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:55.015459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:55.015459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:55.015459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:55.015459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:55.015459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:55.015459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:55.015459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:55.015459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:55.015459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:55.015459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:35:55.025117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 202/398] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:35:55.026084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2bb4f-aebc-4394-95ec-4c26eac9266d None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:55.086511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 197/399] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:35:55.107481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89074f-276e-4ea1-9142-a8d3c6c5d708 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:55.229720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:55.253516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2bb4f-aebc-4394-95ec-4c26eac9266d None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:55.316922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89074f-276e-4ea1-9142-a8d3c6c5d708 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:55.333041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139a15c-5e12-478c-99a8-cb33052cae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:55.333691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139a15c-5e12-478c-99a8-cb33052cae84 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:55.333978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139a15c-5e12-478c-99a8-cb33052cae84 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:55.334311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139a15c-5e12-478c-99a8-cb33052cae84 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:55.335073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139a15c-5e12-478c-99a8-cb33052cae84 None admin] RBAC: Adding query filter params (name=member) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:55.335383 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139a15c-5e12-478c-99a8-cb33052cae84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:55.336819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139a15c-5e12-478c-99a8-cb33052cae84 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:55.357448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 203/400] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:55.365880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139a15c-5e12-478c-99a8-cb33052cae84 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:55.410655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f13b3-b92a-4398-a9f8-3790ea8645d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:55.411338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f13b3-b92a-4398-a9f8-3790ea8645d6 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:55.411624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f13b3-b92a-4398-a9f8-3790ea8645d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:55.411900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f13b3-b92a-4398-a9f8-3790ea8645d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:55.436426 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f13b3-b92a-4398-a9f8-3790ea8645d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-046f13b3-b92a-4398-a9f8-3790ea8645d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:55.441756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:55.442777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:55.444027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:55.444027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:55.444027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:55.444027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:55.444027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:55.444027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:55.444027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:55.444027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:55.444027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:55.444027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:55.444027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:55.444027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:55.444027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 198/401] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:35:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:55.456033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f13b3-b92a-4398-a9f8-3790ea8645d6 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:55.476593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:55.609054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139a15c-5e12-478c-99a8-cb33052cae84 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:55.650638 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98099717-94db-42ce-812b-82012163a27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:55.651541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099717-94db-42ce-812b-82012163a27a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:55.652092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099717-94db-42ce-812b-82012163a27a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:55.652513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099717-94db-42ce-812b-82012163a27a None admin] PATH_INFO: `/v3/groups/94e958c60dff4b998bd2060f7b69f84b` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:55.653981 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98099717-94db-42ce-812b-82012163a27a None admin] RBAC: Authorizing `identity:get_group(group_id=94e958c60dff4b998bd2060f7b69f84b)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:55.655687 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98099717-94db-42ce-812b-82012163a27a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:55.659562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 204/402] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:35:55 2022] GET /identity/v3/groups/94e958c60dff4b998bd2060f7b69f84b => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:55.668436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98099717-94db-42ce-812b-82012163a27a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:55.698583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:55.732865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f13b3-b92a-4398-a9f8-3790ea8645d6 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:55.801441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011ce68-76d2-422c-be60-c950bb8fbd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:55.802838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ce68-76d2-422c-be60-c950bb8fbd9a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:55.803575 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ce68-76d2-422c-be60-c950bb8fbd9a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:55.804264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ce68-76d2-422c-be60-c950bb8fbd9a None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:55.805880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011ce68-76d2-422c-be60-c950bb8fbd9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:55.806659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011ce68-76d2-422c-be60-c950bb8fbd9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:55.808645 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011ce68-76d2-422c-be60-c950bb8fbd9a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:55.821593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 199/403] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:35:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:55.823316 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882c94-aad2-40d8-a0d7-15fc6c4b2256 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:55.823761 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882c94-aad2-40d8-a0d7-15fc6c4b2256 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:55.824084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98099717-94db-42ce-812b-82012163a27a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:55.824346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc882c94-aad2-40d8-a0d7-15fc6c4b2256 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:55.826470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 200/404] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:55.827629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc882c94-aad2-40d8-a0d7-15fc6c4b2256 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:55.862647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8998936-2ae7-45c8-b5d7-14385185bbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:55.863297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8998936-2ae7-45c8-b5d7-14385185bbdc None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:55.863587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8998936-2ae7-45c8-b5d7-14385185bbdc None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:55.863866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8998936-2ae7-45c8-b5d7-14385185bbdc None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:55.865126 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8998936-2ae7-45c8-b5d7-14385185bbdc None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:55.866759 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8998936-2ae7-45c8-b5d7-14385185bbdc None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:55.873285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 205/405] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:55 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:55.873285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f7128-53d0-4780-955b-3efbedfe7600 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:55.873285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f7128-53d0-4780-955b-3efbedfe7600 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:55.873285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f7128-53d0-4780-955b-3efbedfe7600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:55.890776 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-676f7128-53d0-4780-955b-3efbedfe7600 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:55.892564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-676f7128-53d0-4780-955b-3efbedfe7600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:55.917520 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:55.981725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc882c94-aad2-40d8-a0d7-15fc6c4b2256 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:55.988360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 206/406] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:55.989674 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f7128-53d0-4780-955b-3efbedfe7600 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:56.003112 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:56.066170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5a7fd-0036-4540-ac0b-807e6c29c3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:56.067512 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5a7fd-0036-4540-ac0b-807e6c29c3ef None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:56.068018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5a7fd-0036-4540-ac0b-807e6c29c3ef None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:56.068522 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5a7fd-0036-4540-ac0b-807e6c29c3ef None admin] PATH_INFO: `/v3/groups/94e958c60dff4b998bd2060f7b69f84b` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:56.070924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5a7fd-0036-4540-ac0b-807e6c29c3ef None admin] RBAC: Authorizing `identity:get_group(group_id=94e958c60dff4b998bd2060f7b69f84b)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:56.074045 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5a7fd-0036-4540-ac0b-807e6c29c3ef None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:56.078072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 201/407] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:35:55 2022] GET /identity/v3/groups/94e958c60dff4b998bd2060f7b69f84b => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:56.081181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5a7fd-0036-4540-ac0b-807e6c29c3ef None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:56.131431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f7128-53d0-4780-955b-3efbedfe7600 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:56.174013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b30a1-e37f-441d-a617-48850ff0991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:56.175012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b30a1-e37f-441d-a617-48850ff0991c None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:56.175443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b30a1-e37f-441d-a617-48850ff0991c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:56.175895 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b30a1-e37f-441d-a617-48850ff0991c None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787/groups/94e958c60dff4b998bd2060f7b69f84b/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:56.178904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b30a1-e37f-441d-a617-48850ff0991c None admin] RBAC: Authorizing `identity:create_grant(project_id=e80ed515f9014a95b587cb8122d54787, group_id=94e958c60dff4b998bd2060f7b69f84b, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:56.180926 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b30a1-e37f-441d-a617-48850ff0991c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:56.213578 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 207/408] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Jul 27 10:35:55 2022] PUT /identity/v3/projects/e80ed515f9014a95b587cb8122d54787/groups/94e958c60dff4b998bd2060f7b69f84b/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:35:56.215362 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b30a1-e37f-441d-a617-48850ff0991c None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:56.290426 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5a7fd-0036-4540-ac0b-807e6c29c3ef None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:56.343637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f0561-2c08-45f0-94c8-7a86af998f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:56.344814 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f0561-2c08-45f0-94c8-7a86af998f05 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:56.345766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f0561-2c08-45f0-94c8-7a86af998f05 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:56.346160 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f0561-2c08-45f0-94c8-7a86af998f05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:56.351008 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:56.353697 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:56.366518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f0561-2c08-45f0-94c8-7a86af998f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-386f0561-2c08-45f0-94c8-7a86af998f05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:56.374712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:56.375713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:56.376617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:56.376617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:56.376617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:56.376617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:56.376617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:56.376617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:56.376617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:56.376617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:56.376617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:56.376617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:56.376617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:35:56.376617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:56.377940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 202/409] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:35:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:56.381204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59e872-8361-4101-a19b-29c5605c25d9 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:56.381661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59e872-8361-4101-a19b-29c5605c25d9 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:56.382119 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59e872-8361-4101-a19b-29c5605c25d9 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:56.391226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 203/410] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:56.391226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59e872-8361-4101-a19b-29c5605c25d9 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:56.429795 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b30a1-e37f-441d-a617-48850ff0991c None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:56.493614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f95d6-aa12-4fff-abb0-68d7c24622d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:56.494350 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f95d6-aa12-4fff-abb0-68d7c24622d9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:56.494683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f95d6-aa12-4fff-abb0-68d7c24622d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:56.494963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f95d6-aa12-4fff-abb0-68d7c24622d9 None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:56.497223 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f95d6-aa12-4fff-abb0-68d7c24622d9 None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:56.499430 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f95d6-aa12-4fff-abb0-68d7c24622d9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:56.506232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 208/411] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:56 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:56.506232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8769477-f340-4f27-9858-95db4d663e9d None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:56.506232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8769477-f340-4f27-9858-95db4d663e9d None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:56.506232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8769477-f340-4f27-9858-95db4d663e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:56.527483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e8769477-f340-4f27-9858-95db4d663e9d None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:56.528727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e8769477-f340-4f27-9858-95db4d663e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:56.545386 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59e872-8361-4101-a19b-29c5605c25d9 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:56.614859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6416b4-fd2e-4d73-a146-e9229f9f4d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:56.615833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6416b4-fd2e-4d73-a146-e9229f9f4d2b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:56.616334 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6416b4-fd2e-4d73-a146-e9229f9f4d2b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:56.616829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6416b4-fd2e-4d73-a146-e9229f9f4d2b None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:56.618250 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6416b4-fd2e-4d73-a146-e9229f9f4d2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:56.618836 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6416b4-fd2e-4d73-a146-e9229f9f4d2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:56.621141 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6416b4-fd2e-4d73-a146-e9229f9f4d2b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:56.639073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 204/412] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:56.640604 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6416b4-fd2e-4d73-a146-e9229f9f4d2b None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:56.674528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 209/413] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:56.676150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8769477-f340-4f27-9858-95db4d663e9d None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:56.781856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:56.834525 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:56.848820 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6416b4-fd2e-4d73-a146-e9229f9f4d2b None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:56.919879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8769477-f340-4f27-9858-95db4d663e9d None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:56.922021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed365a5b-9b0c-4e29-a694-54ac1a9b9034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:56.924304 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed365a5b-9b0c-4e29-a694-54ac1a9b9034 None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:56.924304 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed365a5b-9b0c-4e29-a694-54ac1a9b9034 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:56.924699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed365a5b-9b0c-4e29-a694-54ac1a9b9034 None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787/groups/94e958c60dff4b998bd2060f7b69f84b/roles/fcaec44122534716b69d5e7f05160915` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:56.928928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed365a5b-9b0c-4e29-a694-54ac1a9b9034 None admin] RBAC: Authorizing `identity:create_grant(project_id=e80ed515f9014a95b587cb8122d54787, group_id=94e958c60dff4b998bd2060f7b69f84b, role_id=fcaec44122534716b69d5e7f05160915)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:56.932272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed365a5b-9b0c-4e29-a694-54ac1a9b9034 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:56.963215 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 205/414] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Jul 27 10:35:56 2022] PUT /identity/v3/projects/e80ed515f9014a95b587cb8122d54787/groups/94e958c60dff4b998bd2060f7b69f84b/roles/fcaec44122534716b69d5e7f05160915 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:35:56.963215 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed365a5b-9b0c-4e29-a694-54ac1a9b9034 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:56.985202 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fc088-fa87-432e-80cb-871a2ab2c0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:56.986775 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc088-fa87-432e-80cb-871a2ab2c0b0 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:56.987230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc088-fa87-432e-80cb-871a2ab2c0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:56.987768 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fc088-fa87-432e-80cb-871a2ab2c0b0 None admin] PATH_INFO: `/v3/groups/f14715c16f104cc1a68ab92390923729` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:56.990372 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fc088-fa87-432e-80cb-871a2ab2c0b0 None admin] RBAC: Authorizing `identity:get_group(group_id=f14715c16f104cc1a68ab92390923729)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:56.993606 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fc088-fa87-432e-80cb-871a2ab2c0b0 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:56.997202 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 210/415] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:35:56 2022] GET /identity/v3/groups/f14715c16f104cc1a68ab92390923729 => generated 229 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:56.999772 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339c47-f2d7-48c9-b0b9-6f6f03a38fec None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:57.000417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339c47-f2d7-48c9-b0b9-6f6f03a38fec None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:57.000851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8339c47-f2d7-48c9-b0b9-6f6f03a38fec None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:57.010525 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 211/416] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:56 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:57.012181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8339c47-f2d7-48c9-b0b9-6f6f03a38fec None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:57.171047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed365a5b-9b0c-4e29-a694-54ac1a9b9034 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:57.196615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:57.200902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8339c47-f2d7-48c9-b0b9-6f6f03a38fec None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:57.227414 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cdbbf-b30c-4e7d-9a29-eb63d66c5056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:57.228367 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cdbbf-b30c-4e7d-9a29-eb63d66c5056 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:57.228874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cdbbf-b30c-4e7d-9a29-eb63d66c5056 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:57.229265 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cdbbf-b30c-4e7d-9a29-eb63d66c5056 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:57.245166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5396af-2490-40f4-8ce7-5de8604e5cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:57.246085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5396af-2490-40f4-8ce7-5de8604e5cb5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:57.246549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5396af-2490-40f4-8ce7-5de8604e5cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:57.246974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5396af-2490-40f4-8ce7-5de8604e5cb5 None admin] PATH_INFO: `/v3/projects/4c0fb163aada45c0be9fae56f3795bdd` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:57.248652 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5396af-2490-40f4-8ce7-5de8604e5cb5 None admin] RBAC: Authorizing `identity:get_project(project_id=4c0fb163aada45c0be9fae56f3795bdd)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:57.249847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cdbbf-b30c-4e7d-9a29-eb63d66c5056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:57.250700 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5396af-2490-40f4-8ce7-5de8604e5cb5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:57.253653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 212/417] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:57 2022] GET /identity/v3/projects/4c0fb163aada45c0be9fae56f3795bdd => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:57.259706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a4a71-a775-4ba4-bc16-1b72fc024f88 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:57.260435 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a4a71-a775-4ba4-bc16-1b72fc024f88 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:57.260886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a4a71-a775-4ba4-bc16-1b72fc024f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-e66cdbbf-b30c-4e7d-9a29-eb63d66c5056 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:57.268231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:57.269380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:57.270231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:57.270231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:57.270231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:57.270231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:57.270231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:57.270231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:57.270231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:57.270231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:57.270231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:57.270231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:57.270231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:57.270231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:57.270857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:57.271282 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 206/418] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:57.277997 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cdbbf-b30c-4e7d-9a29-eb63d66c5056 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:57.291935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-664a4a71-a775-4ba4-bc16-1b72fc024f88 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:57.293880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-664a4a71-a775-4ba4-bc16-1b72fc024f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:57.383485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 213/419] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:57.384627 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a4a71-a775-4ba4-bc16-1b72fc024f88 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:57.478414 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cdbbf-b30c-4e7d-9a29-eb63d66c5056 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:57.531095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a4a71-a775-4ba4-bc16-1b72fc024f88 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:57.536939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbae0b-e9d1-497b-9e65-9c67159cf3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:57.538286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbae0b-e9d1-497b-9e65-9c67159cf3b9 None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:57.538926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbae0b-e9d1-497b-9e65-9c67159cf3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:57.539549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbae0b-e9d1-497b-9e65-9c67159cf3b9 None admin] PATH_INFO: `/v3/projects/4c0fb163aada45c0be9fae56f3795bdd/groups/f14715c16f104cc1a68ab92390923729/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:57.543562 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbae0b-e9d1-497b-9e65-9c67159cf3b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c0fb163aada45c0be9fae56f3795bdd, group_id=f14715c16f104cc1a68ab92390923729, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:57.546855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbae0b-e9d1-497b-9e65-9c67159cf3b9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:57.577879 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 207/420] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Jul 27 10:35:57 2022] PUT /identity/v3/projects/4c0fb163aada45c0be9fae56f3795bdd/groups/f14715c16f104cc1a68ab92390923729/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:35:57.577879 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbae0b-e9d1-497b-9e65-9c67159cf3b9 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:57.586219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:57.594029 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd34883-977c-454e-ab86-3e182665897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:57.595045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd34883-977c-454e-ab86-3e182665897d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:57.596240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd34883-977c-454e-ab86-3e182665897d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:57.596880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd34883-977c-454e-ab86-3e182665897d None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:57.597968 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd34883-977c-454e-ab86-3e182665897d None admin] RBAC: Adding query filter params (name=member) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:57.601368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd34883-977c-454e-ab86-3e182665897d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:57.603246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd34883-977c-454e-ab86-3e182665897d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:57.619393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 214/421] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:57.625419 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd34883-977c-454e-ab86-3e182665897d None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:57.629570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:57.759026 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbae0b-e9d1-497b-9e65-9c67159cf3b9 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:57.804868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1f374-2426-4675-ac66-796a653a2d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:57.805553 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1f374-2426-4675-ac66-796a653a2d3f None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:57.805899 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1f374-2426-4675-ac66-796a653a2d3f None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:57.810214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1f374-2426-4675-ac66-796a653a2d3f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:57.826227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1f374-2426-4675-ac66-796a653a2d3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-1be1f374-2426-4675-ac66-796a653a2d3f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:57.828656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:57.830120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:57.831212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:57.831212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:57.831212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:57.831212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:57.831212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:57.831212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:57.831212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:57.831212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:57.831212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:57.831212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:57.831212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:57.831212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:57.835654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 208/422] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:35:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:57.836317 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd34883-977c-454e-ab86-3e182665897d None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:57.839344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1f374-2426-4675-ac66-796a653a2d3f None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:57.934532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927a04f-e9cf-4410-964b-4f6c82811a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:57.935180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927a04f-e9cf-4410-964b-4f6c82811a10 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:57.935464 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927a04f-e9cf-4410-964b-4f6c82811a10 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:57.935745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927a04f-e9cf-4410-964b-4f6c82811a10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:57.997610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:58.006731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1f374-2426-4675-ac66-796a653a2d3f None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:58.020316 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:58.029585 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927a04f-e9cf-4410-964b-4f6c82811a10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:58.031321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927a04f-e9cf-4410-964b-4f6c82811a10 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:58.070437 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c86ae6-935e-4faf-92f7-cad2bf766c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:58.071233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c86ae6-935e-4faf-92f7-cad2bf766c0a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:58.071529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c86ae6-935e-4faf-92f7-cad2bf766c0a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:58.071808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c86ae6-935e-4faf-92f7-cad2bf766c0a None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:58.072687 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c86ae6-935e-4faf-92f7-cad2bf766c0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:58.072996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c86ae6-935e-4faf-92f7-cad2bf766c0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:58.075612 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c86ae6-935e-4faf-92f7-cad2bf766c0a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:58.099183 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 209/423] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:35:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:58.106252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c86ae6-935e-4faf-92f7-cad2bf766c0a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:58.239372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c86ae6-935e-4faf-92f7-cad2bf766c0a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:58.285140 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afe68f-6deb-4c47-8b22-bb50eb7566bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:58.285758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afe68f-6deb-4c47-8b22-bb50eb7566bc None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:58.286041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afe68f-6deb-4c47-8b22-bb50eb7566bc None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:58.286347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afe68f-6deb-4c47-8b22-bb50eb7566bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:58.289768 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 215/424] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:58.300545 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927a04f-e9cf-4410-964b-4f6c82811a10 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:58.360294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:58.450219 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afe68f-6deb-4c47-8b22-bb50eb7566bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:58.452188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afe68f-6deb-4c47-8b22-bb50eb7566bc None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:58.455938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:58.469836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927a04f-e9cf-4410-964b-4f6c82811a10 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:58.537329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015115e-f9d8-4dd4-b60a-a01bb9e0018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:58.538288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015115e-f9d8-4dd4-b60a-a01bb9e0018b None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:58.538573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015115e-f9d8-4dd4-b60a-a01bb9e0018b None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:58.538851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015115e-f9d8-4dd4-b60a-a01bb9e0018b None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:58.540326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015115e-f9d8-4dd4-b60a-a01bb9e0018b None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:58.542340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015115e-f9d8-4dd4-b60a-a01bb9e0018b None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:58.544847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 216/425] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:58 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:58.546229 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae40c9-00d8-4e78-851e-90a79c135a50 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:58.546531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae40c9-00d8-4e78-851e-90a79c135a50 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:58.546809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae40c9-00d8-4e78-851e-90a79c135a50 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:58.552791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 217/426] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:58.554675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e32bc3-4bd9-4e71-906c-2669cf917d9a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:58.554969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e32bc3-4bd9-4e71-906c-2669cf917d9a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:58.555252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e32bc3-4bd9-4e71-906c-2669cf917d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:58.577688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-65e32bc3-4bd9-4e71-906c-2669cf917d9a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:58.578938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-65e32bc3-4bd9-4e71-906c-2669cf917d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:58.634329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 210/427] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:35:58.635945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afe68f-6deb-4c47-8b22-bb50eb7566bc None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:58.674546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 218/428] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:58.675570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e32bc3-4bd9-4e71-906c-2669cf917d9a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:58.754868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:58.804196 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afe68f-6deb-4c47-8b22-bb50eb7566bc None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:58.842679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:58.857178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e32bc3-4bd9-4e71-906c-2669cf917d9a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:58.873805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88535990-3b88-44eb-bf89-8c382f7270e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:58.875277 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88535990-3b88-44eb-bf89-8c382f7270e7 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:58.878209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88535990-3b88-44eb-bf89-8c382f7270e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:58.878955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88535990-3b88-44eb-bf89-8c382f7270e7 None admin] PATH_INFO: `/v3/groups/94e958c60dff4b998bd2060f7b69f84b` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:58.881542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88535990-3b88-44eb-bf89-8c382f7270e7 None admin] RBAC: Authorizing `identity:get_group(group_id=94e958c60dff4b998bd2060f7b69f84b)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:58.884638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88535990-3b88-44eb-bf89-8c382f7270e7 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:58.887930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 211/429] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:35:58 2022] GET /identity/v3/groups/94e958c60dff4b998bd2060f7b69f84b => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:58.894998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88535990-3b88-44eb-bf89-8c382f7270e7 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:58.911747 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463941f4-aa53-4671-93dc-9f7f393b5c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:58.915070 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463941f4-aa53-4671-93dc-9f7f393b5c1b None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:58.915878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463941f4-aa53-4671-93dc-9f7f393b5c1b None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:58.916578 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463941f4-aa53-4671-93dc-9f7f393b5c1b None admin] PATH_INFO: `/v3/projects/c42f8c638d1645be870a7efafeb6b2ac` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:58.920634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463941f4-aa53-4671-93dc-9f7f393b5c1b None admin] RBAC: Authorizing `identity:get_project(project_id=c42f8c638d1645be870a7efafeb6b2ac)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:58.922131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463941f4-aa53-4671-93dc-9f7f393b5c1b None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:58.930532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 219/430] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:35:58 2022] GET /identity/v3/projects/c42f8c638d1645be870a7efafeb6b2ac => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:58.930532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463941f4-aa53-4671-93dc-9f7f393b5c1b None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:59.055484 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88535990-3b88-44eb-bf89-8c382f7270e7 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:59.076931 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463941f4-aa53-4671-93dc-9f7f393b5c1b None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:59.094679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:59.108873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32334d-fc6a-49ab-90bb-f6d6197cdde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:59.109970 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32334d-fc6a-49ab-90bb-f6d6197cdde4 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:59.110728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32334d-fc6a-49ab-90bb-f6d6197cdde4 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:59.111369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32334d-fc6a-49ab-90bb-f6d6197cdde4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:59.127427 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df890a5e-a62e-49e9-94b0-6969ca2a3eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:59.128253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df890a5e-a62e-49e9-94b0-6969ca2a3eeb None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:59.128537 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df890a5e-a62e-49e9-94b0-6969ca2a3eeb None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:59.128816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df890a5e-a62e-49e9-94b0-6969ca2a3eeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:59.129763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32334d-fc6a-49ab-90bb-f6d6197cdde4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:59.129872 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df890a5e-a62e-49e9-94b0-6969ca2a3eeb None admin] RBAC: Adding query filter params (group.id=94e958c60dff4b998bd2060f7b69f84b, role.id=eef1174229014437a0db0fd8954bc25e, scope.project.id=c42f8c638d1645be870a7efafeb6b2ac) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:59.130086 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df890a5e-a62e-49e9-94b0-6969ca2a3eeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:59.131568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df890a5e-a62e-49e9-94b0-6969ca2a3eeb None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-cf32334d-fc6a-49ab-90bb-f6d6197cdde4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:59.137021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:59.138101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:59.139108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:59.139108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:59.139108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:59.139108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:59.139108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:59.139108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:59.139108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:59.139108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:59.139108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:59.139108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:59.139108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 10:35:59.139108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:59.142709 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 212/432] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:35:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:59.143972 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32334d-fc6a-49ab-90bb-f6d6197cdde4 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:59.144867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 220/432] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jul 27 10:35:58 2022] GET /identity/v3/role_assignments?group.id=94e958c60dff4b998bd2060f7b69f84b&scope.project.id=c42f8c638d1645be870a7efafeb6b2ac&role.id=eef1174229014437a0db0fd8954bc25e => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:59.148609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df890a5e-a62e-49e9-94b0-6969ca2a3eeb None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:59.218790 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:59.340004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32334d-fc6a-49ab-90bb-f6d6197cdde4 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:59.383950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df890a5e-a62e-49e9-94b0-6969ca2a3eeb None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:59.407546 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4752fa7-a8e7-4f93-b181-183113aa3a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:59.408825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4752fa7-a8e7-4f93-b181-183113aa3a62 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:59.409153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4752fa7-a8e7-4f93-b181-183113aa3a62 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:59.409421 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4752fa7-a8e7-4f93-b181-183113aa3a62 None admin] PATH_INFO: `/v3/groups/94e958c60dff4b998bd2060f7b69f84b` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:59.410742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4752fa7-a8e7-4f93-b181-183113aa3a62 None admin] RBAC: Authorizing `identity:get_group(group_id=94e958c60dff4b998bd2060f7b69f84b)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:59.412238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4752fa7-a8e7-4f93-b181-183113aa3a62 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:59.414096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 213/433] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:35:59 2022] GET /identity/v3/groups/94e958c60dff4b998bd2060f7b69f84b => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:59.415204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e41dc-8e4c-43c7-9527-b398d544b359 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:59.415492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e41dc-8e4c-43c7-9527-b398d544b359 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:59.420508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e41dc-8e4c-43c7-9527-b398d544b359 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:59.420508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 214/434] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:35:59.421699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e41dc-8e4c-43c7-9527-b398d544b359 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:59.446673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bb498-e41f-46d0-af45-1a6d61085503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:59.447813 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bb498-e41f-46d0-af45-1a6d61085503 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:59.448109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bb498-e41f-46d0-af45-1a6d61085503 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:59.448393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bb498-e41f-46d0-af45-1a6d61085503 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:59.449166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bb498-e41f-46d0-af45-1a6d61085503 None admin] RBAC: Adding query filter params (name=member) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:59.449479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bb498-e41f-46d0-af45-1a6d61085503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:59.451117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bb498-e41f-46d0-af45-1a6d61085503 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:59.468099 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 221/435] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:35:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:35:59.469446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b3f0-7835-4685-acbf-2c572056b045 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:59.469736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b3f0-7835-4685-acbf-2c572056b045 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:59.475471 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b3f0-7835-4685-acbf-2c572056b045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:59.499161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b4d9b3f0-7835-4685-acbf-2c572056b045 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:35:59.501827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b4d9b3f0-7835-4685-acbf-2c572056b045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:35:59.516794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:59.609134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e41dc-8e4c-43c7-9527-b398d544b359 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:59.615857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 222/436] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:35:59.616763 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9b3f0-7835-4685-acbf-2c572056b045 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:59.649097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:59.652714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598cf5c-aa76-48a4-a0b9-1f7656d80fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:59.652714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598cf5c-aa76-48a4-a0b9-1f7656d80fb0 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:59.653321 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598cf5c-aa76-48a4-a0b9-1f7656d80fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:59.653321 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598cf5c-aa76-48a4-a0b9-1f7656d80fb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:59.653999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598cf5c-aa76-48a4-a0b9-1f7656d80fb0 None admin] RBAC: Adding query filter params (group.id=94e958c60dff4b998bd2060f7b69f84b, role.id=fcaec44122534716b69d5e7f05160915, scope.project.id=c42f8c638d1645be870a7efafeb6b2ac) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:35:59.656650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598cf5c-aa76-48a4-a0b9-1f7656d80fb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:59.656917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598cf5c-aa76-48a4-a0b9-1f7656d80fb0 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:35:59.664509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 215/437] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jul 27 10:35:59 2022] GET /identity/v3/role_assignments?group.id=94e958c60dff4b998bd2060f7b69f84b&scope.project.id=c42f8c638d1645be870a7efafeb6b2ac&role.id=fcaec44122534716b69d5e7f05160915 => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:35:59.665387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598cf5c-aa76-48a4-a0b9-1f7656d80fb0 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:59.796810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9b3f0-7835-4685-acbf-2c572056b045 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:59.799694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598cf5c-aa76-48a4-a0b9-1f7656d80fb0 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:35:59.828667 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:35:59.852664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d6d99-042d-49e8-87c2-2cdaeb90fca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:59.854425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6d99-042d-49e8-87c2-2cdaeb90fca1 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:59.855025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6d99-042d-49e8-87c2-2cdaeb90fca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:59.855574 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d6d99-042d-49e8-87c2-2cdaeb90fca1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:59.862213 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fc342-6238-4156-ae5a-c643a61d322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:35:59.863567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fc342-6238-4156-ae5a-c643a61d322e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:35:59.863857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fc342-6238-4156-ae5a-c643a61d322e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:35:59.864343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fc342-6238-4156-ae5a-c643a61d322e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:35:59.879722 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d6d99-042d-49e8-87c2-2cdaeb90fca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-bf0d6d99-042d-49e8-87c2-2cdaeb90fca1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:35:59.887672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:35:59.888614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:35:59.889432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:35:59.889432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:35:59.889432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:35:59.889432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:35:59.889432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:35:59.889432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:35:59.889432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:35:59.889432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:35:59.889432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:35:59.889432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:35:59.889432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:35:59.889432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:35:59.891537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 216/438] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:35:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:35:59.900885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d6d99-042d-49e8-87c2-2cdaeb90fca1 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:35:59.975739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fc342-6238-4156-ae5a-c643a61d322e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:35:59.977913 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fc342-6238-4156-ae5a-c643a61d322e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:00.000939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:00.081116 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d6d99-042d-49e8-87c2-2cdaeb90fca1 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:00.121257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 223/439] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:36:00.126992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fc342-6238-4156-ae5a-c643a61d322e None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:00.128014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e8b9f-ddc0-42be-8b99-92f5201a74e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:00.128743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e8b9f-ddc0-42be-8b99-92f5201a74e2 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:00.129101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e8b9f-ddc0-42be-8b99-92f5201a74e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:00.129451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e8b9f-ddc0-42be-8b99-92f5201a74e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:00.130622 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e8b9f-ddc0-42be-8b99-92f5201a74e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:00.130914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e8b9f-ddc0-42be-8b99-92f5201a74e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:00.133387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e8b9f-ddc0-42be-8b99-92f5201a74e2 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:00.144513 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 217/440] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:35:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:00.150885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e8b9f-ddc0-42be-8b99-92f5201a74e2 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:00.223429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:00.302731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fc342-6238-4156-ae5a-c643a61d322e None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:00.322368 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e8b9f-ddc0-42be-8b99-92f5201a74e2 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:00.330862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:00.359917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd59fd2-6d63-48a1-9988-f062b6f12e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:00.360975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd59fd2-6d63-48a1-9988-f062b6f12e51 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:00.361439 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd59fd2-6d63-48a1-9988-f062b6f12e51 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:00.361886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd59fd2-6d63-48a1-9988-f062b6f12e51 None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:00.363849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd59fd2-6d63-48a1-9988-f062b6f12e51 None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:00.366421 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd59fd2-6d63-48a1-9988-f062b6f12e51 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:00.369801 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 224/441] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:36:00 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:00.371128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4d8a9-fcd9-4872-8a34-feab2d467f95 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:00.371515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4d8a9-fcd9-4872-8a34-feab2d467f95 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:00.371751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4d8a9-fcd9-4872-8a34-feab2d467f95 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:00.373117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 225/442] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:00.376675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4d8a9-fcd9-4872-8a34-feab2d467f95 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:00.384209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38304f2-551d-4ba1-99df-44930b68f89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:00.384841 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38304f2-551d-4ba1-99df-44930b68f89a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:00.385122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38304f2-551d-4ba1-99df-44930b68f89a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:00.385393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38304f2-551d-4ba1-99df-44930b68f89a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:00.476719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38304f2-551d-4ba1-99df-44930b68f89a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:00.478192 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38304f2-551d-4ba1-99df-44930b68f89a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:00.517353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4d8a9-fcd9-4872-8a34-feab2d467f95 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:00.529277 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:00.565011 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48159c-59c3-4035-9b96-61982877fdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:00.566015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48159c-59c3-4035-9b96-61982877fdb3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:00.566501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48159c-59c3-4035-9b96-61982877fdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:00.566935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48159c-59c3-4035-9b96-61982877fdb3 None admin] PATH_INFO: `/v3/groups/94e958c60dff4b998bd2060f7b69f84b` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:00.568906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48159c-59c3-4035-9b96-61982877fdb3 None admin] RBAC: Authorizing `identity:get_group(group_id=94e958c60dff4b998bd2060f7b69f84b)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:00.571082 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48159c-59c3-4035-9b96-61982877fdb3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:00.578938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 226/443] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:36:00 2022] GET /identity/v3/groups/94e958c60dff4b998bd2060f7b69f84b => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:00.578938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aec35-6768-43e3-9f02-81d735f9bc87 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:00.578938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aec35-6768-43e3-9f02-81d735f9bc87 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:00.578938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aec35-6768-43e3-9f02-81d735f9bc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:00.604418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-338aec35-6768-43e3-9f02-81d735f9bc87 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:00.605649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-338aec35-6768-43e3-9f02-81d735f9bc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:00.623499 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 218/444] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:36:00.624300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38304f2-551d-4ba1-99df-44930b68f89a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:00.683940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:00.716813 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 227/445] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:00.718310 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aec35-6768-43e3-9f02-81d735f9bc87 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:00.750174 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38304f2-551d-4ba1-99df-44930b68f89a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:00.800269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318399dc-1821-45c2-8747-41a623a5912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:00.801011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318399dc-1821-45c2-8747-41a623a5912c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:00.801393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318399dc-1821-45c2-8747-41a623a5912c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:00.801734 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318399dc-1821-45c2-8747-41a623a5912c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:00.802723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318399dc-1821-45c2-8747-41a623a5912c None admin] RBAC: Adding query filter params (group.id=94e958c60dff4b998bd2060f7b69f84b, role.id=eef1174229014437a0db0fd8954bc25e, scope.project.id=e80ed515f9014a95b587cb8122d54787) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:00.803129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318399dc-1821-45c2-8747-41a623a5912c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:00.804960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318399dc-1821-45c2-8747-41a623a5912c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:00.812949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 219/446] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jul 27 10:36:00 2022] GET /identity/v3/role_assignments?group.id=94e958c60dff4b998bd2060f7b69f84b&scope.project.id=e80ed515f9014a95b587cb8122d54787&role.id=eef1174229014437a0db0fd8954bc25e => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:00.814906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318399dc-1821-45c2-8747-41a623a5912c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:00.826915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:00.904124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aec35-6768-43e3-9f02-81d735f9bc87 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:00.979458 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d07a7e-b99b-424a-9d2a-e3cb4fa44ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:00.980302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d07a7e-b99b-424a-9d2a-e3cb4fa44ee5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:00.980875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d07a7e-b99b-424a-9d2a-e3cb4fa44ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:00.981037 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d07a7e-b99b-424a-9d2a-e3cb4fa44ee5 None admin] PATH_INFO: `/v3/projects/e80ed515f9014a95b587cb8122d54787` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:00.982975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d07a7e-b99b-424a-9d2a-e3cb4fa44ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=e80ed515f9014a95b587cb8122d54787)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:00.987557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d07a7e-b99b-424a-9d2a-e3cb4fa44ee5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:00.988233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 228/447] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:36:00 2022] GET /identity/v3/projects/e80ed515f9014a95b587cb8122d54787 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:00.995336 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318399dc-1821-45c2-8747-41a623a5912c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:00.997567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d07a7e-b99b-424a-9d2a-e3cb4fa44ee5 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:01.057338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846873b-69b2-4f53-a044-ff416aeadd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:01.059335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846873b-69b2-4f53-a044-ff416aeadd63 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:01.059864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846873b-69b2-4f53-a044-ff416aeadd63 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:01.060393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846873b-69b2-4f53-a044-ff416aeadd63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:01.077841 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846873b-69b2-4f53-a044-ff416aeadd63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-5846873b-69b2-4f53-a044-ff416aeadd63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:01.086153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:01.087153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:01.087944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:01.087944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:01.087944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:01.087944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:01.087944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:01.087944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:01.087944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:01.087944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:01.087944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:01.087944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:01.087944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:36:01.087944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:01.088579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 220/448] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:36:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:01.094658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:01.096864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846873b-69b2-4f53-a044-ff416aeadd63 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:01.185534 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d07a7e-b99b-424a-9d2a-e3cb4fa44ee5 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:01.211947 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:01.254357 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703876e-c043-417a-924e-edd9546ae5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:01.255040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703876e-c043-417a-924e-edd9546ae5e5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:01.255321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703876e-c043-417a-924e-edd9546ae5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:01.255599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703876e-c043-417a-924e-edd9546ae5e5 None admin] PATH_INFO: `/v3/groups/94e958c60dff4b998bd2060f7b69f84b` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:01.256989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703876e-c043-417a-924e-edd9546ae5e5 None admin] RBAC: Authorizing `identity:get_group(group_id=94e958c60dff4b998bd2060f7b69f84b)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:01.258591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703876e-c043-417a-924e-edd9546ae5e5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:01.260639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 229/449] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:36:00 2022] GET /identity/v3/groups/94e958c60dff4b998bd2060f7b69f84b => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:01.267145 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703876e-c043-417a-924e-edd9546ae5e5 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:01.280867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846873b-69b2-4f53-a044-ff416aeadd63 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:01.330974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8947a-bb6d-4667-b9ef-304814944ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:01.331740 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8947a-bb6d-4667-b9ef-304814944ea3 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:01.332106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8947a-bb6d-4667-b9ef-304814944ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:01.332498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8947a-bb6d-4667-b9ef-304814944ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:01.333564 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8947a-bb6d-4667-b9ef-304814944ea3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:01.333960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8947a-bb6d-4667-b9ef-304814944ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:01.335739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8947a-bb6d-4667-b9ef-304814944ea3 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:01.345210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 221/450] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:36:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:01.351164 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8947a-bb6d-4667-b9ef-304814944ea3 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:01.430442 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703876e-c043-417a-924e-edd9546ae5e5 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:01.457742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:01.478951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8947a-bb6d-4667-b9ef-304814944ea3 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:01.485078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2ec18-1d75-41c1-9045-afe54d430f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:01.486567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2ec18-1d75-41c1-9045-afe54d430f5f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:01.487116 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2ec18-1d75-41c1-9045-afe54d430f5f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:01.488027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2ec18-1d75-41c1-9045-afe54d430f5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:01.489003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2ec18-1d75-41c1-9045-afe54d430f5f None admin] RBAC: Adding query filter params (group.id=94e958c60dff4b998bd2060f7b69f84b, role.id=fcaec44122534716b69d5e7f05160915, scope.project.id=e80ed515f9014a95b587cb8122d54787) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:01.489446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2ec18-1d75-41c1-9045-afe54d430f5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:01.491160 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2ec18-1d75-41c1-9045-afe54d430f5f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:01.498710 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 230/451] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jul 27 10:36:01 2022] GET /identity/v3/role_assignments?group.id=94e958c60dff4b998bd2060f7b69f84b&scope.project.id=e80ed515f9014a95b587cb8122d54787&role.id=fcaec44122534716b69d5e7f05160915 => generated 611 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:01.511322 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:01.521384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbef27-cb95-4363-aab5-4b92d9984e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:01.522033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbef27-cb95-4363-aab5-4b92d9984e6b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:01.522349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbef27-cb95-4363-aab5-4b92d9984e6b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:01.522629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbef27-cb95-4363-aab5-4b92d9984e6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:01.609448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbef27-cb95-4363-aab5-4b92d9984e6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:01.611670 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbef27-cb95-4363-aab5-4b92d9984e6b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:01.739136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 222/452] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 10:36:01.745645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2ec18-1d75-41c1-9045-afe54d430f5f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:01.899320 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2ec18-1d75-41c1-9045-afe54d430f5f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:01.952391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31d101-7000-4158-8092-1dfb07c2e65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:01.953357 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31d101-7000-4158-8092-1dfb07c2e65d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:01.953697 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31d101-7000-4158-8092-1dfb07c2e65d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:01.954028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31d101-7000-4158-8092-1dfb07c2e65d None admin] PATH_INFO: `/v3/projects/4c0fb163aada45c0be9fae56f3795bdd` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:01.956763 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31d101-7000-4158-8092-1dfb07c2e65d None admin] RBAC: Authorizing `identity:get_project(project_id=4c0fb163aada45c0be9fae56f3795bdd)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:01.961110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31d101-7000-4158-8092-1dfb07c2e65d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:01.963048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 231/453] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:36:01 2022] GET /identity/v3/projects/4c0fb163aada45c0be9fae56f3795bdd => generated 344 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:01.969070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbef27-cb95-4363-aab5-4b92d9984e6b None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:02.012660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:02.110166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbef27-cb95-4363-aab5-4b92d9984e6b None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:02.150980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c45df-fc7f-4d94-a185-0ea9f0b84ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:02.151646 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c45df-fc7f-4d94-a185-0ea9f0b84ffb None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:02.151929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c45df-fc7f-4d94-a185-0ea9f0b84ffb None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:02.152203 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c45df-fc7f-4d94-a185-0ea9f0b84ffb None admin] PATH_INFO: `/v3/groups/f14715c16f104cc1a68ab92390923729` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:02.153450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c45df-fc7f-4d94-a185-0ea9f0b84ffb None admin] RBAC: Authorizing `identity:get_group(group_id=f14715c16f104cc1a68ab92390923729)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:02.154992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c45df-fc7f-4d94-a185-0ea9f0b84ffb None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:02.156705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 223/454] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jul 27 10:36:01 2022] GET /identity/v3/groups/f14715c16f104cc1a68ab92390923729 => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:02.163144 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31d101-7000-4158-8092-1dfb07c2e65d None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:02.224061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:02.293432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31d101-7000-4158-8092-1dfb07c2e65d None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:02.354046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cf391-8923-404e-87b8-3b8d23519438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:02.355106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cf391-8923-404e-87b8-3b8d23519438 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:02.355506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cf391-8923-404e-87b8-3b8d23519438 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:02.356003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cf391-8923-404e-87b8-3b8d23519438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:02.357550 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cf391-8923-404e-87b8-3b8d23519438 None admin] RBAC: Adding query filter params (group.id=f14715c16f104cc1a68ab92390923729, role.id=36208a24005e4ff98d827138292bea37, scope.project.id=4c0fb163aada45c0be9fae56f3795bdd) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:02.358099 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cf391-8923-404e-87b8-3b8d23519438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:02.360882 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cf391-8923-404e-87b8-3b8d23519438 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:02.371600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 232/455] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jul 27 10:36:02 2022] GET /identity/v3/role_assignments?group.id=f14715c16f104cc1a68ab92390923729&scope.project.id=4c0fb163aada45c0be9fae56f3795bdd&role.id=36208a24005e4ff98d827138292bea37 => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:05.096651 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d1fc1-fad0-4a35-8a32-d57e85420c92 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:05.098249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d1fc1-fad0-4a35-8a32-d57e85420c92 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:05.098996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d1fc1-fad0-4a35-8a32-d57e85420c92 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:05.102345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 224/456] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:05.109416 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d60fa7-e074-4db2-a514-c0d1c4d85cc0 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:05.110995 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d60fa7-e074-4db2-a514-c0d1c4d85cc0 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:05.112002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d60fa7-e074-4db2-a514-c0d1c4d85cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:05.150225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b8d60fa7-e074-4db2-a514-c0d1c4d85cc0 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:05.152590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b8d60fa7-e074-4db2-a514-c0d1c4d85cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:05.318798 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 233/457] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:05.368352 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d1fc1-fad0-4a35-8a32-d57e85420c92 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:05.624348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:05.640901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d1fc1-fad0-4a35-8a32-d57e85420c92 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:05.735471 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a9533-e9ac-4585-a1e3-8331ffb040c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:05.736570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9533-e9ac-4585-a1e3-8331ffb040c8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:05.737066 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9533-e9ac-4585-a1e3-8331ffb040c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:05.737550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a9533-e9ac-4585-a1e3-8331ffb040c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:05.765136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a9533-e9ac-4585-a1e3-8331ffb040c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:05.768671 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a9533-e9ac-4585-a1e3-8331ffb040c8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-148a9533-e9ac-4585-a1e3-8331ffb040c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:05.806214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:05.807881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:05.809981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:05.809981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:05.809981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:05.809981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:05.809981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 225/458] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:05.815650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d60fa7-e074-4db2-a514-c0d1c4d85cc0 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:05.976601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:06.067857 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f367cb-ed7b-43ef-966c-a291ea5681bb None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:06.069017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f367cb-ed7b-43ef-966c-a291ea5681bb None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:06.069798 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f367cb-ed7b-43ef-966c-a291ea5681bb None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:06.074139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 226/459] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:06.083364 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d6bcf-14ac-44aa-92bf-5762380bc98e None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:06.084531 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d6bcf-14ac-44aa-92bf-5762380bc98e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:06.085858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d6bcf-14ac-44aa-92bf-5762380bc98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:06.093239 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d60fa7-e074-4db2-a514-c0d1c4d85cc0 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:06.130325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-b40d6bcf-14ac-44aa-92bf-5762380bc98e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:06.131475 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b40d6bcf-14ac-44aa-92bf-5762380bc98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:06.172318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637b7e2-8a2e-4f79-9953-84705b4d8773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:06.173592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637b7e2-8a2e-4f79-9953-84705b4d8773 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:06.173863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637b7e2-8a2e-4f79-9953-84705b4d8773 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:06.174085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637b7e2-8a2e-4f79-9953-84705b4d8773 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:06.174894 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637b7e2-8a2e-4f79-9953-84705b4d8773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:06.175216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637b7e2-8a2e-4f79-9953-84705b4d8773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:06.176652 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637b7e2-8a2e-4f79-9953-84705b4d8773 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:06.199344 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 234/460] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:06.208230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637b7e2-8a2e-4f79-9953-84705b4d8773 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:06.306751 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 227/461] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:06.399468 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d6bcf-14ac-44aa-92bf-5762380bc98e None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:06.432347 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637b7e2-8a2e-4f79-9953-84705b4d8773 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:06.440356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:06.483987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b598a-1be5-4a68-a1e0-f2da7312a0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:06.486233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b598a-1be5-4a68-a1e0-f2da7312a0ff None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:06.487348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b598a-1be5-4a68-a1e0-f2da7312a0ff None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:06.488150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b598a-1be5-4a68-a1e0-f2da7312a0ff None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:06.489831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b598a-1be5-4a68-a1e0-f2da7312a0ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:06.493004 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b598a-1be5-4a68-a1e0-f2da7312a0ff None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:06.534368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 235/462] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:36:06 2022] POST /identity/v3/users => generated 246 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:36:06.537263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba20fc3-ef40-4b87-b2e8-6d0301701d52 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:06.538260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba20fc3-ef40-4b87-b2e8-6d0301701d52 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:06.539121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba20fc3-ef40-4b87-b2e8-6d0301701d52 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:06.545319 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:06.546833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 236/463] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:06.552917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f1d3f-2ec7-4a84-983a-a5b4ec2f018c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:06.553552 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f1d3f-2ec7-4a84-983a-a5b4ec2f018c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:06.554287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f1d3f-2ec7-4a84-983a-a5b4ec2f018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:06.586631 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d6bcf-14ac-44aa-92bf-5762380bc98e None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:06.590338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-4a4f1d3f-2ec7-4a84-983a-a5b4ec2f018c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:06.597780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4a4f1d3f-2ec7-4a84-983a-a5b4ec2f018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:06.654034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359c118-05c6-47ad-a8ed-1ccfcda31ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:06.655006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359c118-05c6-47ad-a8ed-1ccfcda31ffd None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:06.655444 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359c118-05c6-47ad-a8ed-1ccfcda31ffd None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:06.655867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359c118-05c6-47ad-a8ed-1ccfcda31ffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:06.693167 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359c118-05c6-47ad-a8ed-1ccfcda31ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:06.696013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359c118-05c6-47ad-a8ed-1ccfcda31ffd None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-6359c118-05c6-47ad-a8ed-1ccfcda31ffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:06.731092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:06.732011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:06.732967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:06.732967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:06.732967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:06.732967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:06.734216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 228/464] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:06.736613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56e95f-68f7-41be-ba92-2dc579e8b525 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:06.737120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56e95f-68f7-41be-ba92-2dc579e8b525 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:06.737593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56e95f-68f7-41be-ba92-2dc579e8b525 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:06.740885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 229/465] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:06.746508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab962f-3c65-4e3d-8ab1-5eac7c0a0616 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:06.746795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab962f-3c65-4e3d-8ab1-5eac7c0a0616 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:06.747074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab962f-3c65-4e3d-8ab1-5eac7c0a0616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:06.759570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 237/466] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:06.761041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f1d3f-2ec7-4a84-983a-a5b4ec2f018c None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:06.769325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-14ab962f-3c65-4e3d-8ab1-5eac7c0a0616 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:06.770671 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-14ab962f-3c65-4e3d-8ab1-5eac7c0a0616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:06.876324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 230/467] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:06.878242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab962f-3c65-4e3d-8ab1-5eac7c0a0616 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:06.962787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:06.977548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:06.985668 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f1d3f-2ec7-4a84-983a-a5b4ec2f018c None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:07.036571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20802f5-4df8-49a4-9ee6-df4559d0a149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:07.040547 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20802f5-4df8-49a4-9ee6-df4559d0a149 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:07.041436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20802f5-4df8-49a4-9ee6-df4559d0a149 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:07.042341 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20802f5-4df8-49a4-9ee6-df4559d0a149 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:07.044109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20802f5-4df8-49a4-9ee6-df4559d0a149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:07.044926 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20802f5-4df8-49a4-9ee6-df4559d0a149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:07.048728 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20802f5-4df8-49a4-9ee6-df4559d0a149 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:07.049754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab962f-3c65-4e3d-8ab1-5eac7c0a0616 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:07.064905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 238/468] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:07.066128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20802f5-4df8-49a4-9ee6-df4559d0a149 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:07.121617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524a0d5-ea7c-4b92-8435-429b15e7c795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:07.122809 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a0d5-ea7c-4b92-8435-429b15e7c795 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:07.123320 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a0d5-ea7c-4b92-8435-429b15e7c795 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:07.124365 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a0d5-ea7c-4b92-8435-429b15e7c795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:07.145475 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524a0d5-ea7c-4b92-8435-429b15e7c795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:07.147976 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524a0d5-ea7c-4b92-8435-429b15e7c795 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-b524a0d5-ea7c-4b92-8435-429b15e7c795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:07.175047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:07.176335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:07.177534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:07.177534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:07.177534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:07.177534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:07.177534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 231/469] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:07.178980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a8b8e-a2ab-40a9-99d6-d4fec7b8c564 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:07.179268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a8b8e-a2ab-40a9-99d6-d4fec7b8c564 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:07.179678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a8b8e-a2ab-40a9-99d6-d4fec7b8c564 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:07.186374 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 232/470] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:07.186374 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a8b8e-a2ab-40a9-99d6-d4fec7b8c564 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:07.208449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20802f5-4df8-49a4-9ee6-df4559d0a149 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:07.272618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ca9f3-1f4d-4451-bb9e-b9d8343754f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:07.273252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ca9f3-1f4d-4451-bb9e-b9d8343754f7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:07.273544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ca9f3-1f4d-4451-bb9e-b9d8343754f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:07.273830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ca9f3-1f4d-4451-bb9e-b9d8343754f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:07.288886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ca9f3-1f4d-4451-bb9e-b9d8343754f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:07.291053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ca9f3-1f4d-4451-bb9e-b9d8343754f7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-e20ca9f3-1f4d-4451-bb9e-b9d8343754f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:07.310443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:07.311407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:07.312271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:07.312271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:07.312271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:07.312271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:07.312271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 239/471] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:07.312889 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ca9f3-1f4d-4451-bb9e-b9d8343754f7 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:07.316243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:07.362004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a8b8e-a2ab-40a9-99d6-d4fec7b8c564 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:07.377690 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:07.406012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077a057-4064-44be-9ae0-7a6cb64aed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:07.406784 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077a057-4064-44be-9ae0-7a6cb64aed0a None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:07.407684 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077a057-4064-44be-9ae0-7a6cb64aed0a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:07.407973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077a057-4064-44be-9ae0-7a6cb64aed0a None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:07.408696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077a057-4064-44be-9ae0-7a6cb64aed0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:07.410215 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077a057-4064-44be-9ae0-7a6cb64aed0a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:07.437627 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 233/472] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:36:07 2022] POST /identity/v3/users => generated 249 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:36:07.439147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc6a3-8c37-40fc-878c-a196c773eb0e None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:07.439323 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc6a3-8c37-40fc-878c-a196c773eb0e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:07.439543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc6a3-8c37-40fc-878c-a196c773eb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:07.471518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ca9f3-1f4d-4451-bb9e-b9d8343754f7 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:07.471771 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-61efc6a3-8c37-40fc-878c-a196c773eb0e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:07.473092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-61efc6a3-8c37-40fc-878c-a196c773eb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:07.517327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262afa69-9c54-4416-a8d5-ca2c7bbd75e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:07.518245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262afa69-9c54-4416-a8d5-ca2c7bbd75e3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:07.518741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262afa69-9c54-4416-a8d5-ca2c7bbd75e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:07.519175 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262afa69-9c54-4416-a8d5-ca2c7bbd75e3 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:07.520056 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262afa69-9c54-4416-a8d5-ca2c7bbd75e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:07.520655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262afa69-9c54-4416-a8d5-ca2c7bbd75e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:07.522210 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262afa69-9c54-4416-a8d5-ca2c7bbd75e3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:07.544173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 240/473] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:07.544173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262afa69-9c54-4416-a8d5-ca2c7bbd75e3 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:07.642421 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:07.652191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 234/474] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:07.653377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efc6a3-8c37-40fc-878c-a196c773eb0e None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:07.709032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262afa69-9c54-4416-a8d5-ca2c7bbd75e3 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:07.768181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12bd5c-ec0a-4855-b4bc-7e0c9092c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:07.769657 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12bd5c-ec0a-4855-b4bc-7e0c9092c72f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:07.770483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12bd5c-ec0a-4855-b4bc-7e0c9092c72f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:07.771294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12bd5c-ec0a-4855-b4bc-7e0c9092c72f None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:07.773776 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12bd5c-ec0a-4855-b4bc-7e0c9092c72f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:07.774754 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12bd5c-ec0a-4855-b4bc-7e0c9092c72f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:07.778481 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12bd5c-ec0a-4855-b4bc-7e0c9092c72f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:07.796915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 241/475] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:07.797765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12bd5c-ec0a-4855-b4bc-7e0c9092c72f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:07.805792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:07.810367 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efc6a3-8c37-40fc-878c-a196c773eb0e None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:07.850377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f97690-d127-42d4-9e34-20984c4d027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:07.851042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97690-d127-42d4-9e34-20984c4d027e None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:07.851345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97690-d127-42d4-9e34-20984c4d027e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:07.851621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f97690-d127-42d4-9e34-20984c4d027e None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:07.852324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f97690-d127-42d4-9e34-20984c4d027e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:07.853844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f97690-d127-42d4-9e34-20984c4d027e None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:07.894067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 235/476] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:36:07 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:36:07.906219 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f97690-d127-42d4-9e34-20984c4d027e None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:07.983062 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12bd5c-ec0a-4855-b4bc-7e0c9092c72f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:08.046637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:08.082225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fce59e-67fc-4e53-9824-acd2191155d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:08.082847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fce59e-67fc-4e53-9824-acd2191155d3 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:08.083137 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fce59e-67fc-4e53-9824-acd2191155d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:08.083526 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fce59e-67fc-4e53-9824-acd2191155d3 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:08.084273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fce59e-67fc-4e53-9824-acd2191155d3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:08.085685 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fce59e-67fc-4e53-9824-acd2191155d3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:08.099051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f97690-d127-42d4-9e34-20984c4d027e None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:08.110349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.sql.core [None req-08fce59e-67fc-4e53-9824-acd2191155d3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 10:36:08.110349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 10:36:08.110349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [parameters: {'id': '41245e5ff01a4a569d30c7031ea08827', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 10:36:08.110349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86616) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-08fce59e-67fc-4e53-9824-acd2191155d3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application conn.query(q) Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application result.read() Jul 27 10:36:08.137300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return ref.to_dict() Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 10:36:08.138277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application next(self.gen) Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application yield resource Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application next(self.gen) Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise self.value Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application session.commit() Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 10:36:08.139248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.session.flush() Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application compat.raise_( Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 10:36:08.140117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 10:36:08.141014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application conn.query(q) Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application result.read() Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 10:36:08.144332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [parameters: {'id': '41245e5ff01a4a569d30c7031ea08827', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:08.146296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 10:36:08.148886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:08.152428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 242/477] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Jul 27 10:36:07 2022] POST /identity/v3/roles => generated 144 bytes in 344 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:08.152428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fce59e-67fc-4e53-9824-acd2191155d3 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:08.158977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af074271-fb92-4138-bcf6-02903a72a093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:08.159624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af074271-fb92-4138-bcf6-02903a72a093 None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:08.159955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af074271-fb92-4138-bcf6-02903a72a093 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:08.160227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af074271-fb92-4138-bcf6-02903a72a093 None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:08.160974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af074271-fb92-4138-bcf6-02903a72a093 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:08.162473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af074271-fb92-4138-bcf6-02903a72a093 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:08.196302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 236/478] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:36:07 2022] POST /identity/v3/users => generated 248 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:36:08.296161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fce59e-67fc-4e53-9824-acd2191155d3 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:08.344242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f6b67-33da-4616-92b2-47787e82bafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:08.345719 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f6b67-33da-4616-92b2-47787e82bafb None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:08.346274 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f6b67-33da-4616-92b2-47787e82bafb None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:08.346757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f6b67-33da-4616-92b2-47787e82bafb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:08.364852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f6b67-33da-4616-92b2-47787e82bafb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-761f6b67-33da-4616-92b2-47787e82bafb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:08.371207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:08.372181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:08.373012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:08.373012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:08.373012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:08.373012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:08.373012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:08.373012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:08.373012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:08.373012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:08.373012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:08.373012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:08.373012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 10:36:08.373012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:08.376569 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 243/479] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:36:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:08.385877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af074271-fb92-4138-bcf6-02903a72a093 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:08.415821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:08.551645 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af074271-fb92-4138-bcf6-02903a72a093 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:08.602560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb743f-9754-4ad8-aa1d-5b3be0840979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:08.603548 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb743f-9754-4ad8-aa1d-5b3be0840979 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:08.604021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb743f-9754-4ad8-aa1d-5b3be0840979 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:08.604473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb743f-9754-4ad8-aa1d-5b3be0840979 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:08.605406 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb743f-9754-4ad8-aa1d-5b3be0840979 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:08.605893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb743f-9754-4ad8-aa1d-5b3be0840979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:08.607498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb743f-9754-4ad8-aa1d-5b3be0840979 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:08.618490 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 237/480] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:09.097193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f377e7-9cbe-43bb-83de-55b4a5caf661 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:09.097574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f377e7-9cbe-43bb-83de-55b4a5caf661 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:09.097855 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f377e7-9cbe-43bb-83de-55b4a5caf661 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:09.099671 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 244/481] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:09.106244 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78243aff-7b6e-49cf-8749-2817ca68cece None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:09.106951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78243aff-7b6e-49cf-8749-2817ca68cece None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:09.107428 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78243aff-7b6e-49cf-8749-2817ca68cece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:09.132326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-78243aff-7b6e-49cf-8749-2817ca68cece None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:09.133887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-78243aff-7b6e-49cf-8749-2817ca68cece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:09.245105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 238/482] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:09.289922 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f377e7-9cbe-43bb-83de-55b4a5caf661 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:09.374920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:09.460417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f377e7-9cbe-43bb-83de-55b4a5caf661 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:09.521884 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26adaa9-19e9-4ed6-90b9-33698057a639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:09.522714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26adaa9-19e9-4ed6-90b9-33698057a639 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:09.523077 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26adaa9-19e9-4ed6-90b9-33698057a639 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:09.523479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26adaa9-19e9-4ed6-90b9-33698057a639 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:09.540353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26adaa9-19e9-4ed6-90b9-33698057a639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-c26adaa9-19e9-4ed6-90b9-33698057a639 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:09.545717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:09.546713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:09.548309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:09.548309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:09.548309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:09.548309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:09.548309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:09.548309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:09.548309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:09.548309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:09.548309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:09.548309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:09.548309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:09.548309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:09.548309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 245/483] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:09.559641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78243aff-7b6e-49cf-8749-2817ca68cece None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:09.562307 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:09.736960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78243aff-7b6e-49cf-8749-2817ca68cece None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:09.790694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380a14-f08e-45e0-a473-3393522375a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:09.791786 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380a14-f08e-45e0-a473-3393522375a0 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:09.792363 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380a14-f08e-45e0-a473-3393522375a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:09.792869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380a14-f08e-45e0-a473-3393522375a0 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:09.794290 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380a14-f08e-45e0-a473-3393522375a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:09.794911 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380a14-f08e-45e0-a473-3393522375a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:09.798103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380a14-f08e-45e0-a473-3393522375a0 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:09.815215 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 239/484] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:09.823592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26adaa9-19e9-4ed6-90b9-33698057a639 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:09.973618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26adaa9-19e9-4ed6-90b9-33698057a639 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:09.981704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:10.023245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967b2b5-6eed-4c13-86c8-3b95146f32b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:10.023863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967b2b5-6eed-4c13-86c8-3b95146f32b2 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:10.024148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967b2b5-6eed-4c13-86c8-3b95146f32b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:10.024427 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967b2b5-6eed-4c13-86c8-3b95146f32b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:10.046957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967b2b5-6eed-4c13-86c8-3b95146f32b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:10.048963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9967b2b5-6eed-4c13-86c8-3b95146f32b2 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-9967b2b5-6eed-4c13-86c8-3b95146f32b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:10.067644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:10.069954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:10.071479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:10.071479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:10.071479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:10.071479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:10.071479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 246/485] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:10.081369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380a14-f08e-45e0-a473-3393522375a0 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:10.229817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:10.296880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380a14-f08e-45e0-a473-3393522375a0 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:10.359311 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459496e-0812-47cc-88a4-9dc18eb482e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:10.360639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459496e-0812-47cc-88a4-9dc18eb482e9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:10.361000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459496e-0812-47cc-88a4-9dc18eb482e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:10.361304 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459496e-0812-47cc-88a4-9dc18eb482e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:10.362522 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459496e-0812-47cc-88a4-9dc18eb482e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:10.362838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459496e-0812-47cc-88a4-9dc18eb482e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:10.364280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459496e-0812-47cc-88a4-9dc18eb482e9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:10.388410 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 240/486] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:10.397925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967b2b5-6eed-4c13-86c8-3b95146f32b2 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:10.504051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6386410-1953-41c1-a5cb-4a5820d56ca7 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:10.504539 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6386410-1953-41c1-a5cb-4a5820d56ca7 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:10.505009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6386410-1953-41c1-a5cb-4a5820d56ca7 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:10.508099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 241/487] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:10.517291 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f11d-c74e-4cd9-980a-48d66d5f3d99 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:10.518164 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f11d-c74e-4cd9-980a-48d66d5f3d99 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:10.518944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36f11d-c74e-4cd9-980a-48d66d5f3d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:10.582505 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967b2b5-6eed-4c13-86c8-3b95146f32b2 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:10.592117 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-1d36f11d-c74e-4cd9-980a-48d66d5f3d99 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:10.595566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1d36f11d-c74e-4cd9-980a-48d66d5f3d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:10.630224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009105fb-cd13-4d63-9c3c-8825cefa796e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:10.630224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009105fb-cd13-4d63-9c3c-8825cefa796e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:10.630224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009105fb-cd13-4d63-9c3c-8825cefa796e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:10.630224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009105fb-cd13-4d63-9c3c-8825cefa796e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:10.638012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009105fb-cd13-4d63-9c3c-8825cefa796e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:10.639838 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009105fb-cd13-4d63-9c3c-8825cefa796e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-009105fb-cd13-4d63-9c3c-8825cefa796e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:10.656161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:10.657549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:10.659679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:10.659679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:10.659679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:10.659679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:10.659679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:10.659679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:10.659679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:10.659679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:10.659679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:36:10.659679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:10.659679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 247/488] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jul 27 10:36:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:10.669798 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009105fb-cd13-4d63-9c3c-8825cefa796e None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:10.706665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:10.843416 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009105fb-cd13-4d63-9c3c-8825cefa796e None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:10.852015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 242/489] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:10.887033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455ebd-2656-4551-9cb6-65b5d5b7d4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:10.887653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455ebd-2656-4551-9cb6-65b5d5b7d4cc None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:10.887934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455ebd-2656-4551-9cb6-65b5d5b7d4cc None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:10.888205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455ebd-2656-4551-9cb6-65b5d5b7d4cc None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:10.889016 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52455ebd-2656-4551-9cb6-65b5d5b7d4cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:10.889325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52455ebd-2656-4551-9cb6-65b5d5b7d4cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:10.890832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52455ebd-2656-4551-9cb6-65b5d5b7d4cc None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:10.907938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f11d-c74e-4cd9-980a-48d66d5f3d99 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:10.952826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 248/490] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jul 27 10:36:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:10.959391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455ebd-2656-4551-9cb6-65b5d5b7d4cc None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:11.028975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:11.087949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36f11d-c74e-4cd9-980a-48d66d5f3d99 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:11.089158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:11.121629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455ebd-2656-4551-9cb6-65b5d5b7d4cc None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:11.133618 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d80372-71fb-4ea8-8a84-be2ae4d4d421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:11.134490 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80372-71fb-4ea8-8a84-be2ae4d4d421 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:11.134927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80372-71fb-4ea8-8a84-be2ae4d4d421 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:11.135366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80372-71fb-4ea8-8a84-be2ae4d4d421 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:11.149415 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d80372-71fb-4ea8-8a84-be2ae4d4d421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-88d80372-71fb-4ea8-8a84-be2ae4d4d421 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:11.157842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:11.158965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:11.159758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:11.159758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:11.159758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:11.159758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:11.159758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:11.159758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:11.159758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:11.159758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:11.159758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:11.159758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:11.159758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:11.159758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:11.159758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 243/491] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:11.161696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04ae85-0596-449c-a38f-1d8f1bfa9c39 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:11.162135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04ae85-0596-449c-a38f-1d8f1bfa9c39 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:11.162587 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04ae85-0596-449c-a38f-1d8f1bfa9c39 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:11.166298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 244/492] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:11.166298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09583c2-9506-464e-af2b-42b2c6b0bc39 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:11.166788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09583c2-9506-464e-af2b-42b2c6b0bc39 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:11.167220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09583c2-9506-464e-af2b-42b2c6b0bc39 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:11.169637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 245/493] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:11.170172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d09a3-2d67-4be7-b9ee-9c7d49b50eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:11.170864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09583c2-9506-464e-af2b-42b2c6b0bc39 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:11.171227 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d09a3-2d67-4be7-b9ee-9c7d49b50eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:11.171650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d09a3-2d67-4be7-b9ee-9c7d49b50eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:11.171935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d09a3-2d67-4be7-b9ee-9c7d49b50eb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:11.250275 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d09a3-2d67-4be7-b9ee-9c7d49b50eb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:11.252601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d09a3-2d67-4be7-b9ee-9c7d49b50eb9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:11.302765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09583c2-9506-464e-af2b-42b2c6b0bc39 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:11.321420 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:11.338544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:11.348746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c99a5e-bb1b-491e-aa8f-93004807fc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:11.349645 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c99a5e-bb1b-491e-aa8f-93004807fc96 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:11.350003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c99a5e-bb1b-491e-aa8f-93004807fc96 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:11.350456 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c99a5e-bb1b-491e-aa8f-93004807fc96 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:11.351785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c99a5e-bb1b-491e-aa8f-93004807fc96 None admin] RBAC: Adding query filter params (name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:11.352265 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c99a5e-bb1b-491e-aa8f-93004807fc96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:11.354082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c99a5e-bb1b-491e-aa8f-93004807fc96 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:11.369501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 246/494] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:11.369501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eba23-1375-4158-90b0-22922981517b None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:11.369501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eba23-1375-4158-90b0-22922981517b None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:11.369501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eba23-1375-4158-90b0-22922981517b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:11.370380 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 249/495] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:36:11.371856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b0d25-2269-4253-91b5-43a91f8cd884 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:11.372098 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b0d25-2269-4253-91b5-43a91f8cd884 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:11.372376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b0d25-2269-4253-91b5-43a91f8cd884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:11.388303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-cf1eba23-1375-4158-90b0-22922981517b None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:11.390063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-cf1eba23-1375-4158-90b0-22922981517b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:11.390802 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-db4b0d25-2269-4253-91b5-43a91f8cd884 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:11.392023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-db4b0d25-2269-4253-91b5-43a91f8cd884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:11.471014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 250/496] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:11.471889 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b0d25-2269-4253-91b5-43a91f8cd884 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:11.490317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 247/497] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:11.492335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eba23-1375-4158-90b0-22922981517b None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:11.613615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b0d25-2269-4253-91b5-43a91f8cd884 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:11.622690 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:11.655482 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b9e93-2790-447e-8042-6987986c08b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:11.656040 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eba23-1375-4158-90b0-22922981517b None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:11.656194 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b9e93-2790-447e-8042-6987986c08b6 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:11.656405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b9e93-2790-447e-8042-6987986c08b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:11.656821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b9e93-2790-447e-8042-6987986c08b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:11.667153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:11.669481 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b9e93-2790-447e-8042-6987986c08b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:11.671045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b9e93-2790-447e-8042-6987986c08b6 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-c86b9e93-2790-447e-8042-6987986c08b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:11.693998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:11.694956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:11.695893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:11.695893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:11.695893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:11.695893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:11.695893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 251/498] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:11.698360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b9e93-2790-447e-8042-6987986c08b6 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:11.715536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e462a-06cc-4fda-9996-c24feb23488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:11.716665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e462a-06cc-4fda-9996-c24feb23488c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:11.717228 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e462a-06cc-4fda-9996-c24feb23488c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:11.717789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e462a-06cc-4fda-9996-c24feb23488c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:11.731820 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e462a-06cc-4fda-9996-c24feb23488c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:11.733777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e462a-06cc-4fda-9996-c24feb23488c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-248e462a-06cc-4fda-9996-c24feb23488c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:11.756007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:11.757188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:11.763109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:11.763109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:11.763109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:11.763109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:11.763109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 248/499] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:11.763109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e462a-06cc-4fda-9996-c24feb23488c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:11.807579 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b9e93-2790-447e-8042-6987986c08b6 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:11.847897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee6551-5ad0-4b67-939a-6888c114678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:11.848544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee6551-5ad0-4b67-939a-6888c114678d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:11.848827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee6551-5ad0-4b67-939a-6888c114678d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:11.849102 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee6551-5ad0-4b67-939a-6888c114678d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:11.866865 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee6551-5ad0-4b67-939a-6888c114678d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-77ee6551-5ad0-4b67-939a-6888c114678d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:11.873886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:11.875134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:11.876571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:11.876571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:11.876571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:11.876571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:11.876571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:11.876571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:11.876571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:11.876571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:11.876571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:11.876571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:11.876571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:11.876571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:11.876571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 252/500] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:11.876571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee6551-5ad0-4b67-939a-6888c114678d None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:11.882751 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e462a-06cc-4fda-9996-c24feb23488c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:11.898679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:11.921077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d558bb7-344b-4ff2-a8c6-cd9d82d4e1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:11.921720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d558bb7-344b-4ff2-a8c6-cd9d82d4e1f3 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:11.922004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d558bb7-344b-4ff2-a8c6-cd9d82d4e1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:11.922447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d558bb7-344b-4ff2-a8c6-cd9d82d4e1f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:11.933512 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d558bb7-344b-4ff2-a8c6-cd9d82d4e1f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-1d558bb7-344b-4ff2-a8c6-cd9d82d4e1f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:11.940644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:11.941675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:11.942542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:11.942542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:11.942542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:11.942542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:11.942542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:11.942542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:11.942542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:11.942542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:11.942542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:11.942542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:11.942542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:11.942542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:11.942542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 249/501] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:11.943343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f6c77-1ec1-4d11-a1c3-90c6897e7011 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:11.943343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f6c77-1ec1-4d11-a1c3-90c6897e7011 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:11.943560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f6c77-1ec1-4d11-a1c3-90c6897e7011 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:11.944786 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 250/502] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:11.945517 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f6c77-1ec1-4d11-a1c3-90c6897e7011 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:11.966939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:11.996705 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee6551-5ad0-4b67-939a-6888c114678d None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:12.036229 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012a8f4-4468-455c-9e8c-0f4a0de42b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:12.036991 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012a8f4-4468-455c-9e8c-0f4a0de42b14 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:12.037307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012a8f4-4468-455c-9e8c-0f4a0de42b14 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:12.037647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012a8f4-4468-455c-9e8c-0f4a0de42b14 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:12.038569 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012a8f4-4468-455c-9e8c-0f4a0de42b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:12.038920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012a8f4-4468-455c-9e8c-0f4a0de42b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:12.040623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012a8f4-4468-455c-9e8c-0f4a0de42b14 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:12.054461 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 253/503] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:12.055450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012a8f4-4468-455c-9e8c-0f4a0de42b14 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:12.068523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f6c77-1ec1-4d11-a1c3-90c6897e7011 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:12.111152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a53725-1002-43b9-ba4e-7d4eaa1bc5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:12.112199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a53725-1002-43b9-ba4e-7d4eaa1bc5c8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:12.112484 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a53725-1002-43b9-ba4e-7d4eaa1bc5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:12.112847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a53725-1002-43b9-ba4e-7d4eaa1bc5c8 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:12.114009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a53725-1002-43b9-ba4e-7d4eaa1bc5c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:12.114498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a53725-1002-43b9-ba4e-7d4eaa1bc5c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:12.116362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a53725-1002-43b9-ba4e-7d4eaa1bc5c8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:12.137354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 251/504] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:12.138133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a53725-1002-43b9-ba4e-7d4eaa1bc5c8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:12.144491 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:12.168418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012a8f4-4468-455c-9e8c-0f4a0de42b14 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:12.205145 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0440a8-851d-4e93-8281-a2e7c8b2a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:12.205771 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0440a8-851d-4e93-8281-a2e7c8b2a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:12.206050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0440a8-851d-4e93-8281-a2e7c8b2a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:12.206367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0440a8-851d-4e93-8281-a2e7c8b2a9b7 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:12.207124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0440a8-851d-4e93-8281-a2e7c8b2a9b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:12.207436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0440a8-851d-4e93-8281-a2e7c8b2a9b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:12.208825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0440a8-851d-4e93-8281-a2e7c8b2a9b7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:12.217435 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 254/505] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:12.218721 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f6183-dec5-4532-9bda-474380be8045 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:12.219024 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f6183-dec5-4532-9bda-474380be8045 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:12.219024 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f6183-dec5-4532-9bda-474380be8045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:12.229055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:12.237887 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-6c3f6183-dec5-4532-9bda-474380be8045 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:12.239138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6c3f6183-dec5-4532-9bda-474380be8045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:12.253392 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a53725-1002-43b9-ba4e-7d4eaa1bc5c8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:12.292293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4a2b4-23ef-4053-94ad-e1e6624d12a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:12.293197 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4a2b4-23ef-4053-94ad-e1e6624d12a8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:12.293525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4a2b4-23ef-4053-94ad-e1e6624d12a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:12.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4a2b4-23ef-4053-94ad-e1e6624d12a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:12.294707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4a2b4-23ef-4053-94ad-e1e6624d12a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:12.295089 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4a2b4-23ef-4053-94ad-e1e6624d12a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:12.296851 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4a2b4-23ef-4053-94ad-e1e6624d12a8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:12.308607 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 252/506] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:12.309883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4a2b4-23ef-4053-94ad-e1e6624d12a8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:12.315328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 255/507] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:12.316221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f6183-dec5-4532-9bda-474380be8045 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:12.389042 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:12.424598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f6183-dec5-4532-9bda-474380be8045 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:12.427312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4a2b4-23ef-4053-94ad-e1e6624d12a8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:12.461354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069541a8-f9ca-4d19-9aa9-724f4bff1e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:12.462151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069541a8-f9ca-4d19-9aa9-724f4bff1e4d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:12.462556 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069541a8-f9ca-4d19-9aa9-724f4bff1e4d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:12.462885 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069541a8-f9ca-4d19-9aa9-724f4bff1e4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:12.463235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b3861-fc08-450d-8b22-3856db2eb08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:12.463886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3861-fc08-450d-8b22-3856db2eb08b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:12.464168 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3861-fc08-450d-8b22-3856db2eb08b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:12.464446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3861-fc08-450d-8b22-3856db2eb08b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:12.471969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069541a8-f9ca-4d19-9aa9-724f4bff1e4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:12.473630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069541a8-f9ca-4d19-9aa9-724f4bff1e4d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:12.476163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b3861-fc08-450d-8b22-3856db2eb08b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:12.478057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b3861-fc08-450d-8b22-3856db2eb08b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:12.481690 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-069541a8-f9ca-4d19-9aa9-724f4bff1e4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:12.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:12.491515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:12.492978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:12.492978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:12.492978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:12.492978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:12.492978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:12.492978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:12.492978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:12.492978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:12.496352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 256/508] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:12.497348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069541a8-f9ca-4d19-9aa9-724f4bff1e4d None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-322b3861-fc08-450d-8b22-3856db2eb08b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:12.498714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:12.499720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:12.500733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:12.500733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:12.500733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:12.500733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:12.500733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:12.500733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:12.500733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:12.500733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:12.500733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 10:36:12.500733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:12.500733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 253/509] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:12.501286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b3861-fc08-450d-8b22-3856db2eb08b None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:12.612468 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b3861-fc08-450d-8b22-3856db2eb08b None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:12.616263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069541a8-f9ca-4d19-9aa9-724f4bff1e4d None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:12.647317 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:12.653915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c272b48-10b9-46db-bdc3-ecd40acce052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:12.654176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c078960-14b3-4222-8fc7-9289ca609b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:12.654598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c272b48-10b9-46db-bdc3-ecd40acce052 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:12.654870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c078960-14b3-4222-8fc7-9289ca609b6a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:12.654972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c272b48-10b9-46db-bdc3-ecd40acce052 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:12.655138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c272b48-10b9-46db-bdc3-ecd40acce052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:12.655236 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c078960-14b3-4222-8fc7-9289ca609b6a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:12.655418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c078960-14b3-4222-8fc7-9289ca609b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:12.667255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c272b48-10b9-46db-bdc3-ecd40acce052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:12.667923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c078960-14b3-4222-8fc7-9289ca609b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:12.668731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c272b48-10b9-46db-bdc3-ecd40acce052 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:12.673857 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c078960-14b3-4222-8fc7-9289ca609b6a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-2c078960-14b3-4222-8fc7-9289ca609b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:12.685757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:12.686767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:12.688061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:12.688061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:12.688061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:12.688061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:12.688061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 254/510] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:12.688061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c078960-14b3-4222-8fc7-9289ca609b6a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-1c272b48-10b9-46db-bdc3-ecd40acce052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:12.695191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:12.696417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:12.697264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:12.697264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:12.697264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:12.697264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:12.697264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 257/511] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:12.697541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c272b48-10b9-46db-bdc3-ecd40acce052 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:12.750427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:12.803818 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c078960-14b3-4222-8fc7-9289ca609b6a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:12.810583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c272b48-10b9-46db-bdc3-ecd40acce052 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:12.846875 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167a519-e800-45ae-a1e3-9bf47580e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:12.847536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167a519-e800-45ae-a1e3-9bf47580e60d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:12.847823 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167a519-e800-45ae-a1e3-9bf47580e60d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:12.848104 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167a519-e800-45ae-a1e3-9bf47580e60d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:12.852941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119bec3-cd2d-44d4-bd7e-a981a50c1326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:12.853594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119bec3-cd2d-44d4-bd7e-a981a50c1326 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:12.853876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119bec3-cd2d-44d4-bd7e-a981a50c1326 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:12.854153 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119bec3-cd2d-44d4-bd7e-a981a50c1326 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:12.854976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119bec3-cd2d-44d4-bd7e-a981a50c1326 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:12.855288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119bec3-cd2d-44d4-bd7e-a981a50c1326 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:12.856748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119bec3-cd2d-44d4-bd7e-a981a50c1326 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:12.875238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167a519-e800-45ae-a1e3-9bf47580e60d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:12.879125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167a519-e800-45ae-a1e3-9bf47580e60d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:12.879598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 258/512] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:12.880437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119bec3-cd2d-44d4-bd7e-a981a50c1326 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-e167a519-e800-45ae-a1e3-9bf47580e60d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:12.895778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:12.896760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:12.897644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:12.897644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:12.897644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:12.897644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:12.897644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 255/513] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:12.897922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167a519-e800-45ae-a1e3-9bf47580e60d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:12.935676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:12.997614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119bec3-cd2d-44d4-bd7e-a981a50c1326 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:13.006262 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167a519-e800-45ae-a1e3-9bf47580e60d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:13.008771 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:13.035233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ba41d-e5ef-4bea-9bf3-77a323a7f536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:13.035870 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ba41d-e5ef-4bea-9bf3-77a323a7f536 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:13.036157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ba41d-e5ef-4bea-9bf3-77a323a7f536 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:13.036437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ba41d-e5ef-4bea-9bf3-77a323a7f536 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:13.037273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ba41d-e5ef-4bea-9bf3-77a323a7f536 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:13.037588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ba41d-e5ef-4bea-9bf3-77a323a7f536 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:13.039091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ba41d-e5ef-4bea-9bf3-77a323a7f536 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:13.052132 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561245d9-6d3f-4c6b-b1e6-a5beaf699617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:13.052757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561245d9-6d3f-4c6b-b1e6-a5beaf699617 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:13.053040 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561245d9-6d3f-4c6b-b1e6-a5beaf699617 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:13.053316 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561245d9-6d3f-4c6b-b1e6-a5beaf699617 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:13.054015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561245d9-6d3f-4c6b-b1e6-a5beaf699617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:13.054358 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561245d9-6d3f-4c6b-b1e6-a5beaf699617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:13.055754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561245d9-6d3f-4c6b-b1e6-a5beaf699617 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:13.057527 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 259/514] 10.222.0.43 () {56 vars in 1139 bytes} [Wed Jul 27 10:36:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:13.058404 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ba41d-e5ef-4bea-9bf3-77a323a7f536 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:13.069207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 256/515] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:13.070062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561245d9-6d3f-4c6b-b1e6-a5beaf699617 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:13.167203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:13.170743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ba41d-e5ef-4bea-9bf3-77a323a7f536 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:13.176695 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561245d9-6d3f-4c6b-b1e6-a5beaf699617 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:13.206864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ac073-8acd-4d58-b469-035e73d7a8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:13.207480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ac073-8acd-4d58-b469-035e73d7a8c5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:13.207766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ac073-8acd-4d58-b469-035e73d7a8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:13.208040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ac073-8acd-4d58-b469-035e73d7a8c5 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:13.208763 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ac073-8acd-4d58-b469-035e73d7a8c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:13.209071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ac073-8acd-4d58-b469-035e73d7a8c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:13.210470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ac073-8acd-4d58-b469-035e73d7a8c5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:13.211450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c99a7b-9d61-49e9-b50c-4703934463e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:13.212059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c99a7b-9d61-49e9-b50c-4703934463e3 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:13.212341 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c99a7b-9d61-49e9-b50c-4703934463e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:13.212612 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c99a7b-9d61-49e9-b50c-4703934463e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:13.213385 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c99a7b-9d61-49e9-b50c-4703934463e3 None admin] RBAC: Adding query filter params (role.id=02a6ae14988149d38f9e819dc66b2f48, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=3bb16c9232464cc2aeee12b7fa918b8e) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:13.213691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c99a7b-9d61-49e9-b50c-4703934463e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:13.215130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c99a7b-9d61-49e9-b50c-4703934463e3 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:13.220695 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 257/516] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:13 2022] GET /identity/v3/role_assignments?user.id=3bb16c9232464cc2aeee12b7fa918b8e&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=02a6ae14988149d38f9e819dc66b2f48 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:13.221487 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c99a7b-9d61-49e9-b50c-4703934463e3 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:13.221985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 260/517] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:13.222608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ac073-8acd-4d58-b469-035e73d7a8c5 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:13.265591 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:13.354930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ac073-8acd-4d58-b469-035e73d7a8c5 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:13.359510 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c99a7b-9d61-49e9-b50c-4703934463e3 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:13.396887 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c975a-d7b2-4b2a-96f4-fbb5406f3332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:13.397520 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c975a-d7b2-4b2a-96f4-fbb5406f3332 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:13.397806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c975a-d7b2-4b2a-96f4-fbb5406f3332 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:13.398097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c975a-d7b2-4b2a-96f4-fbb5406f3332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:13.400726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa106bc-1025-40f0-975c-77b0d39f55ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:13.401422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa106bc-1025-40f0-975c-77b0d39f55ab None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:13.401709 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa106bc-1025-40f0-975c-77b0d39f55ab None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:13.401988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa106bc-1025-40f0-975c-77b0d39f55ab None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:13.402725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa106bc-1025-40f0-975c-77b0d39f55ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:13.403035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa106bc-1025-40f0-975c-77b0d39f55ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:13.404450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa106bc-1025-40f0-975c-77b0d39f55ab None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:13.422810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 258/518] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:13.423923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa106bc-1025-40f0-975c-77b0d39f55ab None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:13.430428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:13.483608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c975a-d7b2-4b2a-96f4-fbb5406f3332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:13.485286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c975a-d7b2-4b2a-96f4-fbb5406f3332 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:13.530661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:13.544995 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa106bc-1025-40f0-975c-77b0d39f55ab None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:13.585654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847aa8b-48dd-4c73-b527-4457d64b6ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:13.586333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847aa8b-48dd-4c73-b527-4457d64b6ed2 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:13.587152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847aa8b-48dd-4c73-b527-4457d64b6ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:13.587435 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847aa8b-48dd-4c73-b527-4457d64b6ed2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:13.596060 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847aa8b-48dd-4c73-b527-4457d64b6ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:13.597507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847aa8b-48dd-4c73-b527-4457d64b6ed2 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:13.608812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 261/519] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:36:13.608812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c975a-d7b2-4b2a-96f4-fbb5406f3332 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-2847aa8b-48dd-4c73-b527-4457d64b6ed2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:13.616047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:13.616985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:13.617877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:13.617877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:13.617877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:13.617877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:13.617877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:13.617877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:13.617877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:13.617877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:13.617877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 10:36:13.617877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:13.617877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 259/520] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:36:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:13.618476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847aa8b-48dd-4c73-b527-4457d64b6ed2 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:13.678868 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:13.728287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c975a-d7b2-4b2a-96f4-fbb5406f3332 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:13.734162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847aa8b-48dd-4c73-b527-4457d64b6ed2 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:13.767826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25f1c0-f0a7-472c-a138-a153a3ee29ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:13.768472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f1c0-f0a7-472c-a138-a153a3ee29ab None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:13.768751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f1c0-f0a7-472c-a138-a153a3ee29ab None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:13.769083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f1c0-f0a7-472c-a138-a153a3ee29ab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:13.770748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebadd8-7a85-4486-a3ef-5e1c32e7476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:13.771375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebadd8-7a85-4486-a3ef-5e1c32e7476e None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:13.771663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebadd8-7a85-4486-a3ef-5e1c32e7476e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:13.771969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebadd8-7a85-4486-a3ef-5e1c32e7476e None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:13.772632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebadd8-7a85-4486-a3ef-5e1c32e7476e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:13.774078 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebadd8-7a85-4486-a3ef-5e1c32e7476e None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:13.777047 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25f1c0-f0a7-472c-a138-a153a3ee29ab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:13.778539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25f1c0-f0a7-472c-a138-a153a3ee29ab None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-3f25f1c0-f0a7-472c-a138-a153a3ee29ab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:13.792235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:13.793232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:13.794136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:13.794136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:13.794136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:13.794136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:13.794136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:13.794136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:13.794136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:13.794136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:13.794136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 10:36:13.794136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:13.794136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 262/521] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:36:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:13.794717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25f1c0-f0a7-472c-a138-a153a3ee29ab None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:13.810495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 260/522] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:36:13 2022] POST /identity/v3/users => generated 247 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:36:13.810495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebadd8-7a85-4486-a3ef-5e1c32e7476e None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:13.815510 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:13.962565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25f1c0-f0a7-472c-a138-a153a3ee29ab None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:13.983249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebadd8-7a85-4486-a3ef-5e1c32e7476e None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:13.996843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:14.017983 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742e435-0621-46aa-996c-54ccc28bbd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:14.018919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742e435-0621-46aa-996c-54ccc28bbd42 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:14.019238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742e435-0621-46aa-996c-54ccc28bbd42 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:14.019518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742e435-0621-46aa-996c-54ccc28bbd42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:14.029829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed96afc-e865-4d47-babd-88864d74852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:14.030515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed96afc-e865-4d47-babd-88864d74852f None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:14.030803 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed96afc-e865-4d47-babd-88864d74852f None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:14.033906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed96afc-e865-4d47-babd-88864d74852f None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:14.033906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed96afc-e865-4d47-babd-88864d74852f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:14.034148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed96afc-e865-4d47-babd-88864d74852f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:14.035720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed96afc-e865-4d47-babd-88864d74852f None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:14.036987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742e435-0621-46aa-996c-54ccc28bbd42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:14.038742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742e435-0621-46aa-996c-54ccc28bbd42 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-d742e435-0621-46aa-996c-54ccc28bbd42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:14.057648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:14.058892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:14.059756 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:14.059756 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:14.059756 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:14.059756 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:14.060649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 263/523] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:14.061554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742e435-0621-46aa-996c-54ccc28bbd42 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:14.098126 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 261/524] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Jul 27 10:36:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:14.099701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed96afc-e865-4d47-babd-88864d74852f None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:14.179625 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:14.194581 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742e435-0621-46aa-996c-54ccc28bbd42 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:14.228580 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed96afc-e865-4d47-babd-88864d74852f None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:14.251510 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df211d-7c44-4f75-9b73-39c326978760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:14.252143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df211d-7c44-4f75-9b73-39c326978760 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:14.258219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df211d-7c44-4f75-9b73-39c326978760 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:14.258219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df211d-7c44-4f75-9b73-39c326978760 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:14.258219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df211d-7c44-4f75-9b73-39c326978760 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:14.258219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df211d-7c44-4f75-9b73-39c326978760 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:14.258219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df211d-7c44-4f75-9b73-39c326978760 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:14.292999 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 264/525] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Jul 27 10:36:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:14.293888 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df211d-7c44-4f75-9b73-39c326978760 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:14.305602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b87430-277a-400f-89f2-423e9df88654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:14.306265 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b87430-277a-400f-89f2-423e9df88654 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:14.306553 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b87430-277a-400f-89f2-423e9df88654 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:14.306830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b87430-277a-400f-89f2-423e9df88654 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:14.307539 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b87430-277a-400f-89f2-423e9df88654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:14.308299 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b87430-277a-400f-89f2-423e9df88654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:14.309971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b87430-277a-400f-89f2-423e9df88654 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:14.327350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 262/526] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:14.328980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b87430-277a-400f-89f2-423e9df88654 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:14.343813 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:14.486320 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b87430-277a-400f-89f2-423e9df88654 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:14.521480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df211d-7c44-4f75-9b73-39c326978760 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:14.537482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:14.574356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296ee20-06eb-46a9-9a2a-892bde537fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:14.576489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296ee20-06eb-46a9-9a2a-892bde537fe4 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:14.578037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296ee20-06eb-46a9-9a2a-892bde537fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:14.578998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296ee20-06eb-46a9-9a2a-892bde537fe4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:14.587751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fdaba-35b5-4bfa-9f1d-110d136675bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:14.588803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fdaba-35b5-4bfa-9f1d-110d136675bc None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:14.589089 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fdaba-35b5-4bfa-9f1d-110d136675bc None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:14.594302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fdaba-35b5-4bfa-9f1d-110d136675bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:14.784080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296ee20-06eb-46a9-9a2a-892bde537fe4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:14.788290 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296ee20-06eb-46a9-9a2a-892bde537fe4 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:14.810259 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fdaba-35b5-4bfa-9f1d-110d136675bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:14.814509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fdaba-35b5-4bfa-9f1d-110d136675bc None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:14.880494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:14.999682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 263/527] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:36:15.001291 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296ee20-06eb-46a9-9a2a-892bde537fe4 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:15.014831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 265/528] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:36:15.016948 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fdaba-35b5-4bfa-9f1d-110d136675bc None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:15.038965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:15.143758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296ee20-06eb-46a9-9a2a-892bde537fe4 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:15.147374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fdaba-35b5-4bfa-9f1d-110d136675bc None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:15.184929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:15.193463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f024e-073a-4a22-84a6-378856dbef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:15.194138 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f024e-073a-4a22-84a6-378856dbef7d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:15.194442 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f024e-073a-4a22-84a6-378856dbef7d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:15.194720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f024e-073a-4a22-84a6-378856dbef7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:15.195068 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f2fa0-6552-45be-8222-a5a9cc15d4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:15.195984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f2fa0-6552-45be-8222-a5a9cc15d4de None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:15.196461 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f2fa0-6552-45be-8222-a5a9cc15d4de None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:15.196925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f2fa0-6552-45be-8222-a5a9cc15d4de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:15.205179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f024e-073a-4a22-84a6-378856dbef7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:15.206578 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f024e-073a-4a22-84a6-378856dbef7d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:15.209630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f2fa0-6552-45be-8222-a5a9cc15d4de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:15.211400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f2fa0-6552-45be-8222-a5a9cc15d4de None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-ed8f024e-073a-4a22-84a6-378856dbef7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:15.223252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:15.224427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:15.225859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:15.225859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:15.225859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:15.225859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:15.225859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:15.225859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:15.225859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:15.225859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:15.225859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 264/529] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:15.225859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f024e-073a-4a22-84a6-378856dbef7d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-941f2fa0-6552-45be-8222-a5a9cc15d4de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:15.234349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:15.236203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:15.237407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:15.237407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:15.237407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:15.237407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:15.245864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 266/530] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:15.245864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f2fa0-6552-45be-8222-a5a9cc15d4de None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:15.373268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:15.398564 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f024e-073a-4a22-84a6-378856dbef7d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:15.410821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f2fa0-6552-45be-8222-a5a9cc15d4de None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:15.443337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77871e9a-ee41-4120-ab28-54b41144fcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:15.444264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77871e9a-ee41-4120-ab28-54b41144fcdc None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:15.444749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77871e9a-ee41-4120-ab28-54b41144fcdc None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:15.445223 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77871e9a-ee41-4120-ab28-54b41144fcdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:15.460477 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77871e9a-ee41-4120-ab28-54b41144fcdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:15.464356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77871e9a-ee41-4120-ab28-54b41144fcdc None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:15.467465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b17e5-1bb3-42b7-b800-b9b39b9f0511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:15.468596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b17e5-1bb3-42b7-b800-b9b39b9f0511 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:15.469367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b17e5-1bb3-42b7-b800-b9b39b9f0511 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:15.469873 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b17e5-1bb3-42b7-b800-b9b39b9f0511 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:15.471509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b17e5-1bb3-42b7-b800-b9b39b9f0511 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:15.472004 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b17e5-1bb3-42b7-b800-b9b39b9f0511 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:15.474208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b17e5-1bb3-42b7-b800-b9b39b9f0511 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:15.491100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 267/531] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-77871e9a-ee41-4120-ab28-54b41144fcdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:15.492143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:15.493790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:15.494650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:15.494650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:15.494650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:15.494650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:15.494650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 265/532] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:15.495472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b17e5-1bb3-42b7-b800-b9b39b9f0511 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:15.501420 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77871e9a-ee41-4120-ab28-54b41144fcdc None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:15.556703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:15.626481 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b17e5-1bb3-42b7-b800-b9b39b9f0511 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:15.627382 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77871e9a-ee41-4120-ab28-54b41144fcdc None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:15.667819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc6e0c-3e38-4e73-a284-af006d784a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:15.668450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6e0c-3e38-4e73-a284-af006d784a29 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:15.668735 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6e0c-3e38-4e73-a284-af006d784a29 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:15.669021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6e0c-3e38-4e73-a284-af006d784a29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:15.669808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc6e0c-3e38-4e73-a284-af006d784a29 None admin] RBAC: Adding query filter params (role.id=02a6ae14988149d38f9e819dc66b2f48, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=6b33631df63d4657a8e2ad108ca9f670) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:15.670124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc6e0c-3e38-4e73-a284-af006d784a29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:15.671606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc6e0c-3e38-4e73-a284-af006d784a29 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:15.673333 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d673b-ae5e-4837-a0b1-300d88ad265e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:15.673972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d673b-ae5e-4837-a0b1-300d88ad265e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:15.674235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:15.674336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d673b-ae5e-4837-a0b1-300d88ad265e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:15.674553 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d673b-ae5e-4837-a0b1-300d88ad265e None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:15.675532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d673b-ae5e-4837-a0b1-300d88ad265e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:15.675654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d673b-ae5e-4837-a0b1-300d88ad265e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:15.677381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d673b-ae5e-4837-a0b1-300d88ad265e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:15.686617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 266/533] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:15 2022] GET /identity/v3/role_assignments?user.id=6b33631df63d4657a8e2ad108ca9f670&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=02a6ae14988149d38f9e819dc66b2f48 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:15.689413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0dc9e-ea0b-4701-addb-80888e5607aa None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:15.690822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0dc9e-ea0b-4701-addb-80888e5607aa None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:15.691659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0dc9e-ea0b-4701-addb-80888e5607aa None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:15.693732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 267/534] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:15.694862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0dc9e-ea0b-4701-addb-80888e5607aa None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:15.700446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 268/535] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:15.700446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d673b-ae5e-4837-a0b1-300d88ad265e None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:15.849174 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0dc9e-ea0b-4701-addb-80888e5607aa None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:15.892173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d673b-ae5e-4837-a0b1-300d88ad265e None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:15.892173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:15.904764 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903d43f-5fc7-4955-b772-e071ee517682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:15.905843 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d43f-5fc7-4955-b772-e071ee517682 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:15.906680 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d43f-5fc7-4955-b772-e071ee517682 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:15.907166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d43f-5fc7-4955-b772-e071ee517682 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:15.908181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903d43f-5fc7-4955-b772-e071ee517682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:15.908723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903d43f-5fc7-4955-b772-e071ee517682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:15.910462 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903d43f-5fc7-4955-b772-e071ee517682 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:15.926303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 268/536] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:15.928268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f0430-a51b-4493-bfc5-112e3bc2c2b1 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:15.928976 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f0430-a51b-4493-bfc5-112e3bc2c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:15.929779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f0430-a51b-4493-bfc5-112e3bc2c2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:15.935629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286ba5c-4d6d-43f0-893d-eeaf49b234e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:15.936304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286ba5c-4d6d-43f0-893d-eeaf49b234e8 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:15.936591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286ba5c-4d6d-43f0-893d-eeaf49b234e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:15.936867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286ba5c-4d6d-43f0-893d-eeaf49b234e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:15.946943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286ba5c-4d6d-43f0-893d-eeaf49b234e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:15.948432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286ba5c-4d6d-43f0-893d-eeaf49b234e8 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:15.957255 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-561f0430-a51b-4493-bfc5-112e3bc2c2b1 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:15.958919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-561f0430-a51b-4493-bfc5-112e3bc2c2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-8286ba5c-4d6d-43f0-893d-eeaf49b234e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:15.961218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:15.962071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:15.962961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:15.962961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:15.962961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:15.962961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:15.962961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:15.962961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:15.962961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:15.962961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:15.967186 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 269/537] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:15.968207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286ba5c-4d6d-43f0-893d-eeaf49b234e8 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:16.025932 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:16.050251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 269/538] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:16.050251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f0430-a51b-4493-bfc5-112e3bc2c2b1 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:16.113586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286ba5c-4d6d-43f0-893d-eeaf49b234e8 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:16.150469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5013baf-6f07-48a4-8102-a236fc4834d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:16.151048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5013baf-6f07-48a4-8102-a236fc4834d9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:16.151332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5013baf-6f07-48a4-8102-a236fc4834d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:16.153186 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5013baf-6f07-48a4-8102-a236fc4834d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:16.161419 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5013baf-6f07-48a4-8102-a236fc4834d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:16.162947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5013baf-6f07-48a4-8102-a236fc4834d9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:16.165976 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f0430-a51b-4493-bfc5-112e3bc2c2b1 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-e5013baf-6f07-48a4-8102-a236fc4834d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:16.176480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:16.178287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:16.180083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:16.180083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:16.180083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:16.180083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:16.180083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:16.180083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:16.180083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:16.180083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:16.186222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 270/539] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:16.186222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5013baf-6f07-48a4-8102-a236fc4834d9 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:16.207071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d050a5b-8b56-4b3e-8888-a2b39fade6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:16.207810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d050a5b-8b56-4b3e-8888-a2b39fade6e2 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:16.208102 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d050a5b-8b56-4b3e-8888-a2b39fade6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:16.208389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d050a5b-8b56-4b3e-8888-a2b39fade6e2 None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:16.209152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d050a5b-8b56-4b3e-8888-a2b39fade6e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:16.209516 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d050a5b-8b56-4b3e-8888-a2b39fade6e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:16.210659 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:16.212463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d050a5b-8b56-4b3e-8888-a2b39fade6e2 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:16.237959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 270/540] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:16.239465 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d050a5b-8b56-4b3e-8888-a2b39fade6e2 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:16.296649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:16.299916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5013baf-6f07-48a4-8102-a236fc4834d9 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:16.336503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a464b8e-4def-4ba8-a410-4bf140a0e013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:16.337139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a464b8e-4def-4ba8-a410-4bf140a0e013 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:16.337428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a464b8e-4def-4ba8-a410-4bf140a0e013 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:16.337706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a464b8e-4def-4ba8-a410-4bf140a0e013 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:16.349540 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a464b8e-4def-4ba8-a410-4bf140a0e013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-8a464b8e-4def-4ba8-a410-4bf140a0e013 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:16.355092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:16.356406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:16.357541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:16.357541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:16.357541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:16.357541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:16.357541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:16.357541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:16.357541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:16.357541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:16.357541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:16.357541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:16.357541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:16.357541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:16.361340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 271/541] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:16.362314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a464b8e-4def-4ba8-a410-4bf140a0e013 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:16.372097 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d050a5b-8b56-4b3e-8888-a2b39fade6e2 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:16.420190 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de8ddc-9ef0-460e-a4da-e0f00f02a39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:16.420734 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de8ddc-9ef0-460e-a4da-e0f00f02a39c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:16.421018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de8ddc-9ef0-460e-a4da-e0f00f02a39c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:16.421298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de8ddc-9ef0-460e-a4da-e0f00f02a39c None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:16.422121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de8ddc-9ef0-460e-a4da-e0f00f02a39c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:16.422649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de8ddc-9ef0-460e-a4da-e0f00f02a39c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:16.424429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de8ddc-9ef0-460e-a4da-e0f00f02a39c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:16.438758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 271/542] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:16.440062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61684f11-78f2-491d-801a-5f8f23e092ed None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:16.440353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61684f11-78f2-491d-801a-5f8f23e092ed None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:16.440630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61684f11-78f2-491d-801a-5f8f23e092ed None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:16.442049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 272/543] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:16.446713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61684f11-78f2-491d-801a-5f8f23e092ed None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:16.470943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:16.493850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a464b8e-4def-4ba8-a410-4bf140a0e013 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:16.543683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59c287-796d-4e9b-a9ce-98b6c410c425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:16.544883 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59c287-796d-4e9b-a9ce-98b6c410c425 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:16.545485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59c287-796d-4e9b-a9ce-98b6c410c425 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:16.546061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59c287-796d-4e9b-a9ce-98b6c410c425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:16.548845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59c287-796d-4e9b-a9ce-98b6c410c425 None admin] RBAC: Adding query filter params (role.id=02a6ae14988149d38f9e819dc66b2f48, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=65bd5264306d4d33a2e14b01abb4364a) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:16.549338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59c287-796d-4e9b-a9ce-98b6c410c425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:16.551349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59c287-796d-4e9b-a9ce-98b6c410c425 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:16.566311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 272/544] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:16 2022] GET /identity/v3/role_assignments?user.id=65bd5264306d4d33a2e14b01abb4364a&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=02a6ae14988149d38f9e819dc66b2f48 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:16.566311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59c287-796d-4e9b-a9ce-98b6c410c425 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:16.579726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61684f11-78f2-491d-801a-5f8f23e092ed None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:16.592250 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:16.642070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340db30-c625-45be-beac-ee81e26aa7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:16.642070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340db30-c625-45be-beac-ee81e26aa7d4 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:16.642070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340db30-c625-45be-beac-ee81e26aa7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:16.642070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340db30-c625-45be-beac-ee81e26aa7d4 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:16.642705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340db30-c625-45be-beac-ee81e26aa7d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:16.642705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340db30-c625-45be-beac-ee81e26aa7d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:16.646787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340db30-c625-45be-beac-ee81e26aa7d4 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:16.657721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 273/545] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:16.659685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a8f7f-9bda-44d4-92e4-02411e208030 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:16.660286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a8f7f-9bda-44d4-92e4-02411e208030 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:16.660772 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a8f7f-9bda-44d4-92e4-02411e208030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:16.683087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-379a8f7f-9bda-44d4-92e4-02411e208030 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:16.684999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-379a8f7f-9bda-44d4-92e4-02411e208030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:16.707025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59c287-796d-4e9b-a9ce-98b6c410c425 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:16.750989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f745039-2ae0-4854-a0bc-d7924c861064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:16.751210 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f745039-2ae0-4854-a0bc-d7924c861064 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:16.751847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f745039-2ae0-4854-a0bc-d7924c861064 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:16.751847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f745039-2ae0-4854-a0bc-d7924c861064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:16.752498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f745039-2ae0-4854-a0bc-d7924c861064 None admin] RBAC: Adding query filter params (role.id=02a6ae14988149d38f9e819dc66b2f48, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=bd4e81eb81934784b8632248ecf0894f) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:16.752817 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f745039-2ae0-4854-a0bc-d7924c861064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:16.754360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f745039-2ae0-4854-a0bc-d7924c861064 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:16.760307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 273/546] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:16 2022] GET /identity/v3/role_assignments?user.id=bd4e81eb81934784b8632248ecf0894f&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=02a6ae14988149d38f9e819dc66b2f48 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:16.761165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f745039-2ae0-4854-a0bc-d7924c861064 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:16.788856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:16.796718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 274/547] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:16.865943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a8f7f-9bda-44d4-92e4-02411e208030 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:16.989961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f745039-2ae0-4854-a0bc-d7924c861064 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:17.039842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:17.043539 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a8f7f-9bda-44d4-92e4-02411e208030 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:17.067005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74312f7a-71f9-496d-8ccb-a7148fd64251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:17.067679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74312f7a-71f9-496d-8ccb-a7148fd64251 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:17.067965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74312f7a-71f9-496d-8ccb-a7148fd64251 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:17.068243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74312f7a-71f9-496d-8ccb-a7148fd64251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:17.084919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec283-cc9e-428c-a9dc-04672f7a7cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:17.085579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec283-cc9e-428c-a9dc-04672f7a7cf2 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:17.085866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec283-cc9e-428c-a9dc-04672f7a7cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:17.086142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec283-cc9e-428c-a9dc-04672f7a7cf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:17.089813 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74312f7a-71f9-496d-8ccb-a7148fd64251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:17.091336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74312f7a-71f9-496d-8ccb-a7148fd64251 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-74312f7a-71f9-496d-8ccb-a7148fd64251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:17.117621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:17.118595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:17.119447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:17.119447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:17.119447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:17.119447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:17.119751 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ec283-cc9e-428c-a9dc-04672f7a7cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:17.122570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 274/548] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-a34ec283-cc9e-428c-a9dc-04672f7a7cf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:17.124744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:17.126569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:17.127940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:17.127940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:17.127940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:17.127940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:17.127940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:17.127940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:17.127940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:17.127940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:17.127940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:17.127940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:17.127940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:17.127940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:17.127940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 275/549] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:17.128715 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74312f7a-71f9-496d-8ccb-a7148fd64251 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:17.132859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec283-cc9e-428c-a9dc-04672f7a7cf2 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:17.254664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:17.327120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74312f7a-71f9-496d-8ccb-a7148fd64251 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:17.344909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec283-cc9e-428c-a9dc-04672f7a7cf2 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:17.404263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef5b62-4aa8-4708-a535-e760384070f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:17.404893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef5b62-4aa8-4708-a535-e760384070f5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:17.405172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef5b62-4aa8-4708-a535-e760384070f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:17.405447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef5b62-4aa8-4708-a535-e760384070f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:17.406292 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef5b62-4aa8-4708-a535-e760384070f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:17.407094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef5b62-4aa8-4708-a535-e760384070f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:17.408887 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef5b62-4aa8-4708-a535-e760384070f5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:17.413593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7ce44-2a12-4e56-b4eb-ad57db47becc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:17.414250 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7ce44-2a12-4e56-b4eb-ad57db47becc None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:17.414566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7ce44-2a12-4e56-b4eb-ad57db47becc None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:17.414798 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7ce44-2a12-4e56-b4eb-ad57db47becc None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:17.415526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7ce44-2a12-4e56-b4eb-ad57db47becc None admin] RBAC: Adding query filter params (name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:17.415827 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7ce44-2a12-4e56-b4eb-ad57db47becc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:17.417259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7ce44-2a12-4e56-b4eb-ad57db47becc None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:17.435766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 276/550] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:17.438890 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 275/551] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:17.441240 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7ce44-2a12-4e56-b4eb-ad57db47becc None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:17.445249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef5b62-4aa8-4708-a535-e760384070f5 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:17.500029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:17.652729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7ce44-2a12-4e56-b4eb-ad57db47becc None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:17.658353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef5b62-4aa8-4708-a535-e760384070f5 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:17.714562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:17.728701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce2d92-0753-4f6d-a945-16899f132e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:17.729376 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce2d92-0753-4f6d-a945-16899f132e8b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:17.729654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce2d92-0753-4f6d-a945-16899f132e8b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:17.729925 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce2d92-0753-4f6d-a945-16899f132e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:17.733142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a6204-b42f-4160-8d87-338e21054242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:17.733802 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a6204-b42f-4160-8d87-338e21054242 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:17.734080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a6204-b42f-4160-8d87-338e21054242 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:17.734527 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a6204-b42f-4160-8d87-338e21054242 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:17.752202 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a6204-b42f-4160-8d87-338e21054242 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:17.753675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a6204-b42f-4160-8d87-338e21054242 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:17.757661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce2d92-0753-4f6d-a945-16899f132e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:17.759166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce2d92-0753-4f6d-a945-16899f132e8b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-e54a6204-b42f-4160-8d87-338e21054242 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:17.779436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:17.780531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:17.782113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:17.782113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:17.782113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:17.782113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:17.782113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:17.782113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:17.782113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:17.782113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:17.782113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:36:17.782113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:17.785420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 276/552] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jul 27 10:36:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:17.789401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a6204-b42f-4160-8d87-338e21054242 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-49ce2d92-0753-4f6d-a945-16899f132e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:17.792349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:17.794353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:17.796476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:17.796476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:17.796476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:17.796476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:17.796476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 277/553] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:17.801438 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce2d92-0753-4f6d-a945-16899f132e8b None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:17.946944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:17.969616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a6204-b42f-4160-8d87-338e21054242 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:17.981306 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce2d92-0753-4f6d-a945-16899f132e8b None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:18.011731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecc0ea-4c6e-4bbd-81e0-62d396cbd3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:18.012359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecc0ea-4c6e-4bbd-81e0-62d396cbd3ce None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:18.012909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecc0ea-4c6e-4bbd-81e0-62d396cbd3ce None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:18.013053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecc0ea-4c6e-4bbd-81e0-62d396cbd3ce None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:18.013864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecc0ea-4c6e-4bbd-81e0-62d396cbd3ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:18.014148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecc0ea-4c6e-4bbd-81e0-62d396cbd3ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:18.016238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecc0ea-4c6e-4bbd-81e0-62d396cbd3ce None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:18.026681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fccdb-1af2-4b21-9fe7-6356e9f5ae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:18.028458 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fccdb-1af2-4b21-9fe7-6356e9f5ae57 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:18.028898 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fccdb-1af2-4b21-9fe7-6356e9f5ae57 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:18.029431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fccdb-1af2-4b21-9fe7-6356e9f5ae57 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:18.030326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fccdb-1af2-4b21-9fe7-6356e9f5ae57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:18.030783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fccdb-1af2-4b21-9fe7-6356e9f5ae57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:18.033889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fccdb-1af2-4b21-9fe7-6356e9f5ae57 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:18.037326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 277/554] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jul 27 10:36:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:18.038398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb33c3-f9a0-4cd2-8561-fa4af06142be None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:18.038684 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb33c3-f9a0-4cd2-8561-fa4af06142be None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:18.038957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb33c3-f9a0-4cd2-8561-fa4af06142be None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:18.040470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 278/555] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:18.042257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb33c3-f9a0-4cd2-8561-fa4af06142be None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:18.051031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 278/556] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:18.056405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc714a-26c1-4343-8383-87e6e960ffaf None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:18.056405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc714a-26c1-4343-8383-87e6e960ffaf None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:18.056405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc714a-26c1-4343-8383-87e6e960ffaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:18.076672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-37fc714a-26c1-4343-8383-87e6e960ffaf None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:18.078865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-37fc714a-26c1-4343-8383-87e6e960ffaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:18.104807 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:18.167257 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 279/557] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:18.168511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc714a-26c1-4343-8383-87e6e960ffaf None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:18.184859 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb33c3-f9a0-4cd2-8561-fa4af06142be None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:18.223948 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e51cf4-f44c-43a7-8717-f3806aa88a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:18.224753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e51cf4-f44c-43a7-8717-f3806aa88a6f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:18.224753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e51cf4-f44c-43a7-8717-f3806aa88a6f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:18.225027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e51cf4-f44c-43a7-8717-f3806aa88a6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:18.237395 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e51cf4-f44c-43a7-8717-f3806aa88a6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:18.238892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e51cf4-f44c-43a7-8717-f3806aa88a6f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:18.255216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-a6e51cf4-f44c-43a7-8717-f3806aa88a6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:18.257455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:18.258933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:18.259832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:18.259832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:18.259832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:18.259832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:18.259832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 279/558] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:18.260559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e51cf4-f44c-43a7-8717-f3806aa88a6f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:18.308939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc714a-26c1-4343-8383-87e6e960ffaf None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:18.350933 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12d309-fdba-4e63-ba3a-2a106ccac23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:18.351963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12d309-fdba-4e63-ba3a-2a106ccac23d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:18.352455 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12d309-fdba-4e63-ba3a-2a106ccac23d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:18.353064 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12d309-fdba-4e63-ba3a-2a106ccac23d None admin] PATH_INFO: `/v3/users/swift` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:18.363839 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12d309-fdba-4e63-ba3a-2a106ccac23d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:18.366426 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12d309-fdba-4e63-ba3a-2a106ccac23d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-dd12d309-fdba-4e63-ba3a-2a106ccac23d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:18.382245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:18.383283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:18.384312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:18.384312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:18.384312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:18.384312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:18.384312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:18.384312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:18.384312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:18.384312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:18.384312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 10:36:18.384312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:18.393803 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 280/559] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:36:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:18.393803 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12d309-fdba-4e63-ba3a-2a106ccac23d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:18.412070 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:18.423650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e51cf4-f44c-43a7-8717-f3806aa88a6f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:18.469344 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385093e-64d9-4509-a0fc-347a06544a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:18.470271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385093e-64d9-4509-a0fc-347a06544a16 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:18.470507 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385093e-64d9-4509-a0fc-347a06544a16 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:18.470790 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385093e-64d9-4509-a0fc-347a06544a16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:18.483855 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385093e-64d9-4509-a0fc-347a06544a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-b385093e-64d9-4509-a0fc-347a06544a16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:18.490676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:18.492231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:18.493394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:18.493394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:18.493394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:18.493394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:18.493394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:18.493394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:18.493394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:18.493394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:18.493394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:18.493394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:18.493394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:18.493394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:18.493394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 280/560] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:18.493394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385093e-64d9-4509-a0fc-347a06544a16 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:18.565079 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12d309-fdba-4e63-ba3a-2a106ccac23d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:18.597875 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:18.612136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae254f-d930-4ba3-b8c6-5ea2189ec750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:18.612770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae254f-d930-4ba3-b8c6-5ea2189ec750 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:18.613070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae254f-d930-4ba3-b8c6-5ea2189ec750 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:18.613375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae254f-d930-4ba3-b8c6-5ea2189ec750 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:18.614094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae254f-d930-4ba3-b8c6-5ea2189ec750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:18.614522 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae254f-d930-4ba3-b8c6-5ea2189ec750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:18.615922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae254f-d930-4ba3-b8c6-5ea2189ec750 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:18.630241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 281/561] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:18.631258 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae254f-d930-4ba3-b8c6-5ea2189ec750 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:18.632614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385093e-64d9-4509-a0fc-347a06544a16 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:18.681186 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5aadd-d404-442b-ae8e-2724c65d0bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:18.682691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5aadd-d404-442b-ae8e-2724c65d0bd8 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:18.683196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5aadd-d404-442b-ae8e-2724c65d0bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:18.683929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5aadd-d404-442b-ae8e-2724c65d0bd8 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:18.685635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5aadd-d404-442b-ae8e-2724c65d0bd8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:18.686178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5aadd-d404-442b-ae8e-2724c65d0bd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:18.689003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5aadd-d404-442b-ae8e-2724c65d0bd8 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:18.718440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 281/562] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Jul 27 10:36:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:18.719788 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5aadd-d404-442b-ae8e-2724c65d0bd8 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:18.733736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:18.756912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae254f-d930-4ba3-b8c6-5ea2189ec750 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:18.797731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0cc43-6013-4188-bd2a-b1cdb8f0dcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:18.798496 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0cc43-6013-4188-bd2a-b1cdb8f0dcac None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:18.798785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0cc43-6013-4188-bd2a-b1cdb8f0dcac None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:18.799067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0cc43-6013-4188-bd2a-b1cdb8f0dcac None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:18.799809 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0cc43-6013-4188-bd2a-b1cdb8f0dcac None admin] RBAC: Adding query filter params (name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:18.800118 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0cc43-6013-4188-bd2a-b1cdb8f0dcac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:18.801633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0cc43-6013-4188-bd2a-b1cdb8f0dcac None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:18.812059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 282/563] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:18.813707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0cc43-6013-4188-bd2a-b1cdb8f0dcac None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:18.850648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5aadd-d404-442b-ae8e-2724c65d0bd8 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:18.872908 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:18.888438 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60feb3e-1327-4f9b-acff-f61cbbf9af96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:18.889097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60feb3e-1327-4f9b-acff-f61cbbf9af96 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:18.889375 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60feb3e-1327-4f9b-acff-f61cbbf9af96 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:18.889648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60feb3e-1327-4f9b-acff-f61cbbf9af96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:18.900777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60feb3e-1327-4f9b-acff-f61cbbf9af96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:18.902348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60feb3e-1327-4f9b-acff-f61cbbf9af96 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-e60feb3e-1327-4f9b-acff-f61cbbf9af96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:18.915708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:18.916777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:18.919225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:18.919225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:18.919225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:18.919225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:18.919225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:18.919225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:18.919225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:18.919225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:18.919225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 282/564] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:18.919225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60feb3e-1327-4f9b-acff-f61cbbf9af96 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:18.950880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0cc43-6013-4188-bd2a-b1cdb8f0dcac None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:18.990018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb5df3-9077-4e6e-bb9b-953105fadeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:18.990731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb5df3-9077-4e6e-bb9b-953105fadeef None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:18.991015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb5df3-9077-4e6e-bb9b-953105fadeef None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:18.991294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb5df3-9077-4e6e-bb9b-953105fadeef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:19.002605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:19.042614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60feb3e-1327-4f9b-acff-f61cbbf9af96 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:19.077717 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb5df3-9077-4e6e-bb9b-953105fadeef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:19.080794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb5df3-9077-4e6e-bb9b-953105fadeef None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:19.096196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1647f9-e64a-4287-b44f-1b482dc1db30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:19.098154 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1647f9-e64a-4287-b44f-1b482dc1db30 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:19.099015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1647f9-e64a-4287-b44f-1b482dc1db30 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:19.099549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1647f9-e64a-4287-b44f-1b482dc1db30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:19.118399 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1647f9-e64a-4287-b44f-1b482dc1db30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:19.120695 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1647f9-e64a-4287-b44f-1b482dc1db30 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-fb1647f9-e64a-4287-b44f-1b482dc1db30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:19.150135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:19.151616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:19.152637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:19.152637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:19.152637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:19.152637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:19.153076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 283/565] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:19.154867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c769dd-3549-4841-8395-8cfb5afeaade None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:19.155820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c769dd-3549-4841-8395-8cfb5afeaade None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:19.156815 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c769dd-3549-4841-8395-8cfb5afeaade None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:19.159702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 284/566] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:19.160950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c769dd-3549-4841-8395-8cfb5afeaade None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:19.166390 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:19.232959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 283/567] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:36:19.234983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1174f1-fe1f-4911-b817-9c5379fb0fa1 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:19.235310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1174f1-fe1f-4911-b817-9c5379fb0fa1 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:19.235555 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1174f1-fe1f-4911-b817-9c5379fb0fa1 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:19.236838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 284/568] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:19.237552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1174f1-fe1f-4911-b817-9c5379fb0fa1 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:19.301135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c769dd-3549-4841-8395-8cfb5afeaade None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:19.325657 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:19.338733 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d9afc-f6f8-41d6-9307-71cd54ce1df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:19.339368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9afc-f6f8-41d6-9307-71cd54ce1df5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:19.339652 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9afc-f6f8-41d6-9307-71cd54ce1df5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:19.339929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d9afc-f6f8-41d6-9307-71cd54ce1df5 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:19.340712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d9afc-f6f8-41d6-9307-71cd54ce1df5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:19.341024 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d9afc-f6f8-41d6-9307-71cd54ce1df5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:19.342522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d9afc-f6f8-41d6-9307-71cd54ce1df5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:19.356898 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 285/569] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:19.359025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203aaa3d-e52c-453c-9bb7-c547915e5c9f None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:19.360796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203aaa3d-e52c-453c-9bb7-c547915e5c9f None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:19.361289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203aaa3d-e52c-453c-9bb7-c547915e5c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:19.382055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-203aaa3d-e52c-453c-9bb7-c547915e5c9f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:19.383338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-203aaa3d-e52c-453c-9bb7-c547915e5c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:19.385692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1174f1-fe1f-4911-b817-9c5379fb0fa1 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:19.433788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdaa8a-c3fb-4703-89eb-6fa7239fc01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:19.435206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdaa8a-c3fb-4703-89eb-6fa7239fc01c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:19.435703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdaa8a-c3fb-4703-89eb-6fa7239fc01c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:19.436219 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdaa8a-c3fb-4703-89eb-6fa7239fc01c None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:19.437542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdaa8a-c3fb-4703-89eb-6fa7239fc01c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:19.438096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdaa8a-c3fb-4703-89eb-6fa7239fc01c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:19.440341 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdaa8a-c3fb-4703-89eb-6fa7239fc01c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:19.456922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 285/570] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:19.457788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdaa8a-c3fb-4703-89eb-6fa7239fc01c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:19.478215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 286/571] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:19.478215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e37b0-ebc6-45ea-88a4-5c4489a476ec None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:19.478519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:19.478619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e37b0-ebc6-45ea-88a4-5c4489a476ec None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:19.478619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e37b0-ebc6-45ea-88a4-5c4489a476ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:19.497089 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-ac7e37b0-ebc6-45ea-88a4-5c4489a476ec None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:19.498406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ac7e37b0-ebc6-45ea-88a4-5c4489a476ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:19.573017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 287/572] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:19.573777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e37b0-ebc6-45ea-88a4-5c4489a476ec None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:19.588999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdaa8a-c3fb-4703-89eb-6fa7239fc01c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:19.630577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:19.635929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c0d98-c897-4f21-9a95-150c8fab3eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:19.636581 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c0d98-c897-4f21-9a95-150c8fab3eb1 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:19.636864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c0d98-c897-4f21-9a95-150c8fab3eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:19.637138 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c0d98-c897-4f21-9a95-150c8fab3eb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:19.656384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c0d98-c897-4f21-9a95-150c8fab3eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:19.657886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c0d98-c897-4f21-9a95-150c8fab3eb1 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-001c0d98-c897-4f21-9a95-150c8fab3eb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:19.676584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:19.677647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:19.678679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:19.678679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:19.678679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:19.678679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:19.678923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 286/573] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:19.679947 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c0d98-c897-4f21-9a95-150c8fab3eb1 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:19.703744 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e37b0-ebc6-45ea-88a4-5c4489a476ec None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:19.744432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016bbfe-5add-4892-90d4-4ab683b7ab85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:19.745115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016bbfe-5add-4892-90d4-4ab683b7ab85 None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:19.745398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016bbfe-5add-4892-90d4-4ab683b7ab85 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:19.745673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016bbfe-5add-4892-90d4-4ab683b7ab85 None admin] PATH_INFO: `/v3/projects/52e68e1a140146e28b504864955367c1/users/3bb16c9232464cc2aeee12b7fa918b8e/roles/02a6ae14988149d38f9e819dc66b2f48` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:19.746594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:19.762706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016bbfe-5add-4892-90d4-4ab683b7ab85 None admin] RBAC: Authorizing `identity:create_grant(project_id=52e68e1a140146e28b504864955367c1, user_id=3bb16c9232464cc2aeee12b7fa918b8e, role_id=02a6ae14988149d38f9e819dc66b2f48)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:19.764172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016bbfe-5add-4892-90d4-4ab683b7ab85 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:19.778044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 288/574] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:36:19 2022] PUT /identity/v3/projects/52e68e1a140146e28b504864955367c1/users/3bb16c9232464cc2aeee12b7fa918b8e/roles/02a6ae14988149d38f9e819dc66b2f48 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:36:19.779013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016bbfe-5add-4892-90d4-4ab683b7ab85 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:19.793585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c0d98-c897-4f21-9a95-150c8fab3eb1 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:19.843208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54135171-9174-46e3-95f2-7b763932a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:19.844689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54135171-9174-46e3-95f2-7b763932a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:19.845205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54135171-9174-46e3-95f2-7b763932a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:19.845694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54135171-9174-46e3-95f2-7b763932a3d8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:19.856066 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54135171-9174-46e3-95f2-7b763932a3d8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:19.858071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54135171-9174-46e3-95f2-7b763932a3d8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-54135171-9174-46e3-95f2-7b763932a3d8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:19.877766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:19.878905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:19.879876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:19.879876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:19.879876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:19.879876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:19.879876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:19.879876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:19.879876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:19.879876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:19.879876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 10:36:19.879876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:19.879876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 287/575] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:19.879876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54135171-9174-46e3-95f2-7b763932a3d8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:19.947393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:19.959961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016bbfe-5add-4892-90d4-4ab683b7ab85 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:20.003090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a26f37-975b-4a11-bdd0-e864555e257c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:20.003749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a26f37-975b-4a11-bdd0-e864555e257c None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:20.004034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a26f37-975b-4a11-bdd0-e864555e257c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:20.004305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a26f37-975b-4a11-bdd0-e864555e257c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:20.016379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a26f37-975b-4a11-bdd0-e864555e257c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:20.019080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54135171-9174-46e3-95f2-7b763932a3d8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-36a26f37-975b-4a11-bdd0-e864555e257c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:20.021328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:20.022474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:20.023352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:20.023352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:20.023352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:20.023352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:20.023352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:20.023352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:20.023352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:20.023352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:20.023352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:20.023352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:20.023352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:20.023352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:20.023352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 289/576] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:20.023352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a26f37-975b-4a11-bdd0-e864555e257c None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:20.049494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:20.070061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193c036-0b40-42b8-a48b-187823f5d15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:20.071876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c036-0b40-42b8-a48b-187823f5d15e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:20.071876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c036-0b40-42b8-a48b-187823f5d15e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:20.071876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193c036-0b40-42b8-a48b-187823f5d15e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:20.084626 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193c036-0b40-42b8-a48b-187823f5d15e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-e193c036-0b40-42b8-a48b-187823f5d15e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:20.090173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:20.091163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:20.092032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:20.092032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:20.092032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:20.092032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:20.092032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:20.092032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:20.092032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:20.092032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:20.092032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:20.092032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:20.092032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:20.092032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:20.092032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 288/577] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:20.092836 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193c036-0b40-42b8-a48b-187823f5d15e None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:20.157718 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a26f37-975b-4a11-bdd0-e864555e257c None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:20.205121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881e8ae-01cd-400e-ab59-9682081ccef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:20.205743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881e8ae-01cd-400e-ab59-9682081ccef7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:20.206029 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881e8ae-01cd-400e-ab59-9682081ccef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:20.206339 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881e8ae-01cd-400e-ab59-9682081ccef7 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:20.207058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881e8ae-01cd-400e-ab59-9682081ccef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:20.207364 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881e8ae-01cd-400e-ab59-9682081ccef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:20.208929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881e8ae-01cd-400e-ab59-9682081ccef7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:20.220102 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193c036-0b40-42b8-a48b-187823f5d15e None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:20.223329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 290/578] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:20.223571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881e8ae-01cd-400e-ab59-9682081ccef7 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:20.242867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:20.275046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dbdcd-4d29-4a07-852c-fccb79de3837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:20.275678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dbdcd-4d29-4a07-852c-fccb79de3837 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:20.275963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dbdcd-4d29-4a07-852c-fccb79de3837 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:20.276265 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dbdcd-4d29-4a07-852c-fccb79de3837 None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:20.277046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dbdcd-4d29-4a07-852c-fccb79de3837 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:20.277624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dbdcd-4d29-4a07-852c-fccb79de3837 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:20.278912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dbdcd-4d29-4a07-852c-fccb79de3837 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:20.304001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 289/579] 10.222.0.43 () {56 vars in 1139 bytes} [Wed Jul 27 10:36:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:20.304001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dbdcd-4d29-4a07-852c-fccb79de3837 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:20.343653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:20.354565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881e8ae-01cd-400e-ab59-9682081ccef7 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:20.392324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49720d68-5ad3-444b-853e-ad7fdc2639de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:20.392946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49720d68-5ad3-444b-853e-ad7fdc2639de None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:20.393229 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49720d68-5ad3-444b-853e-ad7fdc2639de None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:20.393501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49720d68-5ad3-444b-853e-ad7fdc2639de None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:20.394446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49720d68-5ad3-444b-853e-ad7fdc2639de None admin] RBAC: Adding query filter params (name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:20.394708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49720d68-5ad3-444b-853e-ad7fdc2639de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:20.396232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49720d68-5ad3-444b-853e-ad7fdc2639de None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:20.409518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 291/580] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:20.409518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49720d68-5ad3-444b-853e-ad7fdc2639de None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:20.419761 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dbdcd-4d29-4a07-852c-fccb79de3837 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:20.456090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bb0ad-0864-4660-825d-e049c8f59e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:20.456762 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bb0ad-0864-4660-825d-e049c8f59e8a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:20.457044 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bb0ad-0864-4660-825d-e049c8f59e8a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:20.457312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bb0ad-0864-4660-825d-e049c8f59e8a None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:20.458066 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bb0ad-0864-4660-825d-e049c8f59e8a None admin] RBAC: Adding query filter params (name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:20.458405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bb0ad-0864-4660-825d-e049c8f59e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:20.459756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bb0ad-0864-4660-825d-e049c8f59e8a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:20.468251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 290/581] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:20.469116 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bb0ad-0864-4660-825d-e049c8f59e8a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:20.499381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:20.527405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49720d68-5ad3-444b-853e-ad7fdc2639de None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:20.564787 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f3004-a03f-47ea-b1f1-0dda449471cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:20.565809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f3004-a03f-47ea-b1f1-0dda449471cf None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:20.566086 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f3004-a03f-47ea-b1f1-0dda449471cf None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:20.566391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f3004-a03f-47ea-b1f1-0dda449471cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:20.573440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f3004-a03f-47ea-b1f1-0dda449471cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:20.574935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f3004-a03f-47ea-b1f1-0dda449471cf None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:20.577323 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:20.581303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bb0ad-0864-4660-825d-e049c8f59e8a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-9b6f3004-a03f-47ea-b1f1-0dda449471cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:20.587124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:20.588104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:20.589031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:20.589031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:20.589031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:20.589031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:20.589031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:20.589031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:20.589031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:20.589031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:20.593071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 292/582] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:20.593923 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f3004-a03f-47ea-b1f1-0dda449471cf None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:20.622385 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668d48-2814-4e54-a803-b23c4516839f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:20.623492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668d48-2814-4e54-a803-b23c4516839f None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:20.624010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668d48-2814-4e54-a803-b23c4516839f None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:20.624504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668d48-2814-4e54-a803-b23c4516839f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:20.641892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10668d48-2814-4e54-a803-b23c4516839f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:20.643393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10668d48-2814-4e54-a803-b23c4516839f None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-10668d48-2814-4e54-a803-b23c4516839f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:20.659877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:20.660816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:20.661732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:20.661732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:20.661732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:20.661732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:20.661732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 291/583] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:20.661732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668d48-2814-4e54-a803-b23c4516839f None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:20.714369 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f3004-a03f-47ea-b1f1-0dda449471cf None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:20.752390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbe726-ed18-486a-88be-212a46ec8d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:20.753036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbe726-ed18-486a-88be-212a46ec8d02 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:20.753319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbe726-ed18-486a-88be-212a46ec8d02 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:20.753594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbe726-ed18-486a-88be-212a46ec8d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:20.755629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:20.765695 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbe726-ed18-486a-88be-212a46ec8d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:20.767262 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbe726-ed18-486a-88be-212a46ec8d02 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:20.777713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10668d48-2814-4e54-a803-b23c4516839f None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-c1dbe726-ed18-486a-88be-212a46ec8d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:20.784076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:20.784985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:20.785874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:20.785874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:20.785874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:20.785874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:20.789893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 293/584] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:20.790694 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbe726-ed18-486a-88be-212a46ec8d02 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:20.815834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6be04-be5a-4329-bf9d-7465c828271a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:20.816917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6be04-be5a-4329-bf9d-7465c828271a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:20.817278 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6be04-be5a-4329-bf9d-7465c828271a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:20.817638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6be04-be5a-4329-bf9d-7465c828271a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:20.830794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6be04-be5a-4329-bf9d-7465c828271a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:20.832288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6be04-be5a-4329-bf9d-7465c828271a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-c6d6be04-be5a-4329-bf9d-7465c828271a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:20.848867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:20.849788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:20.850724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:20.850724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:20.850724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:20.850724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:20.850724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 292/585] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:20.851015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6be04-be5a-4329-bf9d-7465c828271a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:20.853513 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:20.927911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbe726-ed18-486a-88be-212a46ec8d02 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:20.967225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31807833-6603-420c-b26d-8410a5de006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:20.967856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31807833-6603-420c-b26d-8410a5de006f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:20.968141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31807833-6603-420c-b26d-8410a5de006f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:20.968464 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31807833-6603-420c-b26d-8410a5de006f None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:20.969273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31807833-6603-420c-b26d-8410a5de006f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:20.969778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31807833-6603-420c-b26d-8410a5de006f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:20.969966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6be04-be5a-4329-bf9d-7465c828271a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:20.971283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31807833-6603-420c-b26d-8410a5de006f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:20.988989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 294/586] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:20.989903 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31807833-6603-420c-b26d-8410a5de006f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:21.010048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63a41-21df-4360-a7e7-b6678f2ec59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:21.010732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63a41-21df-4360-a7e7-b6678f2ec59b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:21.011057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63a41-21df-4360-a7e7-b6678f2ec59b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:21.011291 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63a41-21df-4360-a7e7-b6678f2ec59b None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:21.011986 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63a41-21df-4360-a7e7-b6678f2ec59b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:21.012296 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63a41-21df-4360-a7e7-b6678f2ec59b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:21.013666 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63a41-21df-4360-a7e7-b6678f2ec59b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:21.026783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 293/587] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:21.027598 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63a41-21df-4360-a7e7-b6678f2ec59b None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:21.044420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:21.095799 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:21.108051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31807833-6603-420c-b26d-8410a5de006f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:21.140233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63a41-21df-4360-a7e7-b6678f2ec59b None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:21.146840 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465956b-3f1f-46c8-ab6f-29b0f36434e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:21.147472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465956b-3f1f-46c8-ab6f-29b0f36434e9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:21.147757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465956b-3f1f-46c8-ab6f-29b0f36434e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:21.148037 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465956b-3f1f-46c8-ab6f-29b0f36434e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:21.148743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465956b-3f1f-46c8-ab6f-29b0f36434e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:21.149050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465956b-3f1f-46c8-ab6f-29b0f36434e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:21.150454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465956b-3f1f-46c8-ab6f-29b0f36434e9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:21.164688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 295/588] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:21.165690 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465956b-3f1f-46c8-ab6f-29b0f36434e9 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:21.183078 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a4e34-1a6d-44ba-9805-904f591cf5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:21.183894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a4e34-1a6d-44ba-9805-904f591cf5a3 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:21.184177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a4e34-1a6d-44ba-9805-904f591cf5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:21.184454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a4e34-1a6d-44ba-9805-904f591cf5a3 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:21.185149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a4e34-1a6d-44ba-9805-904f591cf5a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:21.185454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a4e34-1a6d-44ba-9805-904f591cf5a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:21.187103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a4e34-1a6d-44ba-9805-904f591cf5a3 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:21.203805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 294/589] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:21.203805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a4e34-1a6d-44ba-9805-904f591cf5a3 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:21.283158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465956b-3f1f-46c8-ab6f-29b0f36434e9 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:21.290697 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:21.319602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a4e34-1a6d-44ba-9805-904f591cf5a3 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:21.320651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449da67b-b66d-4154-9795-95ae5d9c83ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:21.321282 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449da67b-b66d-4154-9795-95ae5d9c83ad None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:21.321569 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449da67b-b66d-4154-9795-95ae5d9c83ad None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:21.321845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449da67b-b66d-4154-9795-95ae5d9c83ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:21.322689 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449da67b-b66d-4154-9795-95ae5d9c83ad None admin] RBAC: Adding query filter params (role.id=02a6ae14988149d38f9e819dc66b2f48, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=dc3b05867de6493e94c01e3c478e1d8e) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:21.323007 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449da67b-b66d-4154-9795-95ae5d9c83ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:21.324442 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449da67b-b66d-4154-9795-95ae5d9c83ad None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:21.330703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 296/590] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:21 2022] GET /identity/v3/role_assignments?user.id=dc3b05867de6493e94c01e3c478e1d8e&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=02a6ae14988149d38f9e819dc66b2f48 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:21.331512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449da67b-b66d-4154-9795-95ae5d9c83ad None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:21.356146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:21.374028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6842cef-0b33-456c-903d-8ea6ce26ecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:21.375466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6842cef-0b33-456c-903d-8ea6ce26ecab None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:21.376957 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6842cef-0b33-456c-903d-8ea6ce26ecab None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:21.377501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6842cef-0b33-456c-903d-8ea6ce26ecab None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:21.387733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6842cef-0b33-456c-903d-8ea6ce26ecab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:21.391247 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6842cef-0b33-456c-903d-8ea6ce26ecab None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-a6842cef-0b33-456c-903d-8ea6ce26ecab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:21.408945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:21.409924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:21.410870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:21.410870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:21.410870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:21.410870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:21.410870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:21.410870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:21.410870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:21.410870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:21.415431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 295/591] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:21.416532 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6842cef-0b33-456c-903d-8ea6ce26ecab None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:21.476059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449da67b-b66d-4154-9795-95ae5d9c83ad None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:21.527205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8828fad-01ae-4304-a2bb-2c40c97ea447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:21.527867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8828fad-01ae-4304-a2bb-2c40c97ea447 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:21.528155 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8828fad-01ae-4304-a2bb-2c40c97ea447 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:21.528434 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8828fad-01ae-4304-a2bb-2c40c97ea447 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:21.539862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8828fad-01ae-4304-a2bb-2c40c97ea447 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:21.542023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8828fad-01ae-4304-a2bb-2c40c97ea447 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:21.544807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6842cef-0b33-456c-903d-8ea6ce26ecab None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-f8828fad-01ae-4304-a2bb-2c40c97ea447 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:21.556796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:21.557900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:21.559152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:21.559152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:21.559152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:21.559152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:21.559152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:21.559152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:21.559152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:21.559152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:21.559152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 10:36:21.559152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:21.564686 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 297/592] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:36:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:21.566810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8828fad-01ae-4304-a2bb-2c40c97ea447 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:21.603832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b092e49-fe05-4111-b4df-2d4b450bd2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:21.605040 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b092e49-fe05-4111-b4df-2d4b450bd2b5 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:21.605629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b092e49-fe05-4111-b4df-2d4b450bd2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:21.606278 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b092e49-fe05-4111-b4df-2d4b450bd2b5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:21.622216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b092e49-fe05-4111-b4df-2d4b450bd2b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:21.625527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b092e49-fe05-4111-b4df-2d4b450bd2b5 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:21.628768 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-7b092e49-fe05-4111-b4df-2d4b450bd2b5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:21.643518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:21.645711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:21.648599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:21.648599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:21.648599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:21.648599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:21.648599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:21.648599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:21.648599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:21.648599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:21.648599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 10:36:21.648599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:21.648599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 296/593] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:36:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:21.648599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b092e49-fe05-4111-b4df-2d4b450bd2b5 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:21.698972 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:21.740661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8828fad-01ae-4304-a2bb-2c40c97ea447 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:21.763812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b092e49-fe05-4111-b4df-2d4b450bd2b5 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:21.784319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c8f8d-4793-4ef9-ae8e-d39ff21cf998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:21.785130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8f8d-4793-4ef9-ae8e-d39ff21cf998 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:21.785512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8f8d-4793-4ef9-ae8e-d39ff21cf998 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:21.785889 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c8f8d-4793-4ef9-ae8e-d39ff21cf998 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:21.786897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c8f8d-4793-4ef9-ae8e-d39ff21cf998 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:21.787313 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c8f8d-4793-4ef9-ae8e-d39ff21cf998 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:21.788946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c8f8d-4793-4ef9-ae8e-d39ff21cf998 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:21.808365 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad230c-13d8-4dcb-989a-8d25da03c1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:21.809313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad230c-13d8-4dcb-989a-8d25da03c1b8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:21.809599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad230c-13d8-4dcb-989a-8d25da03c1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:21.809877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad230c-13d8-4dcb-989a-8d25da03c1b8 None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:21.810580 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 298/594] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:21.813348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad230c-13d8-4dcb-989a-8d25da03c1b8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:21.813348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad230c-13d8-4dcb-989a-8d25da03c1b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:21.813831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c8f8d-4793-4ef9-ae8e-d39ff21cf998 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:21.814044 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad230c-13d8-4dcb-989a-8d25da03c1b8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:21.840741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 297/595] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Jul 27 10:36:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:21.841877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad230c-13d8-4dcb-989a-8d25da03c1b8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:21.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:21.942579 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c8f8d-4793-4ef9-ae8e-d39ff21cf998 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:21.964486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:21.968540 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad230c-13d8-4dcb-989a-8d25da03c1b8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:21.980344 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fe157-a3ea-41a7-813c-31b19c35b8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:21.981054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fe157-a3ea-41a7-813c-31b19c35b8c5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:21.981400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fe157-a3ea-41a7-813c-31b19c35b8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:21.981680 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fe157-a3ea-41a7-813c-31b19c35b8c5 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:21.982536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fe157-a3ea-41a7-813c-31b19c35b8c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:21.982844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fe157-a3ea-41a7-813c-31b19c35b8c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:21.985163 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fe157-a3ea-41a7-813c-31b19c35b8c5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:22.005492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ed3bb-2b61-4b0c-81aa-d5fe23e175ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:22.006177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ed3bb-2b61-4b0c-81aa-d5fe23e175ed None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:22.006543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ed3bb-2b61-4b0c-81aa-d5fe23e175ed None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:22.006883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ed3bb-2b61-4b0c-81aa-d5fe23e175ed None admin] PATH_INFO: `/v3/projects/52e68e1a140146e28b504864955367c1/users/6b33631df63d4657a8e2ad108ca9f670/roles/02a6ae14988149d38f9e819dc66b2f48` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:22.009460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 299/596] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Jul 27 10:36:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:22.010642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fe157-a3ea-41a7-813c-31b19c35b8c5 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:22.023534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ed3bb-2b61-4b0c-81aa-d5fe23e175ed None admin] RBAC: Authorizing `identity:create_grant(project_id=52e68e1a140146e28b504864955367c1, user_id=6b33631df63d4657a8e2ad108ca9f670, role_id=02a6ae14988149d38f9e819dc66b2f48)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:22.025062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ed3bb-2b61-4b0c-81aa-d5fe23e175ed None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:22.045109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 298/597] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:36:21 2022] PUT /identity/v3/projects/52e68e1a140146e28b504864955367c1/users/6b33631df63d4657a8e2ad108ca9f670/roles/02a6ae14988149d38f9e819dc66b2f48 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:36:22.045109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda4ea6-9005-4712-9228-375c7f575b39 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:22.045109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda4ea6-9005-4712-9228-375c7f575b39 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:22.045109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda4ea6-9005-4712-9228-375c7f575b39 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:22.045785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 299/598] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:22.047392 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda4ea6-9005-4712-9228-375c7f575b39 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:22.145369 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fe157-a3ea-41a7-813c-31b19c35b8c5 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:22.185148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda4ea6-9005-4712-9228-375c7f575b39 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:22.192141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c755d7f-d9b5-4a15-8486-dce71529fd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:22.193194 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c755d7f-d9b5-4a15-8486-dce71529fd3c None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:22.193676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c755d7f-d9b5-4a15-8486-dce71529fd3c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:22.194161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c755d7f-d9b5-4a15-8486-dce71529fd3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:22.206865 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c755d7f-d9b5-4a15-8486-dce71529fd3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:22.208742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c755d7f-d9b5-4a15-8486-dce71529fd3c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:22.219400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-8c755d7f-d9b5-4a15-8486-dce71529fd3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:22.227559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:22.228565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:22.229564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:22.229564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:22.229564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:22.229564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:22.236098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a625f8-54c3-4fe1-b7ad-dbf03cd2c9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:22.236098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a625f8-54c3-4fe1-b7ad-dbf03cd2c9b3 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:22.236098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a625f8-54c3-4fe1-b7ad-dbf03cd2c9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:22.236098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a625f8-54c3-4fe1-b7ad-dbf03cd2c9b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:22.236763 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 300/599] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:22.238416 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4adb-e3bb-4a1e-87df-487b3e73ff8d None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:22.238932 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4adb-e3bb-4a1e-87df-487b3e73ff8d None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:22.239415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4adb-e3bb-4a1e-87df-487b3e73ff8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:22.248696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a625f8-54c3-4fe1-b7ad-dbf03cd2c9b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:22.250728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a625f8-54c3-4fe1-b7ad-dbf03cd2c9b3 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:22.260386 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-870f4adb-e3bb-4a1e-87df-487b3e73ff8d None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:22.261920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-870f4adb-e3bb-4a1e-87df-487b3e73ff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-c8a625f8-54c3-4fe1-b7ad-dbf03cd2c9b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:22.269094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:22.270046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:22.271491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:22.271491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:22.271491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:22.271491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:22.271491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 300/600] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:22.271777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a625f8-54c3-4fe1-b7ad-dbf03cd2c9b3 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:22.279647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:22.348072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 301/601] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:22.348735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f4adb-e3bb-4a1e-87df-487b3e73ff8d None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:22.419056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a625f8-54c3-4fe1-b7ad-dbf03cd2c9b3 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:22.458557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cb479-fa38-4cd8-b9cb-20b7f7e5617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:22.459543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cb479-fa38-4cd8-b9cb-20b7f7e5617a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:22.460026 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cb479-fa38-4cd8-b9cb-20b7f7e5617a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:22.460516 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cb479-fa38-4cd8-b9cb-20b7f7e5617a None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:22.461425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cb479-fa38-4cd8-b9cb-20b7f7e5617a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:22.462008 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cb479-fa38-4cd8-b9cb-20b7f7e5617a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:22.463683 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cb479-fa38-4cd8-b9cb-20b7f7e5617a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:22.483526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 301/602] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:22.483707 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f4adb-e3bb-4a1e-87df-487b3e73ff8d None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:22.485818 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cb479-fa38-4cd8-b9cb-20b7f7e5617a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:22.524950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:22.537006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aec51f-705a-440b-b849-5afc7bce75d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:22.537798 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aec51f-705a-440b-b849-5afc7bce75d0 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:22.538203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aec51f-705a-440b-b849-5afc7bce75d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:22.539844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aec51f-705a-440b-b849-5afc7bce75d0 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:22.540663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aec51f-705a-440b-b849-5afc7bce75d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:22.541095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aec51f-705a-440b-b849-5afc7bce75d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:22.543277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aec51f-705a-440b-b849-5afc7bce75d0 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:22.556297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 302/603] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:22.557414 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aec51f-705a-440b-b849-5afc7bce75d0 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:22.567028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:22.611048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cb479-fa38-4cd8-b9cb-20b7f7e5617a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:22.649042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499d1f0-3a13-45bf-964f-e17f7b5dae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:22.649922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499d1f0-3a13-45bf-964f-e17f7b5dae92 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:22.650360 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499d1f0-3a13-45bf-964f-e17f7b5dae92 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:22.650736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499d1f0-3a13-45bf-964f-e17f7b5dae92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:22.663774 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499d1f0-3a13-45bf-964f-e17f7b5dae92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-a499d1f0-3a13-45bf-964f-e17f7b5dae92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:22.669635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:22.670789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:22.672213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:22.672213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:22.672213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:22.672213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:22.672213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:22.672213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:22.672213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:22.672213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:22.672213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:22.672213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:22.672213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:22.672213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:22.678216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 302/604] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:22.678216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499d1f0-3a13-45bf-964f-e17f7b5dae92 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:22.711061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aec51f-705a-440b-b849-5afc7bce75d0 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:22.747850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae634d-979f-4bcc-9915-7136b31c9f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:22.748643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae634d-979f-4bcc-9915-7136b31c9f5a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:22.749021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae634d-979f-4bcc-9915-7136b31c9f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:22.749390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae634d-979f-4bcc-9915-7136b31c9f5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:22.757425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae634d-979f-4bcc-9915-7136b31c9f5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:22.759059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae634d-979f-4bcc-9915-7136b31c9f5a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-ecae634d-979f-4bcc-9915-7136b31c9f5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:22.771130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:22.772199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:22.773179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:22.773179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:22.773179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:22.773179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:22.773179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:22.773179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:22.773179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:22.773179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:22.778803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 303/605] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:22.779774 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae634d-979f-4bcc-9915-7136b31c9f5a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:22.819635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499d1f0-3a13-45bf-964f-e17f7b5dae92 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:22.840241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:22.846719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:22.861526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea24aa1-e58e-4068-9e46-42eba003a493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:22.862421 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea24aa1-e58e-4068-9e46-42eba003a493 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:22.862720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea24aa1-e58e-4068-9e46-42eba003a493 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:22.863092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea24aa1-e58e-4068-9e46-42eba003a493 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:22.877051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea24aa1-e58e-4068-9e46-42eba003a493 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:22.878854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea24aa1-e58e-4068-9e46-42eba003a493 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-4ea24aa1-e58e-4068-9e46-42eba003a493 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:22.894483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:22.895418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:22.896313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:22.896313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:22.896313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:22.896313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:22.896313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:22.896313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:22.896313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:22.896313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:22.898850 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 303/606] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:22.900018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea24aa1-e58e-4068-9e46-42eba003a493 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:22.910925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae634d-979f-4bcc-9915-7136b31c9f5a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:22.957557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcba9ba-e5bb-4755-a714-0948f19435a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:22.958202 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcba9ba-e5bb-4755-a714-0948f19435a5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:22.958487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcba9ba-e5bb-4755-a714-0948f19435a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:22.958758 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcba9ba-e5bb-4755-a714-0948f19435a5 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:22.959872 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcba9ba-e5bb-4755-a714-0948f19435a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:22.960180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcba9ba-e5bb-4755-a714-0948f19435a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:22.961557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcba9ba-e5bb-4755-a714-0948f19435a5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:22.978256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 304/607] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:22.979700 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcba9ba-e5bb-4755-a714-0948f19435a5 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:23.032404 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea24aa1-e58e-4068-9e46-42eba003a493 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:23.079853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9c7af-ffdf-42e9-a58f-e18381c35c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:23.080494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c7af-ffdf-42e9-a58f-e18381c35c8c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:23.080774 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c7af-ffdf-42e9-a58f-e18381c35c8c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:23.081049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c7af-ffdf-42e9-a58f-e18381c35c8c None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:23.081809 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9c7af-ffdf-42e9-a58f-e18381c35c8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:23.082115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9c7af-ffdf-42e9-a58f-e18381c35c8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:23.083682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9c7af-ffdf-42e9-a58f-e18381c35c8c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:23.098273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcba9ba-e5bb-4755-a714-0948f19435a5 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:23.107464 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 304/608] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:23.107464 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9c7af-ffdf-42e9-a58f-e18381c35c8c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:23.119428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:23.153470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ececcdd-e993-41b1-b18d-163acd120d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:23.154156 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ececcdd-e993-41b1-b18d-163acd120d33 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:23.154466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ececcdd-e993-41b1-b18d-163acd120d33 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:23.154742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ececcdd-e993-41b1-b18d-163acd120d33 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:23.155514 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ececcdd-e993-41b1-b18d-163acd120d33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:23.155849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ececcdd-e993-41b1-b18d-163acd120d33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:23.157614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ececcdd-e993-41b1-b18d-163acd120d33 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:23.164248 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:23.177066 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 305/609] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:23.178615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ececcdd-e993-41b1-b18d-163acd120d33 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:23.246600 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9c7af-ffdf-42e9-a58f-e18381c35c8c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:23.296023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed629e2-763f-433d-92ce-4ef19b3a5ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:23.297210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed629e2-763f-433d-92ce-4ef19b3a5ed9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:23.297503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed629e2-763f-433d-92ce-4ef19b3a5ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:23.297780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed629e2-763f-433d-92ce-4ef19b3a5ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:23.302807 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ececcdd-e993-41b1-b18d-163acd120d33 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:23.311532 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed629e2-763f-433d-92ce-4ef19b3a5ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:23.314655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed629e2-763f-433d-92ce-4ef19b3a5ed9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-8ed629e2-763f-433d-92ce-4ef19b3a5ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:23.337526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:23.338800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:23.339945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:23.339945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:23.339945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:23.339945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:23.339945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 305/610] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:23.339945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed629e2-763f-433d-92ce-4ef19b3a5ed9 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:23.354630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c18ba-5b31-4895-bee6-49e4d7ef968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:23.355747 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c18ba-5b31-4895-bee6-49e4d7ef968b None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:23.356792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c18ba-5b31-4895-bee6-49e4d7ef968b None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:23.357299 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c18ba-5b31-4895-bee6-49e4d7ef968b None admin] PATH_INFO: `/v3/projects/52e68e1a140146e28b504864955367c1/users/65bd5264306d4d33a2e14b01abb4364a/roles/02a6ae14988149d38f9e819dc66b2f48` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:23.381530 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c18ba-5b31-4895-bee6-49e4d7ef968b None admin] RBAC: Authorizing `identity:create_grant(project_id=52e68e1a140146e28b504864955367c1, user_id=65bd5264306d4d33a2e14b01abb4364a, role_id=02a6ae14988149d38f9e819dc66b2f48)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:23.384260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c18ba-5b31-4895-bee6-49e4d7ef968b None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:23.413486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 306/611] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:36:23 2022] PUT /identity/v3/projects/52e68e1a140146e28b504864955367c1/users/65bd5264306d4d33a2e14b01abb4364a/roles/02a6ae14988149d38f9e819dc66b2f48 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:36:23.415617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c18ba-5b31-4895-bee6-49e4d7ef968b None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:23.475254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:23.533642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:23.542217 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed629e2-763f-433d-92ce-4ef19b3a5ed9 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:23.598874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06c464-9ae1-486e-b3b5-9a0dec358993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:23.600797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06c464-9ae1-486e-b3b5-9a0dec358993 None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:23.600797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06c464-9ae1-486e-b3b5-9a0dec358993 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:23.600797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06c464-9ae1-486e-b3b5-9a0dec358993 None admin] PATH_INFO: `/v3/projects/52e68e1a140146e28b504864955367c1/users/bd4e81eb81934784b8632248ecf0894f/roles/02a6ae14988149d38f9e819dc66b2f48` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:23.619147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c18ba-5b31-4895-bee6-49e4d7ef968b None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:23.632321 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06c464-9ae1-486e-b3b5-9a0dec358993 None admin] RBAC: Authorizing `identity:create_grant(project_id=52e68e1a140146e28b504864955367c1, user_id=bd4e81eb81934784b8632248ecf0894f, role_id=02a6ae14988149d38f9e819dc66b2f48)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:23.633905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06c464-9ae1-486e-b3b5-9a0dec358993 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:23.658288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 306/612] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:36:23 2022] PUT /identity/v3/projects/52e68e1a140146e28b504864955367c1/users/bd4e81eb81934784b8632248ecf0894f/roles/02a6ae14988149d38f9e819dc66b2f48 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:36:23.661074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df929e-dfbc-4528-b95f-9168f5031b1d None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:23.662034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df929e-dfbc-4528-b95f-9168f5031b1d None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:23.663085 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df929e-dfbc-4528-b95f-9168f5031b1d None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:23.665136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d79da-6f4b-4336-ba44-d652e2359aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:23.665863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d79da-6f4b-4336-ba44-d652e2359aee None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:23.666230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d79da-6f4b-4336-ba44-d652e2359aee None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:23.666583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d79da-6f4b-4336-ba44-d652e2359aee None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:23.667395 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 307/613] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:23.667619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d79da-6f4b-4336-ba44-d652e2359aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:23.667973 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d79da-6f4b-4336-ba44-d652e2359aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:23.669585 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d79da-6f4b-4336-ba44-d652e2359aee None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:23.674758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf270623-296d-42f3-bdfd-c15c3cacfdbc None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:23.675520 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf270623-296d-42f3-bdfd-c15c3cacfdbc None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:23.676558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf270623-296d-42f3-bdfd-c15c3cacfdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:23.688632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 307/614] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:23.694550 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d79da-6f4b-4336-ba44-d652e2359aee None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:23.717072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-bf270623-296d-42f3-bdfd-c15c3cacfdbc None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:23.718980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-bf270623-296d-42f3-bdfd-c15c3cacfdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:23.883339 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:23.884732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 308/615] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:23.904744 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d79da-6f4b-4336-ba44-d652e2359aee None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:23.921141 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf270623-296d-42f3-bdfd-c15c3cacfdbc None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:23.951928 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ae739-4674-417f-b4f0-6c57ec680a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:23.953275 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ae739-4674-417f-b4f0-6c57ec680a99 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:23.954212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ae739-4674-417f-b4f0-6c57ec680a99 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:23.954870 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ae739-4674-417f-b4f0-6c57ec680a99 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:23.966198 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ae739-4674-417f-b4f0-6c57ec680a99 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:23.969414 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ae739-4674-417f-b4f0-6c57ec680a99 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-665ae739-4674-417f-b4f0-6c57ec680a99 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:23.987355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:23.988379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:23.989329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:23.989329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:23.989329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:23.989329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:23.989329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:23.989329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:23.989329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:23.989329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:23.989329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:36:23.989329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:23.992875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 308/616] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jul 27 10:36:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:23.998117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ae739-4674-417f-b4f0-6c57ec680a99 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:24.055023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:24.108081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf270623-296d-42f3-bdfd-c15c3cacfdbc None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:24.148035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ae739-4674-417f-b4f0-6c57ec680a99 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:24.192805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fa324-dc49-4308-8f62-50cb135a906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:24.193475 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fa324-dc49-4308-8f62-50cb135a906b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:24.193760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fa324-dc49-4308-8f62-50cb135a906b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:24.194045 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fa324-dc49-4308-8f62-50cb135a906b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:24.198574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4028f4-723d-4aa2-ad72-16beb34c24b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:24.199202 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4028f4-723d-4aa2-ad72-16beb34c24b1 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:24.199491 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4028f4-723d-4aa2-ad72-16beb34c24b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:24.199770 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4028f4-723d-4aa2-ad72-16beb34c24b1 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:24.200592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4028f4-723d-4aa2-ad72-16beb34c24b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:24.200904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4028f4-723d-4aa2-ad72-16beb34c24b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:24.202376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4028f4-723d-4aa2-ad72-16beb34c24b1 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:24.217557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fa324-dc49-4308-8f62-50cb135a906b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-7b5fa324-dc49-4308-8f62-50cb135a906b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:24.224098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:24.225017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:24.225854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:24.225854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:24.225854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:24.225854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:24.225854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:24.225854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:24.225854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:24.225854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:24.225854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:24.225854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:24.225854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:24.225854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:24.225854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 309/617] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:24.231370 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fa324-dc49-4308-8f62-50cb135a906b None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:24.241240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:24.252808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 309/618] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jul 27 10:36:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:24.258517 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4028f4-723d-4aa2-ad72-16beb34c24b1 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:24.345981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fa324-dc49-4308-8f62-50cb135a906b None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:24.386552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe71e6-70ba-4c8d-8543-3d76d633e468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:24.387184 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe71e6-70ba-4c8d-8543-3d76d633e468 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:24.387470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe71e6-70ba-4c8d-8543-3d76d633e468 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:24.387746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe71e6-70ba-4c8d-8543-3d76d633e468 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:24.388474 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe71e6-70ba-4c8d-8543-3d76d633e468 None admin] RBAC: Adding query filter params (name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:24.388784 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe71e6-70ba-4c8d-8543-3d76d633e468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:24.390209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe71e6-70ba-4c8d-8543-3d76d633e468 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:24.391864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:24.404902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 310/619] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:24.406878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458254b-0b79-4a91-b5f3-f1609a18dd18 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:24.407171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458254b-0b79-4a91-b5f3-f1609a18dd18 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:24.407428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4028f4-723d-4aa2-ad72-16beb34c24b1 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:24.407540 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458254b-0b79-4a91-b5f3-f1609a18dd18 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:24.409055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 311/620] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:24.409792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458254b-0b79-4a91-b5f3-f1609a18dd18 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:24.466532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e435e-7263-4038-af89-351106809bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:24.467215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e435e-7263-4038-af89-351106809bc3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:24.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e435e-7263-4038-af89-351106809bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:24.467779 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e435e-7263-4038-af89-351106809bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:24.525069 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458254b-0b79-4a91-b5f3-f1609a18dd18 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:24.561000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:24.563649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e435e-7263-4038-af89-351106809bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:24.564227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49393d87-7176-48bc-99db-650b1588f328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:24.564896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49393d87-7176-48bc-99db-650b1588f328 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:24.565181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49393d87-7176-48bc-99db-650b1588f328 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:24.565461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49393d87-7176-48bc-99db-650b1588f328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:24.566259 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e435e-7263-4038-af89-351106809bc3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:24.583769 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49393d87-7176-48bc-99db-650b1588f328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:24.585397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49393d87-7176-48bc-99db-650b1588f328 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-49393d87-7176-48bc-99db-650b1588f328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:24.602636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:24.603615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:24.604545 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:24.604545 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:24.604545 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:24.604545 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:24.604545 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 312/621] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:24.608713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcea7d7-0d03-40e8-8eef-c84483397ac1 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:24.608713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcea7d7-0d03-40e8-8eef-c84483397ac1 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:24.608713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcea7d7-0d03-40e8-8eef-c84483397ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:24.627183 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-adcea7d7-0d03-40e8-8eef-c84483397ac1 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:24.628544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-adcea7d7-0d03-40e8-8eef-c84483397ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:24.681855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:24.682056 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 310/622] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 10:36:24.682890 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e435e-7263-4038-af89-351106809bc3 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:24.716889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 313/623] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:24.718114 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcea7d7-0d03-40e8-8eef-c84483397ac1 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:24.812482 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:24.816081 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e435e-7263-4038-af89-351106809bc3 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:24.835517 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcea7d7-0d03-40e8-8eef-c84483397ac1 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:24.857424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0644b-3acb-4464-ac67-5b5aeca66f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:24.858154 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0644b-3acb-4464-ac67-5b5aeca66f39 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:24.858537 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0644b-3acb-4464-ac67-5b5aeca66f39 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:24.859313 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0644b-3acb-4464-ac67-5b5aeca66f39 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:24.860116 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0644b-3acb-4464-ac67-5b5aeca66f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:24.860937 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0644b-3acb-4464-ac67-5b5aeca66f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:24.862970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0644b-3acb-4464-ac67-5b5aeca66f39 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:24.881664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 311/624] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:24.882918 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0644b-3acb-4464-ac67-5b5aeca66f39 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:24.886691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cee7ab-fa44-47a9-926b-9d8d50a8751b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:24.888183 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee7ab-fa44-47a9-926b-9d8d50a8751b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:24.895531 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee7ab-fa44-47a9-926b-9d8d50a8751b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:24.896094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cee7ab-fa44-47a9-926b-9d8d50a8751b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:24.909474 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cee7ab-fa44-47a9-926b-9d8d50a8751b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:24.911426 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cee7ab-fa44-47a9-926b-9d8d50a8751b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-81cee7ab-fa44-47a9-926b-9d8d50a8751b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:24.930606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:24.931757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:24.932812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:24.932812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:24.932812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:24.932812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:24.935115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 314/625] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:24.936061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cee7ab-fa44-47a9-926b-9d8d50a8751b None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:24.971350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:24.995653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0644b-3acb-4464-ac67-5b5aeca66f39 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:25.032146 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd220713-32d2-434f-949a-f353751d92fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:25.032893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd220713-32d2-434f-949a-f353751d92fa None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:25.033548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd220713-32d2-434f-949a-f353751d92fa None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:25.033548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd220713-32d2-434f-949a-f353751d92fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:25.046079 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd220713-32d2-434f-949a-f353751d92fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-cd220713-32d2-434f-949a-f353751d92fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:25.053028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:25.054258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:25.055519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:25.055519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:25.055519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:25.055519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:25.055519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:25.055519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:25.055519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:25.055519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:25.055519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:25.055519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:25.055519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:25.055519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:25.055519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 312/626] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:25.055519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd220713-32d2-434f-949a-f353751d92fa None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:25.062447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cee7ab-fa44-47a9-926b-9d8d50a8751b None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:25.086343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:25.106377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cd301-8dd3-4dbb-8b45-2c770897bff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:25.107414 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cd301-8dd3-4dbb-8b45-2c770897bff0 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:25.107838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cd301-8dd3-4dbb-8b45-2c770897bff0 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:25.108252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cd301-8dd3-4dbb-8b45-2c770897bff0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:25.117753 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cd301-8dd3-4dbb-8b45-2c770897bff0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:25.119450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5cd301-8dd3-4dbb-8b45-2c770897bff0 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-6c5cd301-8dd3-4dbb-8b45-2c770897bff0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:25.132725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:25.133883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:25.134942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:25.134942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:25.134942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:25.134942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:25.134942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:25.134942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:25.134942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:25.134942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:25.134942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 10:36:25.134942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:25.137110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 315/627] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:36:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:25.138121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cd301-8dd3-4dbb-8b45-2c770897bff0 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:25.177733 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd220713-32d2-434f-949a-f353751d92fa None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:25.215938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe874-5b4f-41af-a73c-2076ac2265b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:25.216542 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe874-5b4f-41af-a73c-2076ac2265b3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:25.216885 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe874-5b4f-41af-a73c-2076ac2265b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:25.217214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe874-5b4f-41af-a73c-2076ac2265b3 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:25.218033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe874-5b4f-41af-a73c-2076ac2265b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:25.218584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe874-5b4f-41af-a73c-2076ac2265b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:25.220595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe874-5b4f-41af-a73c-2076ac2265b3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:25.235373 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 313/628] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:25.236173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe874-5b4f-41af-a73c-2076ac2265b3 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:25.251185 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:25.263344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cd301-8dd3-4dbb-8b45-2c770897bff0 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:25.302785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d84da0-8744-458f-97a7-b771faafe30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:25.303658 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d84da0-8744-458f-97a7-b771faafe30d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:25.304081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d84da0-8744-458f-97a7-b771faafe30d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:25.304588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d84da0-8744-458f-97a7-b771faafe30d None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:25.305512 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d84da0-8744-458f-97a7-b771faafe30d None admin] RBAC: Adding query filter params (name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:25.306042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d84da0-8744-458f-97a7-b771faafe30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:25.307579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d84da0-8744-458f-97a7-b771faafe30d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:25.318349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 316/629] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:25.319394 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d84da0-8744-458f-97a7-b771faafe30d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:25.326656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:25.348011 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe874-5b4f-41af-a73c-2076ac2265b3 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:25.387275 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308794b-c29d-4942-80fb-fb20ba16cf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:25.388081 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308794b-c29d-4942-80fb-fb20ba16cf07 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:25.388331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308794b-c29d-4942-80fb-fb20ba16cf07 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:25.388716 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308794b-c29d-4942-80fb-fb20ba16cf07 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:25.389630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308794b-c29d-4942-80fb-fb20ba16cf07 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:25.389999 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308794b-c29d-4942-80fb-fb20ba16cf07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:25.391751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308794b-c29d-4942-80fb-fb20ba16cf07 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:25.416689 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 314/630] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Jul 27 10:36:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:25.417725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308794b-c29d-4942-80fb-fb20ba16cf07 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:25.445908 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d84da0-8744-458f-97a7-b771faafe30d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:25.493003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a72f8-9b04-42c2-81ad-625ee81b5be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:25.493889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a72f8-9b04-42c2-81ad-625ee81b5be2 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:25.494398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a72f8-9b04-42c2-81ad-625ee81b5be2 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:25.494932 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a72f8-9b04-42c2-81ad-625ee81b5be2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:25.503621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a72f8-9b04-42c2-81ad-625ee81b5be2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:25.505439 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a72f8-9b04-42c2-81ad-625ee81b5be2 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-cc1a72f8-9b04-42c2-81ad-625ee81b5be2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:25.519950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:25.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:25.522055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:25.522055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:25.522055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:25.522055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:25.522055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:25.522055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:25.522055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:25.522055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:25.524281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 317/631] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:25.525304 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a72f8-9b04-42c2-81ad-625ee81b5be2 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:25.527947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308794b-c29d-4942-80fb-fb20ba16cf07 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:25.548488 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:25.567952 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5d9ee-3dd9-4bad-8cd1-a2f430207bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:25.568704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d9ee-3dd9-4bad-8cd1-a2f430207bc7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:25.568995 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d9ee-3dd9-4bad-8cd1-a2f430207bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:25.569278 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d9ee-3dd9-4bad-8cd1-a2f430207bc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:25.576523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:25.581284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5d9ee-3dd9-4bad-8cd1-a2f430207bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:25.583347 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5d9ee-3dd9-4bad-8cd1-a2f430207bc7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-7bd5d9ee-3dd9-4bad-8cd1-a2f430207bc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:25.601792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:25.603166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:25.604249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:25.604249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:25.604249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:25.604249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:25.609603 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 315/632] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:25.610776 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5d9ee-3dd9-4bad-8cd1-a2f430207bc7 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:25.655310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a72f8-9b04-42c2-81ad-625ee81b5be2 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:25.699915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf31a68-692c-4ec3-8937-aa0d78dd71d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:25.700896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf31a68-692c-4ec3-8937-aa0d78dd71d5 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:25.701399 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf31a68-692c-4ec3-8937-aa0d78dd71d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:25.701845 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf31a68-692c-4ec3-8937-aa0d78dd71d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:25.715148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf31a68-692c-4ec3-8937-aa0d78dd71d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:25.716954 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf31a68-692c-4ec3-8937-aa0d78dd71d5 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:25.725507 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5d9ee-3dd9-4bad-8cd1-a2f430207bc7 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-2bf31a68-692c-4ec3-8937-aa0d78dd71d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:25.735572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:25.736494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:25.737393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:25.737393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:25.737393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:25.737393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:25.739646 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 318/633] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:25.740581 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf31a68-692c-4ec3-8937-aa0d78dd71d5 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:25.768427 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a931ac-fbe1-453e-87a1-715b02b213af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:25.768975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a931ac-fbe1-453e-87a1-715b02b213af None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:25.769262 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a931ac-fbe1-453e-87a1-715b02b213af None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:25.769544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a931ac-fbe1-453e-87a1-715b02b213af None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:25.770447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a931ac-fbe1-453e-87a1-715b02b213af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:25.770765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a931ac-fbe1-453e-87a1-715b02b213af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:25.772310 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a931ac-fbe1-453e-87a1-715b02b213af None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:25.786061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 316/634] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:25.786935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a931ac-fbe1-453e-87a1-715b02b213af None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:25.824999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:25.844756 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:25.867243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf31a68-692c-4ec3-8937-aa0d78dd71d5 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:25.903098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db1227-40b1-44b6-b5b7-4d7af5e90df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:25.903757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db1227-40b1-44b6-b5b7-4d7af5e90df7 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:25.904136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db1227-40b1-44b6-b5b7-4d7af5e90df7 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:25.904249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db1227-40b1-44b6-b5b7-4d7af5e90df7 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:25.904917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db1227-40b1-44b6-b5b7-4d7af5e90df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:25.905220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db1227-40b1-44b6-b5b7-4d7af5e90df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:25.907208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db1227-40b1-44b6-b5b7-4d7af5e90df7 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:25.911698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a931ac-fbe1-453e-87a1-715b02b213af None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:25.919210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 319/635] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:25.924199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e43292-23b3-4ae1-a578-4d9a22581b05 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:25.925137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e43292-23b3-4ae1-a578-4d9a22581b05 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:25.925425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e43292-23b3-4ae1-a578-4d9a22581b05 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:25.926838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 320/636] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:25.927654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e43292-23b3-4ae1-a578-4d9a22581b05 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:25.950404 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600fdae-1179-48b0-bef0-21abd8f41a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:25.951346 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600fdae-1179-48b0-bef0-21abd8f41a3b None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:25.951809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600fdae-1179-48b0-bef0-21abd8f41a3b None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:25.952241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600fdae-1179-48b0-bef0-21abd8f41a3b None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:25.952957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600fdae-1179-48b0-bef0-21abd8f41a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:25.953265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600fdae-1179-48b0-bef0-21abd8f41a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:25.954784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600fdae-1179-48b0-bef0-21abd8f41a3b None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:25.966686 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 317/637] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:25.967634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600fdae-1179-48b0-bef0-21abd8f41a3b None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:26.048102 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e43292-23b3-4ae1-a578-4d9a22581b05 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:26.071759 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:26.077355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600fdae-1179-48b0-bef0-21abd8f41a3b None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:26.083289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef1453-6e22-4bf2-a260-b4030ba552c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:26.083912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef1453-6e22-4bf2-a260-b4030ba552c1 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:26.084199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef1453-6e22-4bf2-a260-b4030ba552c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:26.084477 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef1453-6e22-4bf2-a260-b4030ba552c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:26.085268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef1453-6e22-4bf2-a260-b4030ba552c1 None admin] RBAC: Adding query filter params (role.id=02a6ae14988149d38f9e819dc66b2f48, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=3bb16c9232464cc2aeee12b7fa918b8e) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:26.085581 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef1453-6e22-4bf2-a260-b4030ba552c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:26.087041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef1453-6e22-4bf2-a260-b4030ba552c1 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:26.087948 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:26.092959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 321/638] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:25 2022] GET /identity/v3/role_assignments?user.id=3bb16c9232464cc2aeee12b7fa918b8e&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=02a6ae14988149d38f9e819dc66b2f48 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:26.094730 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901379c-54e2-4778-a32e-b05e8e5615dc None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:26.095057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901379c-54e2-4778-a32e-b05e8e5615dc None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:26.095290 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901379c-54e2-4778-a32e-b05e8e5615dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:26.116943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c005bf4-eefb-49d7-84d2-6c90cb667d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:26.117612 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005bf4-eefb-49d7-84d2-6c90cb667d3f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:26.117896 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005bf4-eefb-49d7-84d2-6c90cb667d3f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:26.118171 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005bf4-eefb-49d7-84d2-6c90cb667d3f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:26.127593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-8901379c-54e2-4778-a32e-b05e8e5615dc None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:26.128245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c005bf4-eefb-49d7-84d2-6c90cb667d3f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:26.128834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8901379c-54e2-4778-a32e-b05e8e5615dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:26.129940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c005bf4-eefb-49d7-84d2-6c90cb667d3f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-5c005bf4-eefb-49d7-84d2-6c90cb667d3f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:26.143486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:26.144704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:26.145878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:26.145878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:26.145878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:26.145878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:26.145878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:26.145878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:26.145878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:26.145878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:26.145878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 10:36:26.145878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:26.147657 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 318/639] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:26.148471 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c005bf4-eefb-49d7-84d2-6c90cb667d3f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:26.216132 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 322/640] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:26.217621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b077e94-e1b8-4502-b623-c9a9bc08d217 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:26.218002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b077e94-e1b8-4502-b623-c9a9bc08d217 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:26.218936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b077e94-e1b8-4502-b623-c9a9bc08d217 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:26.220553 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 323/641] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:26.221209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b077e94-e1b8-4502-b623-c9a9bc08d217 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:26.278325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c005bf4-eefb-49d7-84d2-6c90cb667d3f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:26.326175 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fce0ca-565e-4c10-b415-b5e62d032f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:26.326784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fce0ca-565e-4c10-b415-b5e62d032f8d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:26.327074 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fce0ca-565e-4c10-b415-b5e62d032f8d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:26.327355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fce0ca-565e-4c10-b415-b5e62d032f8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:26.335924 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fce0ca-565e-4c10-b415-b5e62d032f8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:26.337406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fce0ca-565e-4c10-b415-b5e62d032f8d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-89fce0ca-565e-4c10-b415-b5e62d032f8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:26.349984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:26.351237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:26.352297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:26.352297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:26.352297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:26.352297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:26.352297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:26.352297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:26.352297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:26.352297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:26.352297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 319/642] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:26.352900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd202bc4-f6ce-4390-ae2f-3eb93e4d234b None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:26.352900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd202bc4-f6ce-4390-ae2f-3eb93e4d234b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:26.352900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd202bc4-f6ce-4390-ae2f-3eb93e4d234b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:26.360440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b077e94-e1b8-4502-b623-c9a9bc08d217 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:26.373564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-dd202bc4-f6ce-4390-ae2f-3eb93e4d234b None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:26.375433 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-dd202bc4-f6ce-4390-ae2f-3eb93e4d234b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:26.380272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:26.398578 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21690e45-8cc7-4050-8d80-701c6a08ed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:26.399628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21690e45-8cc7-4050-8d80-701c6a08ed2d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:26.400013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21690e45-8cc7-4050-8d80-701c6a08ed2d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:26.400586 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21690e45-8cc7-4050-8d80-701c6a08ed2d None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:26.401951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21690e45-8cc7-4050-8d80-701c6a08ed2d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:26.402384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21690e45-8cc7-4050-8d80-701c6a08ed2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:26.404027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21690e45-8cc7-4050-8d80-701c6a08ed2d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:26.405472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:26.429926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 324/643] 10.222.0.43 () {56 vars in 1139 bytes} [Wed Jul 27 10:36:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:26.429926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21690e45-8cc7-4050-8d80-701c6a08ed2d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:26.463611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 320/644] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:26.464559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd202bc4-f6ce-4390-ae2f-3eb93e4d234b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:26.549174 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21690e45-8cc7-4050-8d80-701c6a08ed2d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:26.579709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd202bc4-f6ce-4390-ae2f-3eb93e4d234b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:26.586509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1bfd9-91bb-45fd-82b7-c8d3bea1eb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:26.587165 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1bfd9-91bb-45fd-82b7-c8d3bea1eb98 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:26.587566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1bfd9-91bb-45fd-82b7-c8d3bea1eb98 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:26.587847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1bfd9-91bb-45fd-82b7-c8d3bea1eb98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:26.599657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1bfd9-91bb-45fd-82b7-c8d3bea1eb98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-30f1bfd9-91bb-45fd-82b7-c8d3bea1eb98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:26.605139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:26.606135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:26.607152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:26.607152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:26.607152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:26.607152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:26.607152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:26.607152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:26.607152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:26.607152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:26.607152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:26.607152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:26.607152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:26.607152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:26.607152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 325/645] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:26.607872 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1bfd9-91bb-45fd-82b7-c8d3bea1eb98 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:26.622467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf430f9-1a75-479d-9913-327a70ac8270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:26.623100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf430f9-1a75-479d-9913-327a70ac8270 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:26.623385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf430f9-1a75-479d-9913-327a70ac8270 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:26.623654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf430f9-1a75-479d-9913-327a70ac8270 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:26.624513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf430f9-1a75-479d-9913-327a70ac8270 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:26.624814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf430f9-1a75-479d-9913-327a70ac8270 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:26.626424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf430f9-1a75-479d-9913-327a70ac8270 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:26.645781 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 321/646] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:26.646774 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf430f9-1a75-479d-9913-327a70ac8270 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:26.649664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:26.671508 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:26.726213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1bfd9-91bb-45fd-82b7-c8d3bea1eb98 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:26.763350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6218c1b-573e-408c-b6b1-194242166c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:26.764047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6218c1b-573e-408c-b6b1-194242166c4a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:26.764256 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6218c1b-573e-408c-b6b1-194242166c4a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:26.764530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6218c1b-573e-408c-b6b1-194242166c4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:26.770464 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf430f9-1a75-479d-9913-327a70ac8270 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:26.806931 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826be739-71e9-45de-ae4c-69449ba28ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:26.807515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826be739-71e9-45de-ae4c-69449ba28ebf None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:26.807800 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826be739-71e9-45de-ae4c-69449ba28ebf None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:26.808058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826be739-71e9-45de-ae4c-69449ba28ebf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:26.820080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826be739-71e9-45de-ae4c-69449ba28ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-826be739-71e9-45de-ae4c-69449ba28ebf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:26.825469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:26.826880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:26.829169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:26.829169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:26.829169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:26.829169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:26.829169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:26.829169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:26.829169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:26.829169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:26.829169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:26.829169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:26.829169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:26.829169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:26.832467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 322/647] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:26.833352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826be739-71e9-45de-ae4c-69449ba28ebf None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:26.848011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6218c1b-573e-408c-b6b1-194242166c4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:26.849568 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6218c1b-573e-408c-b6b1-194242166c4a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:26.897130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:26.927982 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:26.950920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826be739-71e9-45de-ae4c-69449ba28ebf None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:26.979727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 326/648] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:36:26.979727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6218c1b-573e-408c-b6b1-194242166c4a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:26.994485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c30e16-073e-4340-a782-0e2849528b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:26.995208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c30e16-073e-4340-a782-0e2849528b8a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:26.995501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c30e16-073e-4340-a782-0e2849528b8a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:26.995780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c30e16-073e-4340-a782-0e2849528b8a None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:26.996529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c30e16-073e-4340-a782-0e2849528b8a None admin] RBAC: Adding query filter params (name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:26.996841 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c30e16-073e-4340-a782-0e2849528b8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:26.998313 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c30e16-073e-4340-a782-0e2849528b8a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:27.007079 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 323/649] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:27.007879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c30e16-073e-4340-a782-0e2849528b8a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:27.092666 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6218c1b-573e-408c-b6b1-194242166c4a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:27.115923 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c30e16-073e-4340-a782-0e2849528b8a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:27.148683 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9df1ba-609c-458b-a46d-5b4724c8d088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:27.149621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9df1ba-609c-458b-a46d-5b4724c8d088 None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:27.150304 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9df1ba-609c-458b-a46d-5b4724c8d088 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:27.150658 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9df1ba-609c-458b-a46d-5b4724c8d088 None admin] PATH_INFO: `/v3/projects/52e68e1a140146e28b504864955367c1/users/dc3b05867de6493e94c01e3c478e1d8e/roles/02a6ae14988149d38f9e819dc66b2f48` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:27.155146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:27.159245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473327a-29a0-4dfc-bea9-1e4a86aba776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:27.159965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473327a-29a0-4dfc-bea9-1e4a86aba776 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:27.160324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473327a-29a0-4dfc-bea9-1e4a86aba776 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:27.160674 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473327a-29a0-4dfc-bea9-1e4a86aba776 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:27.161494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473327a-29a0-4dfc-bea9-1e4a86aba776 None admin] RBAC: Adding query filter params (name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:27.161880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473327a-29a0-4dfc-bea9-1e4a86aba776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:27.163406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473327a-29a0-4dfc-bea9-1e4a86aba776 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:27.170343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9df1ba-609c-458b-a46d-5b4724c8d088 None admin] RBAC: Authorizing `identity:create_grant(project_id=52e68e1a140146e28b504864955367c1, user_id=dc3b05867de6493e94c01e3c478e1d8e, role_id=02a6ae14988149d38f9e819dc66b2f48)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:27.171943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9df1ba-609c-458b-a46d-5b4724c8d088 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:27.177691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 324/650] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:27.177691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473327a-29a0-4dfc-bea9-1e4a86aba776 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:27.180273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:27.192414 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 327/651] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:36:26 2022] PUT /identity/v3/projects/52e68e1a140146e28b504864955367c1/users/dc3b05867de6493e94c01e3c478e1d8e/roles/02a6ae14988149d38f9e819dc66b2f48 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:36:27.193543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9df1ba-609c-458b-a46d-5b4724c8d088 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:27.304868 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473327a-29a0-4dfc-bea9-1e4a86aba776 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:27.317022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9df1ba-609c-458b-a46d-5b4724c8d088 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:27.355691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae52439-a909-4f1a-a06b-2c1ff1455c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:27.356992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae52439-a909-4f1a-a06b-2c1ff1455c15 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:27.357732 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae52439-a909-4f1a-a06b-2c1ff1455c15 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:27.358164 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae52439-a909-4f1a-a06b-2c1ff1455c15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:27.362485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ed56b-f7a0-4ff4-953c-4cdca7bbd733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:27.363247 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed56b-f7a0-4ff4-953c-4cdca7bbd733 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:27.363603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed56b-f7a0-4ff4-953c-4cdca7bbd733 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:27.363947 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ed56b-f7a0-4ff4-953c-4cdca7bbd733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:27.373062 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae52439-a909-4f1a-a06b-2c1ff1455c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:27.375513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae52439-a909-4f1a-a06b-2c1ff1455c15 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:27.376606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ed56b-f7a0-4ff4-953c-4cdca7bbd733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:27.378071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ed56b-f7a0-4ff4-953c-4cdca7bbd733 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-0ae52439-a909-4f1a-a06b-2c1ff1455c15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:27.395247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:27.396359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:27.397466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:27.397466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:27.397466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:27.397466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-d92ed56b-f7a0-4ff4-953c-4cdca7bbd733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:27.397723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:27.398703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:27.399901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:27.399901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:27.399901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:27.399901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:27.399901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 328/652] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:27.401794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 325/653] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:27.404341 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ed56b-f7a0-4ff4-953c-4cdca7bbd733 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:27.405399 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae52439-a909-4f1a-a06b-2c1ff1455c15 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:27.457041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:27.474074 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:27.535272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ed56b-f7a0-4ff4-953c-4cdca7bbd733 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:27.535473 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae52439-a909-4f1a-a06b-2c1ff1455c15 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:27.572164 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8beef-801d-4849-8e92-92a3db8e0230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:27.572754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7879094-ac37-4b69-a8c7-8892535358dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:27.572886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8beef-801d-4849-8e92-92a3db8e0230 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:27.573058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8beef-801d-4849-8e92-92a3db8e0230 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:27.573336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8beef-801d-4849-8e92-92a3db8e0230 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:27.574046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8beef-801d-4849-8e92-92a3db8e0230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:27.574353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7879094-ac37-4b69-a8c7-8892535358dc None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:27.574458 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8beef-801d-4849-8e92-92a3db8e0230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:27.574920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7879094-ac37-4b69-a8c7-8892535358dc None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:27.575510 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7879094-ac37-4b69-a8c7-8892535358dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:27.575752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8beef-801d-4849-8e92-92a3db8e0230 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:27.589063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7879094-ac37-4b69-a8c7-8892535358dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:27.591302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7879094-ac37-4b69-a8c7-8892535358dc None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:27.593913 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 326/654] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:27.594742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8beef-801d-4849-8e92-92a3db8e0230 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-f7879094-ac37-4b69-a8c7-8892535358dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:27.614447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:27.615378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:27.616288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:27.616288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:27.616288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:27.616288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:27.623001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 329/655] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:27.624958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7879094-ac37-4b69-a8c7-8892535358dc None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:27.704118 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8beef-801d-4849-8e92-92a3db8e0230 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:27.721971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:27.728194 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:27.744271 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7879094-ac37-4b69-a8c7-8892535358dc None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:27.751190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54332641-8d56-4286-9093-6a2af03c1165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:27.751832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54332641-8d56-4286-9093-6a2af03c1165 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:27.752115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54332641-8d56-4286-9093-6a2af03c1165 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:27.752400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54332641-8d56-4286-9093-6a2af03c1165 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:27.753117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54332641-8d56-4286-9093-6a2af03c1165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:27.753429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54332641-8d56-4286-9093-6a2af03c1165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:27.754865 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54332641-8d56-4286-9093-6a2af03c1165 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:27.769572 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 327/656] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:27.770497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54332641-8d56-4286-9093-6a2af03c1165 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:27.788917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef9202-7214-41e2-a6db-baf885dd0b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:27.789945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef9202-7214-41e2-a6db-baf885dd0b0e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:27.790497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef9202-7214-41e2-a6db-baf885dd0b0e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:27.791043 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef9202-7214-41e2-a6db-baf885dd0b0e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:27.800569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef9202-7214-41e2-a6db-baf885dd0b0e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:27.802393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef9202-7214-41e2-a6db-baf885dd0b0e None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-e1ef9202-7214-41e2-a6db-baf885dd0b0e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:27.816354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:27.817369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:27.818362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:27.818362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:27.818362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:27.818362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:27.818362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:27.818362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:27.818362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:27.818362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:27.818362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 10:36:27.818362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:27.820988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 330/657] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:36:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:27.822050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef9202-7214-41e2-a6db-baf885dd0b0e None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:27.888795 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54332641-8d56-4286-9093-6a2af03c1165 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:27.927785 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185344c3-69be-451f-899d-df3a1d0684e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:27.928427 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185344c3-69be-451f-899d-df3a1d0684e6 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:27.928715 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185344c3-69be-451f-899d-df3a1d0684e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:27.928996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185344c3-69be-451f-899d-df3a1d0684e6 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:27.929811 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185344c3-69be-451f-899d-df3a1d0684e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:27.930127 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185344c3-69be-451f-899d-df3a1d0684e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:27.931650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185344c3-69be-451f-899d-df3a1d0684e6 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:27.950454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 328/658] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:27.950454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185344c3-69be-451f-899d-df3a1d0684e6 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:27.956714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef9202-7214-41e2-a6db-baf885dd0b0e None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:27.985344 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:27.994835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4c0a3-d84e-4220-a860-163d7a5ad82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:27.996148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4c0a3-d84e-4220-a860-163d7a5ad82c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:27.996679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4c0a3-d84e-4220-a860-163d7a5ad82c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:27.997174 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4c0a3-d84e-4220-a860-163d7a5ad82c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:28.006034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4c0a3-d84e-4220-a860-163d7a5ad82c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:28.007851 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4c0a3-d84e-4220-a860-163d7a5ad82c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-6fc4c0a3-d84e-4220-a860-163d7a5ad82c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:28.020603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:28.021567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:28.022497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:28.022497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:28.022497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:28.022497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:28.022497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:28.022497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:28.022497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:28.022497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:28.025001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 331/659] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:28.026123 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4c0a3-d84e-4220-a860-163d7a5ad82c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:28.040145 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:28.062666 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185344c3-69be-451f-899d-df3a1d0684e6 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:28.102482 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b385d-dac7-4f93-b345-14f2b2ebd9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:28.102967 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b385d-dac7-4f93-b345-14f2b2ebd9c0 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:28.103252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b385d-dac7-4f93-b345-14f2b2ebd9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:28.103535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b385d-dac7-4f93-b345-14f2b2ebd9c0 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:28.104352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b385d-dac7-4f93-b345-14f2b2ebd9c0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:28.104664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b385d-dac7-4f93-b345-14f2b2ebd9c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:28.106115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b385d-dac7-4f93-b345-14f2b2ebd9c0 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:28.131276 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 329/660] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Jul 27 10:36:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:28.132045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b385d-dac7-4f93-b345-14f2b2ebd9c0 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:28.141902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4c0a3-d84e-4220-a860-163d7a5ad82c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:28.178587 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc28da3-08b2-4e70-89e5-d8abd059456a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:28.179631 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28da3-08b2-4e70-89e5-d8abd059456a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:28.180163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28da3-08b2-4e70-89e5-d8abd059456a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:28.180655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc28da3-08b2-4e70-89e5-d8abd059456a None admin] PATH_INFO: `/v3/users/glance` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:28.190166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc28da3-08b2-4e70-89e5-d8abd059456a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:28.191935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc28da3-08b2-4e70-89e5-d8abd059456a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-fdc28da3-08b2-4e70-89e5-d8abd059456a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:28.205084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:28.206090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:28.207146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:28.207146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:28.207146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:28.207146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:28.207146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:28.207146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:28.207146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:28.207146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:28.207146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 10:36:28.207146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:28.214431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 332/661] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:36:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:28.215738 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc28da3-08b2-4e70-89e5-d8abd059456a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:28.237191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:28.245916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b385d-dac7-4f93-b345-14f2b2ebd9c0 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:28.285327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ce572-7c9f-4600-b180-26d13ffc817f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:28.285949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce572-7c9f-4600-b180-26d13ffc817f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:28.286261 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce572-7c9f-4600-b180-26d13ffc817f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:28.286539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ce572-7c9f-4600-b180-26d13ffc817f None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:28.287301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ce572-7c9f-4600-b180-26d13ffc817f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:28.287613 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ce572-7c9f-4600-b180-26d13ffc817f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:28.289282 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ce572-7c9f-4600-b180-26d13ffc817f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:28.292891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:28.307901 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 330/662] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:28.309061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ce572-7c9f-4600-b180-26d13ffc817f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:28.331447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc28da3-08b2-4e70-89e5-d8abd059456a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:28.369101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e98546-50db-441a-9cb9-3988a68b4fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:28.369752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e98546-50db-441a-9cb9-3988a68b4fbd None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:28.370031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e98546-50db-441a-9cb9-3988a68b4fbd None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:28.370446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e98546-50db-441a-9cb9-3988a68b4fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:28.424906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ce572-7c9f-4600-b180-26d13ffc817f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:28.454871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e98546-50db-441a-9cb9-3988a68b4fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:28.456419 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e98546-50db-441a-9cb9-3988a68b4fbd None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:28.464699 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fa9f9-ea2d-450a-a835-4dff74f66913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:28.465416 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa9f9-ea2d-450a-a835-4dff74f66913 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:28.465766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa9f9-ea2d-450a-a835-4dff74f66913 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:28.466112 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa9f9-ea2d-450a-a835-4dff74f66913 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:28.467019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fa9f9-ea2d-450a-a835-4dff74f66913 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:28.467400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fa9f9-ea2d-450a-a835-4dff74f66913 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:28.469211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fa9f9-ea2d-450a-a835-4dff74f66913 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:28.492196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 331/663] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Jul 27 10:36:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:28.492196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c39d12-1eaa-4622-88e2-1097d3e62984 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:28.492196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c39d12-1eaa-4622-88e2-1097d3e62984 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:28.492196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c39d12-1eaa-4622-88e2-1097d3e62984 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:28.492196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 332/664] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:28.492196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c39d12-1eaa-4622-88e2-1097d3e62984 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:28.507874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:28.538435 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:28.574035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 333/665] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:36:28.575187 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e98546-50db-441a-9cb9-3988a68b4fbd None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:28.613414 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c39d12-1eaa-4622-88e2-1097d3e62984 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:28.651630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487405f-24ce-4f1c-b692-fef1da3315a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:28.652401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487405f-24ce-4f1c-b692-fef1da3315a4 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:28.652821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487405f-24ce-4f1c-b692-fef1da3315a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:28.653181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487405f-24ce-4f1c-b692-fef1da3315a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:28.654100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487405f-24ce-4f1c-b692-fef1da3315a4 None admin] RBAC: Adding query filter params (role.id=02a6ae14988149d38f9e819dc66b2f48, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=6b33631df63d4657a8e2ad108ca9f670) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:28.654448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487405f-24ce-4f1c-b692-fef1da3315a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:28.656197 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487405f-24ce-4f1c-b692-fef1da3315a4 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:28.663157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 333/666] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:28 2022] GET /identity/v3/role_assignments?user.id=6b33631df63d4657a8e2ad108ca9f670&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=02a6ae14988149d38f9e819dc66b2f48 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:28.665425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c68777-e0f0-4299-acb4-2732e299c7ea None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:28.665916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c68777-e0f0-4299-acb4-2732e299c7ea None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:28.666576 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c68777-e0f0-4299-acb4-2732e299c7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:28.693124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e98546-50db-441a-9cb9-3988a68b4fbd None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:28.694397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-52c68777-e0f0-4299-acb4-2732e299c7ea None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:28.697502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-52c68777-e0f0-4299-acb4-2732e299c7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:28.736558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9628d7d-3521-41ee-ac88-fd6c123c968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:28.737211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9628d7d-3521-41ee-ac88-fd6c123c968f None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:28.737496 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9628d7d-3521-41ee-ac88-fd6c123c968f None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:28.737772 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9628d7d-3521-41ee-ac88-fd6c123c968f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:28.787422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:28.821968 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 334/667] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:28.823361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c68777-e0f0-4299-acb4-2732e299c7ea None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:28.830407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9628d7d-3521-41ee-ac88-fd6c123c968f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:28.831893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9628d7d-3521-41ee-ac88-fd6c123c968f None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:28.833321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:28.967283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 334/668] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:36:28.969250 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9628d7d-3521-41ee-ac88-fd6c123c968f None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:28.976476 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c68777-e0f0-4299-acb4-2732e299c7ea None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:29.016551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19afda-3087-4d53-8551-8ca4a6c6c8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:29.017207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19afda-3087-4d53-8551-8ca4a6c6c8f9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:29.017493 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19afda-3087-4d53-8551-8ca4a6c6c8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:29.017817 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19afda-3087-4d53-8551-8ca4a6c6c8f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:29.029683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19afda-3087-4d53-8551-8ca4a6c6c8f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:29.031516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19afda-3087-4d53-8551-8ca4a6c6c8f9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-cc19afda-3087-4d53-8551-8ca4a6c6c8f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:29.048669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:29.049643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:29.050978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:29.050978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:29.050978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:29.050978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:29.050978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 335/669] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:29.050978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19afda-3087-4d53-8551-8ca4a6c6c8f9 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:29.072776 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:29.117840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9628d7d-3521-41ee-ac88-fd6c123c968f None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:29.132165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:29.157810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686abc2-b9e6-4f5a-9b80-ab0b898c5d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:29.158355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686abc2-b9e6-4f5a-9b80-ab0b898c5d8e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:29.158642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686abc2-b9e6-4f5a-9b80-ab0b898c5d8e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:29.158918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686abc2-b9e6-4f5a-9b80-ab0b898c5d8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:29.170559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686abc2-b9e6-4f5a-9b80-ab0b898c5d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-3686abc2-b9e6-4f5a-9b80-ab0b898c5d8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:29.176067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:29.177012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:29.178451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:29.178451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:29.178451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:29.178451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:29.178451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:29.178451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:29.178451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:29.178451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:29.178451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:29.178451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:29.178451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:36:29.178451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:29.178451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 335/670] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:36:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:29.178451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686abc2-b9e6-4f5a-9b80-ab0b898c5d8e None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:29.194343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19afda-3087-4d53-8551-8ca4a6c6c8f9 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:29.243837 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6ff02-21f6-4226-af6c-eab64f446c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:29.245415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6ff02-21f6-4226-af6c-eab64f446c4c None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:29.246049 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6ff02-21f6-4226-af6c-eab64f446c4c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:29.246629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6ff02-21f6-4226-af6c-eab64f446c4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:29.267504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6ff02-21f6-4226-af6c-eab64f446c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:29.268988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6ff02-21f6-4226-af6c-eab64f446c4c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-0de6ff02-21f6-4226-af6c-eab64f446c4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:29.289856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:29.291027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:29.291921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:29.291921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:29.291921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:29.291921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:29.300333 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 336/671] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:29.300333 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6ff02-21f6-4226-af6c-eab64f446c4c None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:29.309225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686abc2-b9e6-4f5a-9b80-ab0b898c5d8e None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:29.350032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:29.356572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711013d-f0e3-4902-9ba3-f8e188f13ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:29.357203 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711013d-f0e3-4902-9ba3-f8e188f13ee0 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:29.357488 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711013d-f0e3-4902-9ba3-f8e188f13ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:29.357807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711013d-f0e3-4902-9ba3-f8e188f13ee0 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:29.358523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711013d-f0e3-4902-9ba3-f8e188f13ee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:29.358846 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711013d-f0e3-4902-9ba3-f8e188f13ee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:29.360217 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711013d-f0e3-4902-9ba3-f8e188f13ee0 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:29.378660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 336/672] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:29.378660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711013d-f0e3-4902-9ba3-f8e188f13ee0 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:29.436188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6ff02-21f6-4226-af6c-eab64f446c4c None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:29.448142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:29.475829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec59988-03ee-468e-9b58-bb69ea5d1e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:29.476450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec59988-03ee-468e-9b58-bb69ea5d1e0e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:29.476735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec59988-03ee-468e-9b58-bb69ea5d1e0e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:29.477016 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec59988-03ee-468e-9b58-bb69ea5d1e0e None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:29.477830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec59988-03ee-468e-9b58-bb69ea5d1e0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:29.478060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec59988-03ee-468e-9b58-bb69ea5d1e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:29.479483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec59988-03ee-468e-9b58-bb69ea5d1e0e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:29.494483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 337/673] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:29.494483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64e023-db1d-4f3a-9757-e0c41b325da0 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:29.494483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64e023-db1d-4f3a-9757-e0c41b325da0 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:29.494483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64e023-db1d-4f3a-9757-e0c41b325da0 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:29.494483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 338/674] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:29.494483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64e023-db1d-4f3a-9757-e0c41b325da0 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:29.506882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711013d-f0e3-4902-9ba3-f8e188f13ee0 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:29.543349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f479203-ed38-4116-b7df-7646f91a4ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:29.544140 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f479203-ed38-4116-b7df-7646f91a4ba0 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:29.544268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f479203-ed38-4116-b7df-7646f91a4ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:29.544514 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f479203-ed38-4116-b7df-7646f91a4ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:29.545210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f479203-ed38-4116-b7df-7646f91a4ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:29.545515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f479203-ed38-4116-b7df-7646f91a4ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:29.547737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f479203-ed38-4116-b7df-7646f91a4ba0 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:29.565947 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 337/675] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:29.565947 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f479203-ed38-4116-b7df-7646f91a4ba0 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:29.615202 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64e023-db1d-4f3a-9757-e0c41b325da0 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:29.623936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:29.654608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1761e-3056-4b00-8a50-a616b13bb35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:29.655257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1761e-3056-4b00-8a50-a616b13bb35c None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:29.656151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1761e-3056-4b00-8a50-a616b13bb35c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:29.656428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1761e-3056-4b00-8a50-a616b13bb35c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:29.663481 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1761e-3056-4b00-8a50-a616b13bb35c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:29.664934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1761e-3056-4b00-8a50-a616b13bb35c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-59b1761e-3056-4b00-8a50-a616b13bb35c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:29.678050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:29.679354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:29.680309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:29.680309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:29.680309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:29.680309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:29.680309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:29.680309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:29.680309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:29.680309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:29.680309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 339/676] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:29.680799 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb72d2-cdfa-48ed-ac0a-c974d86a47a7 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:29.681148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb72d2-cdfa-48ed-ac0a-c974d86a47a7 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:29.681343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb72d2-cdfa-48ed-ac0a-c974d86a47a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:29.691662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f479203-ed38-4116-b7df-7646f91a4ba0 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:29.700402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-2fcb72d2-cdfa-48ed-ac0a-c974d86a47a7 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:29.701976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-2fcb72d2-cdfa-48ed-ac0a-c974d86a47a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:29.728851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:29.731452 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd66c22-6ba8-4980-bdb2-8c50eabaec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:29.732184 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd66c22-6ba8-4980-bdb2-8c50eabaec04 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:29.732813 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd66c22-6ba8-4980-bdb2-8c50eabaec04 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:29.733382 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd66c22-6ba8-4980-bdb2-8c50eabaec04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:29.746062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd66c22-6ba8-4980-bdb2-8c50eabaec04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:29.747548 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd66c22-6ba8-4980-bdb2-8c50eabaec04 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-8fd66c22-6ba8-4980-bdb2-8c50eabaec04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:29.764384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:29.765647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:29.766881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:29.766881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:29.766881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:29.766881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:29.771960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 338/677] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:29.772763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd66c22-6ba8-4980-bdb2-8c50eabaec04 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:29.782364 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 340/678] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:29.782364 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb72d2-cdfa-48ed-ac0a-c974d86a47a7 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:29.890488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb72d2-cdfa-48ed-ac0a-c974d86a47a7 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:29.900744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd66c22-6ba8-4980-bdb2-8c50eabaec04 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:29.903111 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:29.935089 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b51be8-4114-4613-914b-40b5d37eb6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:29.935880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b51be8-4114-4613-914b-40b5d37eb6ea None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:29.936164 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b51be8-4114-4613-914b-40b5d37eb6ea None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:29.936891 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b51be8-4114-4613-914b-40b5d37eb6ea None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:29.937848 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b51be8-4114-4613-914b-40b5d37eb6ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:29.938162 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b51be8-4114-4613-914b-40b5d37eb6ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:29.939816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b51be8-4114-4613-914b-40b5d37eb6ea None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:29.944588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b9aa0-97c1-4e0b-8249-9a3797ab6991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:29.945313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b9aa0-97c1-4e0b-8249-9a3797ab6991 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:29.945693 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b9aa0-97c1-4e0b-8249-9a3797ab6991 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:29.946046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b9aa0-97c1-4e0b-8249-9a3797ab6991 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:29.957379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 341/679] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:29.957379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b51be8-4114-4613-914b-40b5d37eb6ea None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:29.959125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b9aa0-97c1-4e0b-8249-9a3797ab6991 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:29.960629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b9aa0-97c1-4e0b-8249-9a3797ab6991 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-9a1b9aa0-97c1-4e0b-8249-9a3797ab6991 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:29.973831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:29.975003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:29.976125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:29.976125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:29.976125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:29.976125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:29.976125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:29.976125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:29.976125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:29.976125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:29.979951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 339/680] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:29.980791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b9aa0-97c1-4e0b-8249-9a3797ab6991 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:29.986266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:30.075200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b51be8-4114-4613-914b-40b5d37eb6ea None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:30.092202 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b9aa0-97c1-4e0b-8249-9a3797ab6991 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:30.114520 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df97f95-4e2f-4a24-90e4-58db013b004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:30.115137 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df97f95-4e2f-4a24-90e4-58db013b004d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:30.115420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df97f95-4e2f-4a24-90e4-58db013b004d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:30.115698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df97f95-4e2f-4a24-90e4-58db013b004d None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:30.116442 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df97f95-4e2f-4a24-90e4-58db013b004d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:30.116744 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df97f95-4e2f-4a24-90e4-58db013b004d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:30.118138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df97f95-4e2f-4a24-90e4-58db013b004d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:30.135010 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 342/681] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:30.135652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acb57c-fe68-4491-be71-d7d6c4df2b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:30.135652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acb57c-fe68-4491-be71-d7d6c4df2b68 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:30.135839 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df97f95-4e2f-4a24-90e4-58db013b004d None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:30.135924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acb57c-fe68-4491-be71-d7d6c4df2b68 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:30.135924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acb57c-fe68-4491-be71-d7d6c4df2b68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:30.147472 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acb57c-fe68-4491-be71-d7d6c4df2b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-04acb57c-fe68-4491-be71-d7d6c4df2b68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:30.153007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:30.154159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:30.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:30.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:30.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:30.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:30.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:30.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:30.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:30.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:30.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:30.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:30.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:30.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:30.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 340/682] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:30.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acb57c-fe68-4491-be71-d7d6c4df2b68 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:30.184782 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:30.228615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:30.249232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df97f95-4e2f-4a24-90e4-58db013b004d None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:30.273664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acb57c-fe68-4491-be71-d7d6c4df2b68 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:30.289300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31657344-7edb-41a9-9e38-51b9a52a0b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:30.290415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31657344-7edb-41a9-9e38-51b9a52a0b75 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:30.290857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31657344-7edb-41a9-9e38-51b9a52a0b75 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:30.291340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31657344-7edb-41a9-9e38-51b9a52a0b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:30.291969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31657344-7edb-41a9-9e38-51b9a52a0b75 None admin] RBAC: Adding query filter params (role.id=02a6ae14988149d38f9e819dc66b2f48, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=65bd5264306d4d33a2e14b01abb4364a) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:30.292285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31657344-7edb-41a9-9e38-51b9a52a0b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:30.293744 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31657344-7edb-41a9-9e38-51b9a52a0b75 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:30.301011 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 343/683] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:30 2022] GET /identity/v3/role_assignments?user.id=65bd5264306d4d33a2e14b01abb4364a&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=02a6ae14988149d38f9e819dc66b2f48 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:30.302691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31657344-7edb-41a9-9e38-51b9a52a0b75 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:30.324014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36427687-b4d6-4dc1-b288-83921f1f486d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:30.325076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36427687-b4d6-4dc1-b288-83921f1f486d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:30.325634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36427687-b4d6-4dc1-b288-83921f1f486d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:30.326093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36427687-b4d6-4dc1-b288-83921f1f486d None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:30.327761 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36427687-b4d6-4dc1-b288-83921f1f486d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:30.328323 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36427687-b4d6-4dc1-b288-83921f1f486d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:30.330279 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36427687-b4d6-4dc1-b288-83921f1f486d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:30.345793 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 341/684] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:30.347063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36427687-b4d6-4dc1-b288-83921f1f486d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:30.453805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:30.466853 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31657344-7edb-41a9-9e38-51b9a52a0b75 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:30.479476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36427687-b4d6-4dc1-b288-83921f1f486d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:30.509859 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfd16d-2d67-40ce-a072-f1686c204cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:30.510557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfd16d-2d67-40ce-a072-f1686c204cdb None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:30.510830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfd16d-2d67-40ce-a072-f1686c204cdb None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:30.511688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfd16d-2d67-40ce-a072-f1686c204cdb None admin] PATH_INFO: `/v3/users/nova` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:30.520548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfd16d-2d67-40ce-a072-f1686c204cdb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:30.521073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d57a2-6188-4c68-9ae4-2f5e0d26e8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:30.521715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d57a2-6188-4c68-9ae4-2f5e0d26e8a3 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:30.521999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d57a2-6188-4c68-9ae4-2f5e0d26e8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:30.522103 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfd16d-2d67-40ce-a072-f1686c204cdb None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:30.522312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d57a2-6188-4c68-9ae4-2f5e0d26e8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:30.523034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d57a2-6188-4c68-9ae4-2f5e0d26e8a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:30.523343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d57a2-6188-4c68-9ae4-2f5e0d26e8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:30.524846 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d57a2-6188-4c68-9ae4-2f5e0d26e8a3 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-88dfd16d-2d67-40ce-a072-f1686c204cdb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:30.535114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:30.536366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:30.538003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:30.538003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:30.538003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:30.538003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:30.538003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:30.538003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:30.538003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:30.538003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:30.538003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:36:30.538003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:30.538740 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 342/685] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:30.538740 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d57a2-6188-4c68-9ae4-2f5e0d26e8a3 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:30.538912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 344/686] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jul 27 10:36:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:30.542927 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfd16d-2d67-40ce-a072-f1686c204cdb None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:30.555990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:30.660880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d57a2-6188-4c68-9ae4-2f5e0d26e8a3 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:30.672075 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfd16d-2d67-40ce-a072-f1686c204cdb None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:30.712473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44725cb9-daeb-42c7-83ad-564e73353194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:30.713134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44725cb9-daeb-42c7-83ad-564e73353194 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:30.713381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44725cb9-daeb-42c7-83ad-564e73353194 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:30.713660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44725cb9-daeb-42c7-83ad-564e73353194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:30.714481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44725cb9-daeb-42c7-83ad-564e73353194 None admin] RBAC: Adding query filter params (role.id=02a6ae14988149d38f9e819dc66b2f48, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=bd4e81eb81934784b8632248ecf0894f) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:30.714798 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44725cb9-daeb-42c7-83ad-564e73353194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:30.716243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44725cb9-daeb-42c7-83ad-564e73353194 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:30.723244 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 343/687] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:30 2022] GET /identity/v3/role_assignments?user.id=bd4e81eb81934784b8632248ecf0894f&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=02a6ae14988149d38f9e819dc66b2f48 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:30.724075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44725cb9-daeb-42c7-83ad-564e73353194 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:30.729759 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bce493-2e96-4cf6-85c3-e73683b8a403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:30.730856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce493-2e96-4cf6-85c3-e73683b8a403 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:30.731352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce493-2e96-4cf6-85c3-e73683b8a403 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:30.731833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bce493-2e96-4cf6-85c3-e73683b8a403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:30.737884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:30.754849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bce493-2e96-4cf6-85c3-e73683b8a403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:30.757663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bce493-2e96-4cf6-85c3-e73683b8a403 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-16bce493-2e96-4cf6-85c3-e73683b8a403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:30.780121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:30.781207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:30.782113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:30.782113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:30.782113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:30.782113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:30.783908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 345/688] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:30.789581 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bce493-2e96-4cf6-85c3-e73683b8a403 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:30.856549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44725cb9-daeb-42c7-83ad-564e73353194 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:30.877663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:30.897467 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128afcc-a0c4-4af1-86f2-e02c1a00dcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:30.898175 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128afcc-a0c4-4af1-86f2-e02c1a00dcb7 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:30.898498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128afcc-a0c4-4af1-86f2-e02c1a00dcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:30.898773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128afcc-a0c4-4af1-86f2-e02c1a00dcb7 None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:30.899582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128afcc-a0c4-4af1-86f2-e02c1a00dcb7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:30.899889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128afcc-a0c4-4af1-86f2-e02c1a00dcb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:30.901329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128afcc-a0c4-4af1-86f2-e02c1a00dcb7 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:30.922956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 344/689] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jul 27 10:36:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:30.923937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453b5ff-2320-41e7-bf2b-bd9d4069bcc0 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:30.924221 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453b5ff-2320-41e7-bf2b-bd9d4069bcc0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:30.924490 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453b5ff-2320-41e7-bf2b-bd9d4069bcc0 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:30.930135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 345/690] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:30.931450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78a079-ea67-4972-ba2d-890ecc500217 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:30.931738 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78a079-ea67-4972-ba2d-890ecc500217 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:30.932013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78a079-ea67-4972-ba2d-890ecc500217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:30.939401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bce493-2e96-4cf6-85c3-e73683b8a403 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:30.951767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6b78a079-ea67-4972-ba2d-890ecc500217 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:30.952985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6b78a079-ea67-4972-ba2d-890ecc500217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:30.982551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebceb1-7057-48e0-a530-7952382d9b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:30.983955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebceb1-7057-48e0-a530-7952382d9b39 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:30.984251 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebceb1-7057-48e0-a530-7952382d9b39 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:30.984527 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebceb1-7057-48e0-a530-7952382d9b39 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:30.985242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebceb1-7057-48e0-a530-7952382d9b39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:30.985552 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebceb1-7057-48e0-a530-7952382d9b39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:30.986962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebceb1-7057-48e0-a530-7952382d9b39 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:31.002255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 346/691] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:31.003155 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebceb1-7057-48e0-a530-7952382d9b39 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:31.037010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:31.047587 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 346/692] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:31.048276 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78a079-ea67-4972-ba2d-890ecc500217 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:31.131792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebceb1-7057-48e0-a530-7952382d9b39 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:31.159140 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:31.178772 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78a079-ea67-4972-ba2d-890ecc500217 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:31.179921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4771b47-347a-4d75-8e22-8e3ecf94c6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:31.180548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4771b47-347a-4d75-8e22-8e3ecf94c6a8 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:31.180834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4771b47-347a-4d75-8e22-8e3ecf94c6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:31.181114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4771b47-347a-4d75-8e22-8e3ecf94c6a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:31.227894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a3cf7-60e9-41be-85f5-997cfcc7d172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:31.229546 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a3cf7-60e9-41be-85f5-997cfcc7d172 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:31.230101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a3cf7-60e9-41be-85f5-997cfcc7d172 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:31.230604 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a3cf7-60e9-41be-85f5-997cfcc7d172 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:31.241287 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a3cf7-60e9-41be-85f5-997cfcc7d172 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:31.244004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a3cf7-60e9-41be-85f5-997cfcc7d172 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:31.256701 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4771b47-347a-4d75-8e22-8e3ecf94c6a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:31.258313 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4771b47-347a-4d75-8e22-8e3ecf94c6a8 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-be0a3cf7-60e9-41be-85f5-997cfcc7d172 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:31.260988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:31.261914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:31.262895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:31.262895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:31.262895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:31.262895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:31.262895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:31.262895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:31.262895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:31.262895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:31.262895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 10:36:31.262895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:31.264792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 347/693] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:36:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:31.264792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a3cf7-60e9-41be-85f5-997cfcc7d172 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:31.345051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:31.381749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 347/694] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:36:31.383279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4771b47-347a-4d75-8e22-8e3ecf94c6a8 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:31.406252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a3cf7-60e9-41be-85f5-997cfcc7d172 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:31.407392 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:31.457932 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50e5fc-ae4f-42db-bda9-b3bfd1657d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:31.458989 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e5fc-ae4f-42db-bda9-b3bfd1657d64 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:31.459478 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e5fc-ae4f-42db-bda9-b3bfd1657d64 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:31.459945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50e5fc-ae4f-42db-bda9-b3bfd1657d64 None admin] PATH_INFO: `/v3/services/network` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:31.460887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50e5fc-ae4f-42db-bda9-b3bfd1657d64 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:31.462515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50e5fc-ae4f-42db-bda9-b3bfd1657d64 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-0b50e5fc-ae4f-42db-bda9-b3bfd1657d64 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:31.475163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:31.476234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:31.477068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:31.477068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:31.477068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:31.477068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:31.477068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:31.477068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:31.477068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:31.477068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:31.477068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:31.477068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:31.477068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:31.477068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:31.477068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 10:36:31.477068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:31.484947 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 348/695] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:31 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:31.486222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50e5fc-ae4f-42db-bda9-b3bfd1657d64 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:31.508678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4771b47-347a-4d75-8e22-8e3ecf94c6a8 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:31.558583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b652fb-2ed4-4261-a3c9-18a6e96f06e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:31.559268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b652fb-2ed4-4261-a3c9-18a6e96f06e1 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:31.559686 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b652fb-2ed4-4261-a3c9-18a6e96f06e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:31.559982 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b652fb-2ed4-4261-a3c9-18a6e96f06e1 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:31.560971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b652fb-2ed4-4261-a3c9-18a6e96f06e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:31.561280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b652fb-2ed4-4261-a3c9-18a6e96f06e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:31.563568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b652fb-2ed4-4261-a3c9-18a6e96f06e1 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:31.587370 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 348/696] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Jul 27 10:36:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:31.588391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b652fb-2ed4-4261-a3c9-18a6e96f06e1 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:31.603840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50e5fc-ae4f-42db-bda9-b3bfd1657d64 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:31.628011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:31.647116 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b68e4-e0dc-4359-b301-401058c59772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:31.648167 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b68e4-e0dc-4359-b301-401058c59772 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:31.648758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b68e4-e0dc-4359-b301-401058c59772 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:31.649301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b68e4-e0dc-4359-b301-401058c59772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:31.662479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b68e4-e0dc-4359-b301-401058c59772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:31.664443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b68e4-e0dc-4359-b301-401058c59772 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-7e6b68e4-e0dc-4359-b301-401058c59772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:31.683389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:31.684359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:31.685306 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:31.685306 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:31.685306 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:31.685306 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:31.688785 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:31.693137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 349/697] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:31.695206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b68e4-e0dc-4359-b301-401058c59772 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:31.717320 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b652fb-2ed4-4261-a3c9-18a6e96f06e1 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:31.762655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070b062-cdfc-47d7-bbec-99babfd750aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:31.763738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b062-cdfc-47d7-bbec-99babfd750aa None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:31.764225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b062-cdfc-47d7-bbec-99babfd750aa None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:31.765304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070b062-cdfc-47d7-bbec-99babfd750aa None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:31.766342 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070b062-cdfc-47d7-bbec-99babfd750aa None admin] RBAC: Adding query filter params (name=network) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:31.767001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070b062-cdfc-47d7-bbec-99babfd750aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:31.768784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070b062-cdfc-47d7-bbec-99babfd750aa None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:31.774473 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 349/698] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jul 27 10:36:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:31.775668 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070b062-cdfc-47d7-bbec-99babfd750aa None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:31.821928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b68e4-e0dc-4359-b301-401058c59772 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:31.873450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0d62d-04e5-4f56-9cdf-c7b0bd2d632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:31.873450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0d62d-04e5-4f56-9cdf-c7b0bd2d632d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:31.873450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0d62d-04e5-4f56-9cdf-c7b0bd2d632d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:31.873450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0d62d-04e5-4f56-9cdf-c7b0bd2d632d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:31.909618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070b062-cdfc-47d7-bbec-99babfd750aa None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:31.925384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:31.950842 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18703ee-05a2-4885-84a6-8308ffc07da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:31.951876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18703ee-05a2-4885-84a6-8308ffc07da6 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:31.953082 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18703ee-05a2-4885-84a6-8308ffc07da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:31.953805 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18703ee-05a2-4885-84a6-8308ffc07da6 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:31.954734 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18703ee-05a2-4885-84a6-8308ffc07da6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:31.955338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18703ee-05a2-4885-84a6-8308ffc07da6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:31.957079 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18703ee-05a2-4885-84a6-8308ffc07da6 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:31.958549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0d62d-04e5-4f56-9cdf-c7b0bd2d632d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:31.960607 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0d62d-04e5-4f56-9cdf-c7b0bd2d632d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:31.966870 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:31.977129 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 350/699] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:31.978397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18703ee-05a2-4885-84a6-8308ffc07da6 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:32.100108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 350/700] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 10:36:32.101587 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0d62d-04e5-4f56-9cdf-c7b0bd2d632d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:32.121629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18703ee-05a2-4885-84a6-8308ffc07da6 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:32.162633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229c22c-6ba4-4680-8b03-880014eba8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:32.163275 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229c22c-6ba4-4680-8b03-880014eba8f9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:32.163511 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229c22c-6ba4-4680-8b03-880014eba8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:32.163674 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229c22c-6ba4-4680-8b03-880014eba8f9 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:32.164439 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229c22c-6ba4-4680-8b03-880014eba8f9 None admin] RBAC: Adding query filter params (type=network) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:32.164850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229c22c-6ba4-4680-8b03-880014eba8f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:32.166220 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229c22c-6ba4-4680-8b03-880014eba8f9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:32.172798 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 351/701] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jul 27 10:36:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:32.173812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229c22c-6ba4-4680-8b03-880014eba8f9 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:32.200110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:32.271848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0d62d-04e5-4f56-9cdf-c7b0bd2d632d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:32.330214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ff7bd-ba8f-4d01-81b8-c453cc56c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:32.330883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff7bd-ba8f-4d01-81b8-c453cc56c621 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:32.331164 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff7bd-ba8f-4d01-81b8-c453cc56c621 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:32.331440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ff7bd-ba8f-4d01-81b8-c453cc56c621 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:32.342214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ff7bd-ba8f-4d01-81b8-c453cc56c621 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:32.342214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ff7bd-ba8f-4d01-81b8-c453cc56c621 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:32.345275 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-7b5ff7bd-ba8f-4d01-81b8-c453cc56c621 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:32.354080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:32.355110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:32.355991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:32.355991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:32.355991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:32.355991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:32.355991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:32.355991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:32.355991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:32.355991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:32.355991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 351/702] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:32.367763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ff7bd-ba8f-4d01-81b8-c453cc56c621 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:32.416127 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229c22c-6ba4-4680-8b03-880014eba8f9 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:32.491930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc0d66-ea8d-40dd-b23c-c0c5b6b32828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:32.492701 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc0d66-ea8d-40dd-b23c-c0c5b6b32828 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:32.492992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc0d66-ea8d-40dd-b23c-c0c5b6b32828 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:32.493375 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc0d66-ea8d-40dd-b23c-c0c5b6b32828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:32.496509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ff7bd-ba8f-4d01-81b8-c453cc56c621 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:32.517029 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc0d66-ea8d-40dd-b23c-c0c5b6b32828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:32.518533 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc0d66-ea8d-40dd-b23c-c0c5b6b32828 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:32.530724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:32.542018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67912c-767f-4aea-8efa-b70ee07150ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:32.542688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67912c-767f-4aea-8efa-b70ee07150ef None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:32.542967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67912c-767f-4aea-8efa-b70ee07150ef None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:32.543239 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67912c-767f-4aea-8efa-b70ee07150ef None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:32.544008 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67912c-767f-4aea-8efa-b70ee07150ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:32.544314 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67912c-767f-4aea-8efa-b70ee07150ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:32.545758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67912c-767f-4aea-8efa-b70ee07150ef None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-3ddc0d66-ea8d-40dd-b23c-c0c5b6b32828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:32.549515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:32.550443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:32.551363 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:32.551363 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:32.551363 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:32.551363 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:32.552975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 352/703] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:32.558472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc0d66-ea8d-40dd-b23c-c0c5b6b32828 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:32.574041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 352/704] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:32.580646 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67912c-767f-4aea-8efa-b70ee07150ef None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:32.737128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc0d66-ea8d-40dd-b23c-c0c5b6b32828 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:32.772243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67912c-767f-4aea-8efa-b70ee07150ef None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:32.774011 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:32.778997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59025d-8612-488e-8835-152468b278c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:32.779673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59025d-8612-488e-8835-152468b278c3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:32.779946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59025d-8612-488e-8835-152468b278c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:32.780241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59025d-8612-488e-8835-152468b278c3 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:32.781287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59025d-8612-488e-8835-152468b278c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:32.781411 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59025d-8612-488e-8835-152468b278c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:32.782957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59025d-8612-488e-8835-152468b278c3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:32.796709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 353/705] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:32.798079 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982b21-d034-4ae7-8f42-5f0a1c9c4c85 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:32.798532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982b21-d034-4ae7-8f42-5f0a1c9c4c85 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:32.798812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982b21-d034-4ae7-8f42-5f0a1c9c4c85 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:32.800589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 354/706] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:32.802295 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c982b21-d034-4ae7-8f42-5f0a1c9c4c85 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:32.817266 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f00aef-9f39-4ee2-96e2-df3e9eb12809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:32.818628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f00aef-9f39-4ee2-96e2-df3e9eb12809 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:32.819484 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f00aef-9f39-4ee2-96e2-df3e9eb12809 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:32.819979 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f00aef-9f39-4ee2-96e2-df3e9eb12809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:32.821199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f00aef-9f39-4ee2-96e2-df3e9eb12809 None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=3bb16c9232464cc2aeee12b7fa918b8e) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:32.821661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f00aef-9f39-4ee2-96e2-df3e9eb12809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:32.824031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f00aef-9f39-4ee2-96e2-df3e9eb12809 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:32.832485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 353/707] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:32 2022] GET /identity/v3/role_assignments?user.id=3bb16c9232464cc2aeee12b7fa918b8e&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=36208a24005e4ff98d827138292bea37 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:32.834373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e2d47-8dd5-4116-b5ea-e2ef54f183f6 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:32.834808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e2d47-8dd5-4116-b5ea-e2ef54f183f6 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:32.835371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e2d47-8dd5-4116-b5ea-e2ef54f183f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:32.860075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-4b7e2d47-8dd5-4116-b5ea-e2ef54f183f6 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:32.862010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-4b7e2d47-8dd5-4116-b5ea-e2ef54f183f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:32.929009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:32.948240 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 354/708] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:32.956365 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c982b21-d034-4ae7-8f42-5f0a1c9c4c85 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:32.972937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e2d47-8dd5-4116-b5ea-e2ef54f183f6 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:33.000470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d340ac-db94-4a7f-b26f-2d19bd9c51a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:33.001772 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d340ac-db94-4a7f-b26f-2d19bd9c51a6 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:33.002295 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d340ac-db94-4a7f-b26f-2d19bd9c51a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:33.002777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d340ac-db94-4a7f-b26f-2d19bd9c51a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:33.011492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d340ac-db94-4a7f-b26f-2d19bd9c51a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:33.013582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d340ac-db94-4a7f-b26f-2d19bd9c51a6 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-13d340ac-db94-4a7f-b26f-2d19bd9c51a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:33.028003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:33.029054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:33.030060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:33.030060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:33.030060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:33.030060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:33.030060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:33.030060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:33.030060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:33.030060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:33.033205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 355/709] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:33.042828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d340ac-db94-4a7f-b26f-2d19bd9c51a6 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:33.086486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:33.087922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e2d47-8dd5-4116-b5ea-e2ef54f183f6 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:33.127841 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c73581-39ee-435e-af42-2dfdbba940e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:33.127841 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c73581-39ee-435e-af42-2dfdbba940e3 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:33.128279 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c73581-39ee-435e-af42-2dfdbba940e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:33.128443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c73581-39ee-435e-af42-2dfdbba940e3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:33.129067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c73581-39ee-435e-af42-2dfdbba940e3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:33.130472 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c73581-39ee-435e-af42-2dfdbba940e3 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-d8c73581-39ee-435e-af42-2dfdbba940e3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:33.140055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:33.141063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:33.142342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 355/710] 10.222.0.43 () {56 vars in 1129 bytes} [Wed Jul 27 10:36:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:33.147495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83cf7e-939f-4ef5-b731-feaa8cec1681 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:33.147726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83cf7e-939f-4ef5-b731-feaa8cec1681 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:33.147972 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83cf7e-939f-4ef5-b731-feaa8cec1681 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:33.149524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 356/711] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:33.150274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83cf7e-939f-4ef5-b731-feaa8cec1681 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:33.166635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d340ac-db94-4a7f-b26f-2d19bd9c51a6 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:33.205131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff39d9b-a28a-4080-b938-b0997f6d140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:33.206242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff39d9b-a28a-4080-b938-b0997f6d140a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:33.206758 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff39d9b-a28a-4080-b938-b0997f6d140a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:33.207281 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff39d9b-a28a-4080-b938-b0997f6d140a None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:33.208249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff39d9b-a28a-4080-b938-b0997f6d140a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:33.208796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff39d9b-a28a-4080-b938-b0997f6d140a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:33.210522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff39d9b-a28a-4080-b938-b0997f6d140a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:33.210635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:33.224513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 356/712] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:33.226280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd1bc8-22cf-410a-92c0-95994671236f None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:33.226794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd1bc8-22cf-410a-92c0-95994671236f None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:33.227276 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd1bc8-22cf-410a-92c0-95994671236f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:33.247366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-72fd1bc8-22cf-410a-92c0-95994671236f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:33.249001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-72fd1bc8-22cf-410a-92c0-95994671236f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:33.262495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83cf7e-939f-4ef5-b731-feaa8cec1681 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:33.299317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565086da-544e-405b-a2e9-9e997bcd03e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:33.299838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565086da-544e-405b-a2e9-9e997bcd03e7 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:33.300122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565086da-544e-405b-a2e9-9e997bcd03e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:33.300403 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565086da-544e-405b-a2e9-9e997bcd03e7 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:33.301099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565086da-544e-405b-a2e9-9e997bcd03e7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:33.301406 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565086da-544e-405b-a2e9-9e997bcd03e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:33.302921 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565086da-544e-405b-a2e9-9e997bcd03e7 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:33.313441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 357/713] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Jul 27 10:36:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:33.314430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565086da-544e-405b-a2e9-9e997bcd03e7 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:33.334060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 357/714] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:33.335548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd1bc8-22cf-410a-92c0-95994671236f None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:33.379084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:33.456914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565086da-544e-405b-a2e9-9e997bcd03e7 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:33.467080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd1bc8-22cf-410a-92c0-95994671236f None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:33.475417 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:33.504650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0690c4a-bc89-4898-88b8-50c54fbc10b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:33.505280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0690c4a-bc89-4898-88b8-50c54fbc10b8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:33.505589 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0690c4a-bc89-4898-88b8-50c54fbc10b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:33.505832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0690c4a-bc89-4898-88b8-50c54fbc10b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:33.506663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0690c4a-bc89-4898-88b8-50c54fbc10b8 None admin] RBAC: Adding query filter params (role.id=02a6ae14988149d38f9e819dc66b2f48, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=dc3b05867de6493e94c01e3c478e1d8e) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:33.506976 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0690c4a-bc89-4898-88b8-50c54fbc10b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:33.508615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0690c4a-bc89-4898-88b8-50c54fbc10b8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:33.509727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee1748-4683-47dd-96e4-c8905743631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:33.511013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee1748-4683-47dd-96e4-c8905743631e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:33.511827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee1748-4683-47dd-96e4-c8905743631e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:33.512554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee1748-4683-47dd-96e4-c8905743631e None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:33.513993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee1748-4683-47dd-96e4-c8905743631e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:33.515353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee1748-4683-47dd-96e4-c8905743631e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:33.517212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee1748-4683-47dd-96e4-c8905743631e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:33.520432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 358/715] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:33 2022] GET /identity/v3/role_assignments?user.id=dc3b05867de6493e94c01e3c478e1d8e&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=02a6ae14988149d38f9e819dc66b2f48 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:33.521775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0690c4a-bc89-4898-88b8-50c54fbc10b8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:33.528860 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 358/716] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Jul 27 10:36:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:33.656156 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0690c4a-bc89-4898-88b8-50c54fbc10b8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:33.718461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b06f3-d8f6-4eb0-9495-830c1ec98bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:33.719648 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b06f3-d8f6-4eb0-9495-830c1ec98bb3 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:33.720169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b06f3-d8f6-4eb0-9495-830c1ec98bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:33.720674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b06f3-d8f6-4eb0-9495-830c1ec98bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:33.738210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b06f3-d8f6-4eb0-9495-830c1ec98bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:33.740149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b06f3-d8f6-4eb0-9495-830c1ec98bb3 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-051b06f3-d8f6-4eb0-9495-830c1ec98bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:33.763973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:33.765792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:33.766736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:33.766736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:33.766736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:33.766736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:33.769088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 359/717] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:33.774617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee1748-4683-47dd-96e4-c8905743631e None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:33.883411 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:33.895232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee1748-4683-47dd-96e4-c8905743631e None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:33.935799 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d7441-9a8d-4613-b734-bb906fc6ee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:33.936383 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d7441-9a8d-4613-b734-bb906fc6ee1c None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:33.937209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d7441-9a8d-4613-b734-bb906fc6ee1c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:33.937628 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d7441-9a8d-4613-b734-bb906fc6ee1c None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:33.938375 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d7441-9a8d-4613-b734-bb906fc6ee1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:33.938758 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d7441-9a8d-4613-b734-bb906fc6ee1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:33.940191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d7441-9a8d-4613-b734-bb906fc6ee1c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:33.954179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 359/718] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:33.959291 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b06f3-d8f6-4eb0-9495-830c1ec98bb3 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:33.994328 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:34.074170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b06f3-d8f6-4eb0-9495-830c1ec98bb3 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:34.113157 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664ee5e-f8e8-44b5-9c44-b928249d651b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:34.113939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664ee5e-f8e8-44b5-9c44-b928249d651b None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:34.114324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664ee5e-f8e8-44b5-9c44-b928249d651b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:34.114689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664ee5e-f8e8-44b5-9c44-b928249d651b None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:34.115519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664ee5e-f8e8-44b5-9c44-b928249d651b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:34.117326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664ee5e-f8e8-44b5-9c44-b928249d651b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:34.144914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 360/719] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:36:33 2022] POST /identity/v3/users => generated 254 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:36:34.759732 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9262a5a-f9eb-48f5-a8dd-e3f4b7185b76 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:34.760257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9262a5a-f9eb-48f5-a8dd-e3f4b7185b76 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:34.760561 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9262a5a-f9eb-48f5-a8dd-e3f4b7185b76 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:34.762274 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 360/720] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:34.768017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687105f-8d08-4e88-9968-acd8a1cec4c8 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:34.768470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687105f-8d08-4e88-9968-acd8a1cec4c8 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:34.768648 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687105f-8d08-4e88-9968-acd8a1cec4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:34.793769 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-a687105f-8d08-4e88-9968-acd8a1cec4c8 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:34.796059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a687105f-8d08-4e88-9968-acd8a1cec4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:34.906704 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 361/721] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 10:36:34.940262 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9262a5a-f9eb-48f5-a8dd-e3f4b7185b76 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:35.091905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9262a5a-f9eb-48f5-a8dd-e3f4b7185b76 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:35.145057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a27e2e-1b6d-4661-88f2-6051b74f68f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:35.145694 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a27e2e-1b6d-4661-88f2-6051b74f68f5 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:35.145980 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a27e2e-1b6d-4661-88f2-6051b74f68f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:35.146284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a27e2e-1b6d-4661-88f2-6051b74f68f5 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:35.146995 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a27e2e-1b6d-4661-88f2-6051b74f68f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:35.148373 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a27e2e-1b6d-4661-88f2-6051b74f68f5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:35.169930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 361/722] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jul 27 10:36:34 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:36:35.298445 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587bb1c-1d0d-4b16-b0e2-2b9588f4bd1e None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:35.298837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587bb1c-1d0d-4b16-b0e2-2b9588f4bd1e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:35.299021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587bb1c-1d0d-4b16-b0e2-2b9588f4bd1e None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:35.300922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 362/723] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:35.307107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6735b7-31dd-40d2-bf97-f10dbc5f43cd None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:35.307467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6735b7-31dd-40d2-bf97-f10dbc5f43cd None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:35.307673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6735b7-31dd-40d2-bf97-f10dbc5f43cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:35.329432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-af6735b7-31dd-40d2-bf97-f10dbc5f43cd None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:35.330695 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-af6735b7-31dd-40d2-bf97-f10dbc5f43cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:35.334216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:35.565133 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 362/724] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:35 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:36:35.587913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587bb1c-1d0d-4b16-b0e2-2b9588f4bd1e None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:35.611720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:35.707869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587bb1c-1d0d-4b16-b0e2-2b9588f4bd1e None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:35.759471 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe057ab-56aa-435a-8292-7cd532c9e202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:35.760132 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe057ab-56aa-435a-8292-7cd532c9e202 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:35.760419 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe057ab-56aa-435a-8292-7cd532c9e202 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:35.760699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe057ab-56aa-435a-8292-7cd532c9e202 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:35.775624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe057ab-56aa-435a-8292-7cd532c9e202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-cfe057ab-56aa-435a-8292-7cd532c9e202 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:35.780745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:35.781961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:35.783101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:35.783101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:35.783101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:35.783101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:35.783101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:35.783101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:35.783101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:35.783101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:35.783101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:35.783101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:35.783101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:36:35.783101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:35.783101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 363/725] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:36:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:35.789909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6735b7-31dd-40d2-bf97-f10dbc5f43cd None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:35.897992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6735b7-31dd-40d2-bf97-f10dbc5f43cd None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:35.926432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbeff2-d766-4506-ac4e-6cd32d252899 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:35.926717 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbeff2-d766-4506-ac4e-6cd32d252899 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:35.926995 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbeff2-d766-4506-ac4e-6cd32d252899 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:35.928508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 364/726] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:35.934251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416f4c-a593-4e46-b972-3f5c10f98116 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:35.934720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416f4c-a593-4e46-b972-3f5c10f98116 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:35.935298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f416f4c-a593-4e46-b972-3f5c10f98116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:35.948080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81105b1-f429-4b32-be70-597e107916e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:35.948711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81105b1-f429-4b32-be70-597e107916e4 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:35.948996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81105b1-f429-4b32-be70-597e107916e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:35.949275 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81105b1-f429-4b32-be70-597e107916e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:35.950584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81105b1-f429-4b32-be70-597e107916e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:35.950898 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81105b1-f429-4b32-be70-597e107916e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:35.952932 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81105b1-f429-4b32-be70-597e107916e4 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:35.955515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:35.957414 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-7f416f4c-a593-4e46-b972-3f5c10f98116 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:35.959002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7f416f4c-a593-4e46-b972-3f5c10f98116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:35.974211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 363/727] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:36:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:35.980250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81105b1-f429-4b32-be70-597e107916e4 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:36.096072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 365/728] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:35 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 10:36:36.122425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f416f4c-a593-4e46-b972-3f5c10f98116 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:36.142998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81105b1-f429-4b32-be70-597e107916e4 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:36.195807 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ddfc0-88ff-442d-81e5-0444da91c597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:36.196501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ddfc0-88ff-442d-81e5-0444da91c597 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:36.196792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ddfc0-88ff-442d-81e5-0444da91c597 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:36.197078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ddfc0-88ff-442d-81e5-0444da91c597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:36.232192 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ddfc0-88ff-442d-81e5-0444da91c597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:36.235616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ddfc0-88ff-442d-81e5-0444da91c597 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:36.273992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-723ddfc0-88ff-442d-81e5-0444da91c597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:36.299064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:36.300058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:36.300962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:36.300962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:36.300962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:36.300962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:36.306211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 364/729] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:36.315871 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ddfc0-88ff-442d-81e5-0444da91c597 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:36.377089 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f416f4c-a593-4e46-b972-3f5c10f98116 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:36.415327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f96e40-f3b8-4c96-9d89-99cbe5727161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:36.415872 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f96e40-f3b8-4c96-9d89-99cbe5727161 None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:36.416154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f96e40-f3b8-4c96-9d89-99cbe5727161 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:36.416427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f96e40-f3b8-4c96-9d89-99cbe5727161 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:36.417425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f96e40-f3b8-4c96-9d89-99cbe5727161 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:36.418858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f96e40-f3b8-4c96-9d89-99cbe5727161 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:36.442976 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 366/730] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jul 27 10:36:36 2022] POST /identity/v3/services => generated 251 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:36:36.492390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:36.550046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1965d8-58f2-48f5-b34b-fbd1807aa389 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:36.550401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1965d8-58f2-48f5-b34b-fbd1807aa389 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:36.550622 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1965d8-58f2-48f5-b34b-fbd1807aa389 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:36.558274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 367/731] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:36.565437 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0b9da-9cab-4ca4-8c09-6a200f353253 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:36.565767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0b9da-9cab-4ca4-8c09-6a200f353253 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:36.565998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0b9da-9cab-4ca4-8c09-6a200f353253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:36.581680 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ddfc0-88ff-442d-81e5-0444da91c597 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:36.611326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-f1e0b9da-9cab-4ca4-8c09-6a200f353253 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:36.612592 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f1e0b9da-9cab-4ca4-8c09-6a200f353253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:36.642451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55447d-35d2-4a75-8e4b-8e1156e911d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:36.643445 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55447d-35d2-4a75-8e4b-8e1156e911d1 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:36.643932 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55447d-35d2-4a75-8e4b-8e1156e911d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:36.644410 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55447d-35d2-4a75-8e4b-8e1156e911d1 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:36.645351 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55447d-35d2-4a75-8e4b-8e1156e911d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:36.645878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55447d-35d2-4a75-8e4b-8e1156e911d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:36.647504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55447d-35d2-4a75-8e4b-8e1156e911d1 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:36.661731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 365/732] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:36.672163 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55447d-35d2-4a75-8e4b-8e1156e911d1 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:36.712382 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:36.724300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 368/733] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:36.751433 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0b9da-9cab-4ca4-8c09-6a200f353253 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:36.863035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55447d-35d2-4a75-8e4b-8e1156e911d1 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:36.885117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:36.887966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0b9da-9cab-4ca4-8c09-6a200f353253 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:36.925392 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1b0c4-e1b8-401d-ab9a-8faba13dbed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:36.925962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1b0c4-e1b8-401d-ab9a-8faba13dbed6 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:36.926381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1b0c4-e1b8-401d-ab9a-8faba13dbed6 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:36.926657 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1b0c4-e1b8-401d-ab9a-8faba13dbed6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:36.935072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1b0c4-e1b8-401d-ab9a-8faba13dbed6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:36.936703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1b0c4-e1b8-401d-ab9a-8faba13dbed6 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:36.942075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92294edb-3088-47a6-aec0-4dd485f7f435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:36.943054 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294edb-3088-47a6-aec0-4dd485f7f435 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:36.943536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294edb-3088-47a6-aec0-4dd485f7f435 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:36.944004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294edb-3088-47a6-aec0-4dd485f7f435 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-85e1b0c4-e1b8-401d-ab9a-8faba13dbed6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:36.951407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:36.952989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:36.953958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:36.953958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:36.953958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:36.953958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:36.953958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:36.953958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:36.953958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:36.953958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:36.953958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:36:36.953958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:36.958133 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 366/734] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jul 27 10:36:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:36.959447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1b0c4-e1b8-401d-ab9a-8faba13dbed6 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:36.960709 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92294edb-3088-47a6-aec0-4dd485f7f435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-92294edb-3088-47a6-aec0-4dd485f7f435 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:36.968180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:36.969154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:36.970010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:36.970010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:36.970010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:36.970010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:36.970010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:36.970010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:36.970010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:36.970010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:36.970010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:36.970010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:36.970010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:36:36.970010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:36.972150 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 369/735] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:36:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:36.979061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92294edb-3088-47a6-aec0-4dd485f7f435 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:37.043931 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:37.094846 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92294edb-3088-47a6-aec0-4dd485f7f435 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:37.107091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1b0c4-e1b8-401d-ab9a-8faba13dbed6 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:37.150773 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fd065-90a3-46e9-8193-9ba91eae3be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:37.152157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fd065-90a3-46e9-8193-9ba91eae3be7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:37.152675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fd065-90a3-46e9-8193-9ba91eae3be7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:37.153488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fd065-90a3-46e9-8193-9ba91eae3be7 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:37.154609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fd065-90a3-46e9-8193-9ba91eae3be7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:37.155975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fd065-90a3-46e9-8193-9ba91eae3be7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:37.157918 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fd065-90a3-46e9-8193-9ba91eae3be7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:37.181575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 367/736] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jul 27 10:36:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:37.183995 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4639bb8-4084-4ba9-a8e4-58ae70a355cc None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:37.184935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4639bb8-4084-4ba9-a8e4-58ae70a355cc None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:37.185895 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4639bb8-4084-4ba9-a8e4-58ae70a355cc None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:37.188549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 368/737] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:37.189528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4639bb8-4084-4ba9-a8e4-58ae70a355cc None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:37.194642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787180a-34cb-4ac9-a840-cfbbd1fbf392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:37.195274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787180a-34cb-4ac9-a840-cfbbd1fbf392 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:37.195551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787180a-34cb-4ac9-a840-cfbbd1fbf392 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:37.195823 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787180a-34cb-4ac9-a840-cfbbd1fbf392 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:37.196550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787180a-34cb-4ac9-a840-cfbbd1fbf392 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:37.196853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787180a-34cb-4ac9-a840-cfbbd1fbf392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:37.198358 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787180a-34cb-4ac9-a840-cfbbd1fbf392 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:37.209138 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 370/738] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:36:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:37.215105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4728bd-2fb3-4608-8bc8-8c00252500f8 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:37.215105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4728bd-2fb3-4608-8bc8-8c00252500f8 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:37.215105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4728bd-2fb3-4608-8bc8-8c00252500f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:37.228214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:37.229583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-4d4728bd-2fb3-4608-8bc8-8c00252500f8 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:37.230967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-4d4728bd-2fb3-4608-8bc8-8c00252500f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:37.316883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 371/739] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:37.318248 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4728bd-2fb3-4608-8bc8-8c00252500f8 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:37.352407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4639bb8-4084-4ba9-a8e4-58ae70a355cc None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:37.381691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:37.402805 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22897f49-2b3b-4178-bca3-02c7b5787366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:37.404160 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22897f49-2b3b-4178-bca3-02c7b5787366 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:37.404444 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22897f49-2b3b-4178-bca3-02c7b5787366 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:37.404780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22897f49-2b3b-4178-bca3-02c7b5787366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:37.419547 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22897f49-2b3b-4178-bca3-02c7b5787366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:37.421308 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22897f49-2b3b-4178-bca3-02c7b5787366 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-22897f49-2b3b-4178-bca3-02c7b5787366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:37.443698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:37.445497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:37.447038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:37.447038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:37.447038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:37.447038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:37.447038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 369/740] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:37.447038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22897f49-2b3b-4178-bca3-02c7b5787366 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:37.461373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4728bd-2fb3-4608-8bc8-8c00252500f8 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:37.508331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa923c-61f2-4eab-a9d6-f2cc388087c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:37.509630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa923c-61f2-4eab-a9d6-f2cc388087c0 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:37.510536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa923c-61f2-4eab-a9d6-f2cc388087c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:37.511031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa923c-61f2-4eab-a9d6-f2cc388087c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:37.526638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa923c-61f2-4eab-a9d6-f2cc388087c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:37.528111 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa923c-61f2-4eab-a9d6-f2cc388087c0 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:37.546568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-9baa923c-61f2-4eab-a9d6-f2cc388087c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:37.551288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:37.552170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:37.553093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:37.553093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:37.553093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:37.553093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:37.553093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 372/741] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:37.553374 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa923c-61f2-4eab-a9d6-f2cc388087c0 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:37.585161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22897f49-2b3b-4178-bca3-02c7b5787366 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:37.630171 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab469c-8be9-4dfd-a56d-79f1179c7ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:37.630840 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab469c-8be9-4dfd-a56d-79f1179c7ace None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:37.631120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab469c-8be9-4dfd-a56d-79f1179c7ace None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:37.631414 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab469c-8be9-4dfd-a56d-79f1179c7ace None admin] PATH_INFO: `/v3/roles/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:37.647817 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab469c-8be9-4dfd-a56d-79f1179c7ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-f7ab469c-8be9-4dfd-a56d-79f1179c7ace None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:37.655678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:37.656629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:37.657477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:37.657477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:37.657477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:37.657477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:37.657477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:37.657477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:37.657477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:37.657477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:37.657477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:37.657477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:37.657477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:37.657477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:37.662290 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 370/742] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:37.663341 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab469c-8be9-4dfd-a56d-79f1179c7ace None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:37.693486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:37.697974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa923c-61f2-4eab-a9d6-f2cc388087c0 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:37.741447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d259a1-4d40-4428-bf34-29fd7c4c33de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:37.742907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d259a1-4d40-4428-bf34-29fd7c4c33de None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:37.743544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d259a1-4d40-4428-bf34-29fd7c4c33de None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:37.744121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d259a1-4d40-4428-bf34-29fd7c4c33de None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:37.745152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d259a1-4d40-4428-bf34-29fd7c4c33de None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:37.745637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d259a1-4d40-4428-bf34-29fd7c4c33de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:37.747779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d259a1-4d40-4428-bf34-29fd7c4c33de None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:37.766606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 373/743] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:37.767820 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d259a1-4d40-4428-bf34-29fd7c4c33de None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:37.807209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab469c-8be9-4dfd-a56d-79f1179c7ace None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:37.852677 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1f769-41ab-41b6-a0aa-eeb422f0efdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:37.853388 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1f769-41ab-41b6-a0aa-eeb422f0efdb None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:37.853739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1f769-41ab-41b6-a0aa-eeb422f0efdb None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:37.854097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1f769-41ab-41b6-a0aa-eeb422f0efdb None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:37.855488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1f769-41ab-41b6-a0aa-eeb422f0efdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:37.855863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1f769-41ab-41b6-a0aa-eeb422f0efdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:37.857595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1f769-41ab-41b6-a0aa-eeb422f0efdb None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:37.862250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:37.882053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 371/744] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:37.882053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1f769-41ab-41b6-a0aa-eeb422f0efdb None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:37.908484 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d259a1-4d40-4428-bf34-29fd7c4c33de None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:37.954548 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec83dbe-fa19-4c32-99ae-533fcec715b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:37.955640 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec83dbe-fa19-4c32-99ae-533fcec715b6 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:37.956092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec83dbe-fa19-4c32-99ae-533fcec715b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:37.956973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec83dbe-fa19-4c32-99ae-533fcec715b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:37.958221 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec83dbe-fa19-4c32-99ae-533fcec715b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:37.958698 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec83dbe-fa19-4c32-99ae-533fcec715b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:37.960885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec83dbe-fa19-4c32-99ae-533fcec715b6 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:37.973206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 374/745] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:37.974330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec83dbe-fa19-4c32-99ae-533fcec715b6 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:38.007115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:38.029359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1f769-41ab-41b6-a0aa-eeb422f0efdb None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:38.072048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906489-af42-4e97-b0c0-5ec3e5d9d979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:38.072978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906489-af42-4e97-b0c0-5ec3e5d9d979 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:38.073411 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906489-af42-4e97-b0c0-5ec3e5d9d979 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:38.073840 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906489-af42-4e97-b0c0-5ec3e5d9d979 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:38.081389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906489-af42-4e97-b0c0-5ec3e5d9d979 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:38.083110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906489-af42-4e97-b0c0-5ec3e5d9d979 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-07906489-af42-4e97-b0c0-5ec3e5d9d979 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:38.096656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:38.097614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:38.098575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:38.098575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:38.098575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:38.098575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:38.098575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:38.098575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:38.098575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:38.098575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:38.101021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 372/746] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:38.102019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906489-af42-4e97-b0c0-5ec3e5d9d979 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:38.105269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec83dbe-fa19-4c32-99ae-533fcec715b6 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:38.148843 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bdad7-584c-44d1-b816-2ae04627df60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:38.149491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bdad7-584c-44d1-b816-2ae04627df60 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:38.149773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bdad7-584c-44d1-b816-2ae04627df60 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:38.150047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bdad7-584c-44d1-b816-2ae04627df60 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:38.160117 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bdad7-584c-44d1-b816-2ae04627df60 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:38.161812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bdad7-584c-44d1-b816-2ae04627df60 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:38.163018 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-839bdad7-584c-44d1-b816-2ae04627df60 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:38.177048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:38.178129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:38.179139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:38.179139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:38.179139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:38.179139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:38.179139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:38.179139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:38.179139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:38.179139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:38.179139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 10:36:38.179139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:38.180496 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 375/747] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:36:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:38.181569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bdad7-584c-44d1-b816-2ae04627df60 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:38.212397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906489-af42-4e97-b0c0-5ec3e5d9d979 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:38.252409 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cef2fa-e45e-49ed-92c3-2f28a345d186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:38.253052 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cef2fa-e45e-49ed-92c3-2f28a345d186 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:38.253333 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cef2fa-e45e-49ed-92c3-2f28a345d186 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:38.253606 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cef2fa-e45e-49ed-92c3-2f28a345d186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:38.265662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cef2fa-e45e-49ed-92c3-2f28a345d186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:38.267229 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cef2fa-e45e-49ed-92c3-2f28a345d186 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:38.274726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-48cef2fa-e45e-49ed-92c3-2f28a345d186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:38.283147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:38.284073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:38.285017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:38.285017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:38.285017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:38.285017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:38.288968 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 373/748] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:38.290292 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6025a2b-14ef-404c-8978-2b8689d4666d None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:38.290583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6025a2b-14ef-404c-8978-2b8689d4666d None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:38.290858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6025a2b-14ef-404c-8978-2b8689d4666d None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:38.296196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 374/749] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:38.296196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6025a2b-14ef-404c-8978-2b8689d4666d None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:38.302110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bdad7-584c-44d1-b816-2ae04627df60 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:38.341680 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a1a85-f4d0-4c8f-8abd-0164039f8210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:38.342433 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1a85-f4d0-4c8f-8abd-0164039f8210 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:38.342753 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1a85-f4d0-4c8f-8abd-0164039f8210 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:38.343586 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a1a85-f4d0-4c8f-8abd-0164039f8210 None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:38.344652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a1a85-f4d0-4c8f-8abd-0164039f8210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:38.344860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a1a85-f4d0-4c8f-8abd-0164039f8210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:38.346282 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a1a85-f4d0-4c8f-8abd-0164039f8210 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:38.359531 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 376/750] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:38.360197 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a1a85-f4d0-4c8f-8abd-0164039f8210 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:38.411154 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6025a2b-14ef-404c-8978-2b8689d4666d None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:38.420616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:38.448272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab1173-2fea-41b2-bec4-f4e5b4c1f0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:38.449142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab1173-2fea-41b2-bec4-f4e5b4c1f0df None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:38.449281 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab1173-2fea-41b2-bec4-f4e5b4c1f0df None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:38.449440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab1173-2fea-41b2-bec4-f4e5b4c1f0df None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:38.450306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab1173-2fea-41b2-bec4-f4e5b4c1f0df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:38.450598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab1173-2fea-41b2-bec4-f4e5b4c1f0df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:38.452776 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab1173-2fea-41b2-bec4-f4e5b4c1f0df None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:38.471230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 375/751] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Jul 27 10:36:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:38.472384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b723a63-3b03-4541-a71a-3ecfd86a72b7 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:38.472673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b723a63-3b03-4541-a71a-3ecfd86a72b7 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:38.472949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b723a63-3b03-4541-a71a-3ecfd86a72b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:38.480363 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a1a85-f4d0-4c8f-8abd-0164039f8210 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:38.492066 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-7b723a63-3b03-4541-a71a-3ecfd86a72b7 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:38.493068 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-7b723a63-3b03-4541-a71a-3ecfd86a72b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:38.520797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd36af-7cac-415f-820e-ba2007261fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:38.521469 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd36af-7cac-415f-820e-ba2007261fd9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:38.521749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd36af-7cac-415f-820e-ba2007261fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:38.522026 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd36af-7cac-415f-820e-ba2007261fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:38.522747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd36af-7cac-415f-820e-ba2007261fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:38.523049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd36af-7cac-415f-820e-ba2007261fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:38.524402 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd36af-7cac-415f-820e-ba2007261fd9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:38.541775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 377/752] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:38.541775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd36af-7cac-415f-820e-ba2007261fd9 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:38.541775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:38.573827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 376/753] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:38.574920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b723a63-3b03-4541-a71a-3ecfd86a72b7 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:38.657964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd36af-7cac-415f-820e-ba2007261fd9 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:38.689847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:38.693529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ad9c6-9d4f-4548-9469-e00154093825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:38.694226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ad9c6-9d4f-4548-9469-e00154093825 None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:38.694516 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ad9c6-9d4f-4548-9469-e00154093825 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:38.694796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ad9c6-9d4f-4548-9469-e00154093825 None admin] PATH_INFO: `/v3/projects/52e68e1a140146e28b504864955367c1/users/3bb16c9232464cc2aeee12b7fa918b8e/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:38.696774 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ad9c6-9d4f-4548-9469-e00154093825 None admin] RBAC: Authorizing `identity:create_grant(project_id=52e68e1a140146e28b504864955367c1, user_id=3bb16c9232464cc2aeee12b7fa918b8e, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:38.697069 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b723a63-3b03-4541-a71a-3ecfd86a72b7 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:38.698213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ad9c6-9d4f-4548-9469-e00154093825 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:38.722306 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 378/754] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:36:38 2022] PUT /identity/v3/projects/52e68e1a140146e28b504864955367c1/users/3bb16c9232464cc2aeee12b7fa918b8e/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:36:38.722306 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ad9c6-9d4f-4548-9469-e00154093825 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:38.763788 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda8678-eb17-4f21-9e95-799e0916fcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:38.766314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda8678-eb17-4f21-9e95-799e0916fcd1 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:38.766622 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda8678-eb17-4f21-9e95-799e0916fcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:38.766900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda8678-eb17-4f21-9e95-799e0916fcd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:38.794349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:38.847159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ad9c6-9d4f-4548-9469-e00154093825 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:38.876987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda8678-eb17-4f21-9e95-799e0916fcd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:38.878261 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda8678-eb17-4f21-9e95-799e0916fcd1 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:38.886840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d53c1-00b7-46c7-a521-74b3afeb3c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:38.887551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d53c1-00b7-46c7-a521-74b3afeb3c38 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:38.887838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d53c1-00b7-46c7-a521-74b3afeb3c38 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:38.888120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d53c1-00b7-46c7-a521-74b3afeb3c38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:38.900930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d53c1-00b7-46c7-a521-74b3afeb3c38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:38.902396 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d53c1-00b7-46c7-a521-74b3afeb3c38 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-370d53c1-00b7-46c7-a521-74b3afeb3c38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:38.915795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:38.917346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:38.918491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:38.918491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:38.918491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:38.918491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:38.918491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:38.918491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:38.918491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:38.918491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:38.918491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 10:36:38.918491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:38.918491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 379/755] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jul 27 10:36:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:38.918491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d53c1-00b7-46c7-a521-74b3afeb3c38 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:38.985776 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:38.993451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 377/756] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:36:38.994755 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1655ef-8156-4af1-bdee-8f1b3bf13b23 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:38.995049 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1655ef-8156-4af1-bdee-8f1b3bf13b23 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:38.995309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1655ef-8156-4af1-bdee-8f1b3bf13b23 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:38.996720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 378/757] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:39.002125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1655ef-8156-4af1-bdee-8f1b3bf13b23 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:39.040046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d53c1-00b7-46c7-a521-74b3afeb3c38 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:39.065493 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:39.078782 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002a0bc-7759-4471-925e-2c24a965e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:39.079747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002a0bc-7759-4471-925e-2c24a965e9cf None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:39.080205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002a0bc-7759-4471-925e-2c24a965e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:39.080619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002a0bc-7759-4471-925e-2c24a965e9cf None admin] PATH_INFO: `/v3/services/network` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:39.081405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002a0bc-7759-4471-925e-2c24a965e9cf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:39.082919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002a0bc-7759-4471-925e-2c24a965e9cf None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-c002a0bc-7759-4471-925e-2c24a965e9cf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:39.092393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:39.093691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:39.094891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:39.094891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:39.094891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:39.094891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:39.094891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:39.094891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:39.094891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:39.094891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:39.094891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:39.094891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:39.094891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:39.094891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:39.094891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 10:36:39.094891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:39.095781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 380/758] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:38 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:39.101808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002a0bc-7759-4471-925e-2c24a965e9cf None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:39.136946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1655ef-8156-4af1-bdee-8f1b3bf13b23 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:39.189442 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159caee-3f06-4238-b1a3-39aecb7c0dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:39.190304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159caee-3f06-4238-b1a3-39aecb7c0dca None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:39.190598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159caee-3f06-4238-b1a3-39aecb7c0dca None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:39.190877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159caee-3f06-4238-b1a3-39aecb7c0dca None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:39.191858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159caee-3f06-4238-b1a3-39aecb7c0dca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:39.192186 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159caee-3f06-4238-b1a3-39aecb7c0dca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:39.193644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159caee-3f06-4238-b1a3-39aecb7c0dca None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:39.215460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 379/759] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Jul 27 10:36:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:39.216049 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de223c-678a-44f4-96df-e712b2672202 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:39.216808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de223c-678a-44f4-96df-e712b2672202 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:39.217094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de223c-678a-44f4-96df-e712b2672202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:39.228591 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002a0bc-7759-4471-925e-2c24a965e9cf None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:39.239152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-42de223c-678a-44f4-96df-e712b2672202 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:39.240270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-42de223c-678a-44f4-96df-e712b2672202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:39.266744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482112a-ff78-4d5c-bd22-75218ad44f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:39.268013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482112a-ff78-4d5c-bd22-75218ad44f30 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:39.268489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482112a-ff78-4d5c-bd22-75218ad44f30 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:39.269077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482112a-ff78-4d5c-bd22-75218ad44f30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:39.282115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482112a-ff78-4d5c-bd22-75218ad44f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:39.283619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482112a-ff78-4d5c-bd22-75218ad44f30 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:39.296235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-1482112a-ff78-4d5c-bd22-75218ad44f30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:39.299204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:39.300091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:39.300999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:39.300999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:39.300999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:39.300999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:39.300999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 381/760] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:39.301682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482112a-ff78-4d5c-bd22-75218ad44f30 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:39.326335 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 380/761] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:39.327702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de223c-678a-44f4-96df-e712b2672202 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:39.347610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:39.421207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482112a-ff78-4d5c-bd22-75218ad44f30 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:39.442975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de223c-678a-44f4-96df-e712b2672202 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:39.464756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401eab4-e0c1-4c15-a0a9-84d15dc98e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:39.465405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401eab4-e0c1-4c15-a0a9-84d15dc98e2b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:39.465658 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401eab4-e0c1-4c15-a0a9-84d15dc98e2b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:39.465930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401eab4-e0c1-4c15-a0a9-84d15dc98e2b None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:39.466641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401eab4-e0c1-4c15-a0a9-84d15dc98e2b None admin] RBAC: Adding query filter params (name=network) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:39.466945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401eab4-e0c1-4c15-a0a9-84d15dc98e2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:39.468424 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401eab4-e0c1-4c15-a0a9-84d15dc98e2b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:39.477579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 382/762] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jul 27 10:36:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:39.477579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401eab4-e0c1-4c15-a0a9-84d15dc98e2b None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:39.486960 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a257a-f495-4124-8fae-07897b8249a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:39.487590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a257a-f495-4124-8fae-07897b8249a0 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:39.487874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a257a-f495-4124-8fae-07897b8249a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:39.488148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a257a-f495-4124-8fae-07897b8249a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:39.545626 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:39.565172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a257a-f495-4124-8fae-07897b8249a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:39.566662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a257a-f495-4124-8fae-07897b8249a0 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:39.579307 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401eab4-e0c1-4c15-a0a9-84d15dc98e2b None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:39.580832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:39.614971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6125287-ee1a-4fe8-b981-ae62fc7574b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:39.615590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6125287-ee1a-4fe8-b981-ae62fc7574b9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:39.615867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6125287-ee1a-4fe8-b981-ae62fc7574b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:39.616137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6125287-ee1a-4fe8-b981-ae62fc7574b9 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:39.616819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6125287-ee1a-4fe8-b981-ae62fc7574b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:39.617136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6125287-ee1a-4fe8-b981-ae62fc7574b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:39.618518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6125287-ee1a-4fe8-b981-ae62fc7574b9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:39.635365 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 383/763] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:39.635365 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6125287-ee1a-4fe8-b981-ae62fc7574b9 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:39.686688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 381/764] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:36:39.687783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a257a-f495-4124-8fae-07897b8249a0 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:39.750900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6125287-ee1a-4fe8-b981-ae62fc7574b9 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:39.783412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:39.789258 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c8d1c-e4d5-4cbe-9ec4-eab2b86a25ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:39.789915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c8d1c-e4d5-4cbe-9ec4-eab2b86a25ce None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:39.790230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c8d1c-e4d5-4cbe-9ec4-eab2b86a25ce None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:39.790503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c8d1c-e4d5-4cbe-9ec4-eab2b86a25ce None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:39.791140 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c8d1c-e4d5-4cbe-9ec4-eab2b86a25ce None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:39.792601 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c8d1c-e4d5-4cbe-9ec4-eab2b86a25ce None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:39.801886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a257a-f495-4124-8fae-07897b8249a0 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-a74c8d1c-e4d5-4cbe-9ec4-eab2b86a25ce None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:39.802017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:39.802920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:39.809243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 384/765] 10.222.0.43 () {56 vars in 1129 bytes} [Wed Jul 27 10:36:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:39.810099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c8d1c-e4d5-4cbe-9ec4-eab2b86a25ce None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:39.839246 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:39.853587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8694454-bc1c-4385-88a8-1c50fe9fe5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:39.854241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8694454-bc1c-4385-88a8-1c50fe9fe5e7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:39.854888 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8694454-bc1c-4385-88a8-1c50fe9fe5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:39.855174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8694454-bc1c-4385-88a8-1c50fe9fe5e7 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:39.856180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8694454-bc1c-4385-88a8-1c50fe9fe5e7 None admin] RBAC: Adding query filter params (type=network) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:39.856496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8694454-bc1c-4385-88a8-1c50fe9fe5e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:39.858228 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8694454-bc1c-4385-88a8-1c50fe9fe5e7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:39.866511 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 382/766] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jul 27 10:36:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:39.867940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8694454-bc1c-4385-88a8-1c50fe9fe5e7 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:39.931161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c8d1c-e4d5-4cbe-9ec4-eab2b86a25ce None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:39.972800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485d1a1-c449-44a0-ad91-ca194868ec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:39.973780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d1a1-c449-44a0-ad91-ca194868ec93 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:39.974346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d1a1-c449-44a0-ad91-ca194868ec93 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:39.974822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485d1a1-c449-44a0-ad91-ca194868ec93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:39.979367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8694454-bc1c-4385-88a8-1c50fe9fe5e7 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:39.982461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485d1a1-c449-44a0-ad91-ca194868ec93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:39.984202 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485d1a1-c449-44a0-ad91-ca194868ec93 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-c485d1a1-c449-44a0-ad91-ca194868ec93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:39.996015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:39.996917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:39.997878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:39.997878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:39.997878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:39.997878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:39.997878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:39.997878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:39.997878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:39.997878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:39.999851 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 385/767] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:40.000814 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485d1a1-c449-44a0-ad91-ca194868ec93 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:40.022314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734fa00-a4f2-4ce2-9c36-f815bd7ff5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:40.022969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734fa00-a4f2-4ce2-9c36-f815bd7ff5a5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:40.023246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734fa00-a4f2-4ce2-9c36-f815bd7ff5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:40.023524 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734fa00-a4f2-4ce2-9c36-f815bd7ff5a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:40.038368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734fa00-a4f2-4ce2-9c36-f815bd7ff5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:40.040566 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734fa00-a4f2-4ce2-9c36-f815bd7ff5a5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:40.049552 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-8734fa00-a4f2-4ce2-9c36-f815bd7ff5a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:40.056306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:40.057221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:40.058470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:40.058470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:40.058470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:40.058470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:40.067973 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 383/768] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:40.068928 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734fa00-a4f2-4ce2-9c36-f815bd7ff5a5 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:40.121802 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:40.140658 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485d1a1-c449-44a0-ad91-ca194868ec93 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:40.176448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b9167-044b-44e8-a0f7-e16f3d2c359f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:40.177098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9167-044b-44e8-a0f7-e16f3d2c359f None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:40.177390 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9167-044b-44e8-a0f7-e16f3d2c359f None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:40.177664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b9167-044b-44e8-a0f7-e16f3d2c359f None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:40.178386 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b9167-044b-44e8-a0f7-e16f3d2c359f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:40.178692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b9167-044b-44e8-a0f7-e16f3d2c359f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:40.180054 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b9167-044b-44e8-a0f7-e16f3d2c359f None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:40.181180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734fa00-a4f2-4ce2-9c36-f815bd7ff5a5 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:40.190217 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 386/769] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Jul 27 10:36:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:40.191392 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b9167-044b-44e8-a0f7-e16f3d2c359f None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:40.219923 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692d908-f89f-4fd9-9940-4ed3e3c0bb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:40.220549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692d908-f89f-4fd9-9940-4ed3e3c0bb4e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:40.220838 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692d908-f89f-4fd9-9940-4ed3e3c0bb4e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:40.221113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692d908-f89f-4fd9-9940-4ed3e3c0bb4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:40.221879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692d908-f89f-4fd9-9940-4ed3e3c0bb4e None admin] RBAC: Adding query filter params (interface=public, service_id=8f551c434f5f4cf381f29743daf0d382, region_id=RegionOne) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:40.222221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692d908-f89f-4fd9-9940-4ed3e3c0bb4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:40.223591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692d908-f89f-4fd9-9940-4ed3e3c0bb4e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:40.232461 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 384/770] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jul 27 10:36:40 2022] GET /identity/v3/endpoints?service_id=8f551c434f5f4cf381f29743daf0d382&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:40.232461 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692d908-f89f-4fd9-9940-4ed3e3c0bb4e None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:40.304999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b9167-044b-44e8-a0f7-e16f3d2c359f None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:40.311544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:40.344903 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9188262-ed06-47f5-861e-62548c27c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:40.345529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9188262-ed06-47f5-861e-62548c27c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:40.345817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9188262-ed06-47f5-861e-62548c27c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:40.346093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9188262-ed06-47f5-861e-62548c27c7b8 None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:40.346913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9188262-ed06-47f5-861e-62548c27c7b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:40.347196 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9188262-ed06-47f5-861e-62548c27c7b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:40.348628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9188262-ed06-47f5-861e-62548c27c7b8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:40.355020 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692d908-f89f-4fd9-9940-4ed3e3c0bb4e None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:40.366634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 387/771] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:40.366634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9188262-ed06-47f5-861e-62548c27c7b8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:40.377157 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:40.402679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dac49c-d60a-4bf0-a2d3-6b7c8c2bb00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:40.403612 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dac49c-d60a-4bf0-a2d3-6b7c8c2bb00e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:40.403972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dac49c-d60a-4bf0-a2d3-6b7c8c2bb00e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:40.405401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dac49c-d60a-4bf0-a2d3-6b7c8c2bb00e None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:40.406104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dac49c-d60a-4bf0-a2d3-6b7c8c2bb00e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:40.406455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dac49c-d60a-4bf0-a2d3-6b7c8c2bb00e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:40.407844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dac49c-d60a-4bf0-a2d3-6b7c8c2bb00e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:40.422692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 385/772] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:40.427435 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dac49c-d60a-4bf0-a2d3-6b7c8c2bb00e None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:40.474270 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9188262-ed06-47f5-861e-62548c27c7b8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:40.511666 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1944ee6-24a0-4223-885e-3db5bf17b137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:40.512228 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1944ee6-24a0-4223-885e-3db5bf17b137 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:40.512507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1944ee6-24a0-4223-885e-3db5bf17b137 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:40.512779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1944ee6-24a0-4223-885e-3db5bf17b137 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:40.513460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1944ee6-24a0-4223-885e-3db5bf17b137 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:40.513763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1944ee6-24a0-4223-885e-3db5bf17b137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:40.515942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1944ee6-24a0-4223-885e-3db5bf17b137 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:40.526783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 388/773] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Jul 27 10:36:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:40.526783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1944ee6-24a0-4223-885e-3db5bf17b137 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:40.543404 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dac49c-d60a-4bf0-a2d3-6b7c8c2bb00e None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:40.573432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:40.585340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab18cc-3cd1-4b6a-add9-1342f881e5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:40.585963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab18cc-3cd1-4b6a-add9-1342f881e5ab None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:40.586288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab18cc-3cd1-4b6a-add9-1342f881e5ab None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:40.586882 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab18cc-3cd1-4b6a-add9-1342f881e5ab None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:40.587224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab18cc-3cd1-4b6a-add9-1342f881e5ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:40.588598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab18cc-3cd1-4b6a-add9-1342f881e5ab None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:40.593919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 386/774] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jul 27 10:36:40 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:40.594750 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab18cc-3cd1-4b6a-add9-1342f881e5ab None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:40.628886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:40.666967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1944ee6-24a0-4223-885e-3db5bf17b137 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:40.710017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387322f-4eae-4a71-9cae-9c60944ad906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:40.710567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387322f-4eae-4a71-9cae-9c60944ad906 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:40.710870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387322f-4eae-4a71-9cae-9c60944ad906 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:40.711150 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387322f-4eae-4a71-9cae-9c60944ad906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:40.711969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387322f-4eae-4a71-9cae-9c60944ad906 None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=dc3b05867de6493e94c01e3c478e1d8e) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:40.712286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387322f-4eae-4a71-9cae-9c60944ad906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:40.714001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387322f-4eae-4a71-9cae-9c60944ad906 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:40.726646 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 389/775] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:40 2022] GET /identity/v3/role_assignments?user.id=dc3b05867de6493e94c01e3c478e1d8e&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=36208a24005e4ff98d827138292bea37 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:40.727643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab18cc-3cd1-4b6a-add9-1342f881e5ab None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:40.727775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387322f-4eae-4a71-9cae-9c60944ad906 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:40.776573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55222f91-70cf-449b-9e47-24bce9f26e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:40.778277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55222f91-70cf-449b-9e47-24bce9f26e1e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:40.778726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55222f91-70cf-449b-9e47-24bce9f26e1e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:40.779144 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55222f91-70cf-449b-9e47-24bce9f26e1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:40.790301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55222f91-70cf-449b-9e47-24bce9f26e1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:40.793015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55222f91-70cf-449b-9e47-24bce9f26e1e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-55222f91-70cf-449b-9e47-24bce9f26e1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:40.809939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:40.811092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:40.812012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:40.812012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:40.812012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:40.812012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:40.812012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:40.812012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:40.812012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:40.812012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:40.814952 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 387/776] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:40.819647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d883f-aa76-444d-8614-7ac26b2938cf None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:40.819950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d883f-aa76-444d-8614-7ac26b2938cf None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:40.820207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d883f-aa76-444d-8614-7ac26b2938cf None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:40.821731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 388/777] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:36:40.822402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d883f-aa76-444d-8614-7ac26b2938cf None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:40.903503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:40.909606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387322f-4eae-4a71-9cae-9c60944ad906 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:40.956016 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa473b-8351-4e49-9113-e68f02f4467e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:40.956684 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa473b-8351-4e49-9113-e68f02f4467e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:40.956913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa473b-8351-4e49-9113-e68f02f4467e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:40.957182 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa473b-8351-4e49-9113-e68f02f4467e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:40.958268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa473b-8351-4e49-9113-e68f02f4467e None admin] RBAC: Adding query filter params (interface=public, service_id=973da9347936454aa6a8680b91ce0fcd, region_id=RegionOne) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:40.958583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa473b-8351-4e49-9113-e68f02f4467e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:40.960630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa473b-8351-4e49-9113-e68f02f4467e None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:40.971212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d883f-aa76-444d-8614-7ac26b2938cf None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:40.973422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 390/778] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jul 27 10:36:40 2022] GET /identity/v3/endpoints?service_id=973da9347936454aa6a8680b91ce0fcd&interface=public®ion_id=RegionOne => generated 194 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:40.975804 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bb201-73ea-4dc8-8273-821905cb1162 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:40.976091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bb201-73ea-4dc8-8273-821905cb1162 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:40.976361 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bb201-73ea-4dc8-8273-821905cb1162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:40.984166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:41.001057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-7a4bb201-73ea-4dc8-8273-821905cb1162 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:41.002637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7a4bb201-73ea-4dc8-8273-821905cb1162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:41.017312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c0453-0cf2-4aa4-a187-11b17e91573c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:41.017944 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c0453-0cf2-4aa4-a187-11b17e91573c None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:41.018288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c0453-0cf2-4aa4-a187-11b17e91573c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:41.018523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c0453-0cf2-4aa4-a187-11b17e91573c None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:41.019299 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c0453-0cf2-4aa4-a187-11b17e91573c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:41.019610 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c0453-0cf2-4aa4-a187-11b17e91573c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:41.021880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c0453-0cf2-4aa4-a187-11b17e91573c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:41.042370 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 389/779] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:41.043203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c0453-0cf2-4aa4-a187-11b17e91573c None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:41.084641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 391/780] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:41.085887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bb201-73ea-4dc8-8273-821905cb1162 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:41.185680 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c0453-0cf2-4aa4-a187-11b17e91573c None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:41.196512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:41.207175 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bb201-73ea-4dc8-8273-821905cb1162 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:41.225481 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240fc33-21f6-464f-ae4c-9397e0fc63db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:41.226499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240fc33-21f6-464f-ae4c-9397e0fc63db None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:41.226980 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240fc33-21f6-464f-ae4c-9397e0fc63db None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:41.227471 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240fc33-21f6-464f-ae4c-9397e0fc63db None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:41.228326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240fc33-21f6-464f-ae4c-9397e0fc63db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:41.229891 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240fc33-21f6-464f-ae4c-9397e0fc63db None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:41.235595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 390/781] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jul 27 10:36:41 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:41.236667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240fc33-21f6-464f-ae4c-9397e0fc63db None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:41.260231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12a49a-2f70-4196-aed3-bbcca484be0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:41.263222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12a49a-2f70-4196-aed3-bbcca484be0a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:41.264807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12a49a-2f70-4196-aed3-bbcca484be0a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:41.266222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12a49a-2f70-4196-aed3-bbcca484be0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:41.267470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12a49a-2f70-4196-aed3-bbcca484be0a None admin] RBAC: Adding query filter params (role.id=02a6ae14988149d38f9e819dc66b2f48, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=8cfba665ebb9497bad355c0c24f2ccfc) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:41.269594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12a49a-2f70-4196-aed3-bbcca484be0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:41.272092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12a49a-2f70-4196-aed3-bbcca484be0a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:41.274824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:41.285044 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 392/782] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:41 2022] GET /identity/v3/role_assignments?user.id=8cfba665ebb9497bad355c0c24f2ccfc&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=02a6ae14988149d38f9e819dc66b2f48 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:41.386292 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240fc33-21f6-464f-ae4c-9397e0fc63db None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:41.440630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0523783-574d-450f-b658-0868e1f12d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:41.441218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0523783-574d-450f-b658-0868e1f12d27 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:41.441498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0523783-574d-450f-b658-0868e1f12d27 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:41.441768 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0523783-574d-450f-b658-0868e1f12d27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:41.459211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0523783-574d-450f-b658-0868e1f12d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-a0523783-574d-450f-b658-0868e1f12d27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:41.464501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:41.465531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:41.466446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:41.466446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:41.466446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:41.466446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:41.466446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:41.466446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:41.466446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:41.466446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:41.466446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:41.466446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:41.466446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:36:41.466446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:41.466446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 391/783] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:36:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:41.472616 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12a49a-2f70-4196-aed3-bbcca484be0a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:41.588780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12a49a-2f70-4196-aed3-bbcca484be0a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:41.644778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae124973-29c7-4690-b646-4ddc9c1ebee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:41.645814 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae124973-29c7-4690-b646-4ddc9c1ebee8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:41.646333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae124973-29c7-4690-b646-4ddc9c1ebee8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:41.646816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae124973-29c7-4690-b646-4ddc9c1ebee8 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:41.647744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae124973-29c7-4690-b646-4ddc9c1ebee8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:41.648270 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae124973-29c7-4690-b646-4ddc9c1ebee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:41.649837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae124973-29c7-4690-b646-4ddc9c1ebee8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:41.665374 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 393/784] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:36:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:41.671017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0523783-574d-450f-b658-0868e1f12d27 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:41.743442 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:41.800503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0523783-574d-450f-b658-0868e1f12d27 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:41.836704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba30a4-bb9d-45dc-b93d-cdfa42bcf2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:41.837348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba30a4-bb9d-45dc-b93d-cdfa42bcf2bf None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:41.837630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba30a4-bb9d-45dc-b93d-cdfa42bcf2bf None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:41.837904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba30a4-bb9d-45dc-b93d-cdfa42bcf2bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:41.849818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba30a4-bb9d-45dc-b93d-cdfa42bcf2bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:41.851376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba30a4-bb9d-45dc-b93d-cdfa42bcf2bf None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-64ba30a4-bb9d-45dc-b93d-cdfa42bcf2bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:41.866025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:41.867022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:41.867962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:41.867962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:41.867962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:41.867962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:41.867962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 392/785] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:41.873201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae124973-29c7-4690-b646-4ddc9c1ebee8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:41.963052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:42.007725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae124973-29c7-4690-b646-4ddc9c1ebee8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:42.043825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68aa02-4177-4a4e-9301-1c0d8058bbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:42.044453 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68aa02-4177-4a4e-9301-1c0d8058bbe5 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:42.044737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68aa02-4177-4a4e-9301-1c0d8058bbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:42.045015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68aa02-4177-4a4e-9301-1c0d8058bbe5 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:42.046281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68aa02-4177-4a4e-9301-1c0d8058bbe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:42.046599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68aa02-4177-4a4e-9301-1c0d8058bbe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:42.047962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68aa02-4177-4a4e-9301-1c0d8058bbe5 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:42.060727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 394/786] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:42.066326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba30a4-bb9d-45dc-b93d-cdfa42bcf2bf None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:42.162987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:42.175764 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba30a4-bb9d-45dc-b93d-cdfa42bcf2bf None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:42.213055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed8e4e-ea1d-47a5-8201-c3c6b01bd8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:42.213702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed8e4e-ea1d-47a5-8201-c3c6b01bd8e5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:42.213985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed8e4e-ea1d-47a5-8201-c3c6b01bd8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:42.214286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed8e4e-ea1d-47a5-8201-c3c6b01bd8e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:42.222348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed8e4e-ea1d-47a5-8201-c3c6b01bd8e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:42.223789 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed8e4e-ea1d-47a5-8201-c3c6b01bd8e5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-82ed8e4e-ea1d-47a5-8201-c3c6b01bd8e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:42.235957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:42.236946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:42.237915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:42.237915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:42.237915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:42.237915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:42.237915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:42.237915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:42.237915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:42.237915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:42.237915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:36:42.237915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:42.237915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 393/787] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jul 27 10:36:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:42.247304 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68aa02-4177-4a4e-9301-1c0d8058bbe5 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:42.374516 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68aa02-4177-4a4e-9301-1c0d8058bbe5 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:42.393110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:42.410892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815b931-72c4-4d1c-a5ca-5de77d6a9901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:42.411523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815b931-72c4-4d1c-a5ca-5de77d6a9901 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:42.411808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815b931-72c4-4d1c-a5ca-5de77d6a9901 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:42.412088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815b931-72c4-4d1c-a5ca-5de77d6a9901 None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:42.412971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815b931-72c4-4d1c-a5ca-5de77d6a9901 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:42.413283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815b931-72c4-4d1c-a5ca-5de77d6a9901 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:42.414732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815b931-72c4-4d1c-a5ca-5de77d6a9901 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:42.433688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 395/788] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jul 27 10:36:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:42.439993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed8e4e-ea1d-47a5-8201-c3c6b01bd8e5 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:42.545425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed8e4e-ea1d-47a5-8201-c3c6b01bd8e5 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:42.582349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6abb-5345-4c43-9296-3279eefc4fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:42.583000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6abb-5345-4c43-9296-3279eefc4fe9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:42.583283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6abb-5345-4c43-9296-3279eefc4fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:42.583567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6abb-5345-4c43-9296-3279eefc4fe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:42.602908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:42.658729 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa6abb-5345-4c43-9296-3279eefc4fe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:42.660097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa6abb-5345-4c43-9296-3279eefc4fe9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:42.764405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 394/789] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:36:42.771350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815b931-72c4-4d1c-a5ca-5de77d6a9901 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:42.914247 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815b931-72c4-4d1c-a5ca-5de77d6a9901 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:42.964252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd3dae-b2eb-4dd7-8d7e-fd05a7811acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:42.964883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd3dae-b2eb-4dd7-8d7e-fd05a7811acd None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:42.965171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd3dae-b2eb-4dd7-8d7e-fd05a7811acd None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:42.965455 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd3dae-b2eb-4dd7-8d7e-fd05a7811acd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:42.985049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd3dae-b2eb-4dd7-8d7e-fd05a7811acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:42.986541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd3dae-b2eb-4dd7-8d7e-fd05a7811acd None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-12dd3dae-b2eb-4dd7-8d7e-fd05a7811acd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:43.006963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:43.009065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:43.011208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:43.011208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:43.011208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:43.011208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:43.011208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 396/790] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:43.014015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6abb-5345-4c43-9296-3279eefc4fe9 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:43.082667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:43.160364 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6abb-5345-4c43-9296-3279eefc4fe9 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:43.215199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64549f-70fd-44ac-9643-8d0eef386bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:43.216188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64549f-70fd-44ac-9643-8d0eef386bd3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:43.216676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64549f-70fd-44ac-9643-8d0eef386bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:43.217692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64549f-70fd-44ac-9643-8d0eef386bd3 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:43.218630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64549f-70fd-44ac-9643-8d0eef386bd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:43.219175 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64549f-70fd-44ac-9643-8d0eef386bd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:43.220741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64549f-70fd-44ac-9643-8d0eef386bd3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:43.241300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 395/791] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:43.247049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd3dae-b2eb-4dd7-8d7e-fd05a7811acd None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:43.296817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:43.349451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caa981-b78f-4b5a-a304-2e463a8e308c None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:43.350122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caa981-b78f-4b5a-a304-2e463a8e308c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:43.350543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caa981-b78f-4b5a-a304-2e463a8e308c None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:43.352269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 396/792] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:43.358867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01609ea1-d5b5-4454-a6bd-c238053dd3cc None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:43.359358 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01609ea1-d5b5-4454-a6bd-c238053dd3cc None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:43.359813 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01609ea1-d5b5-4454-a6bd-c238053dd3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:43.379649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-01609ea1-d5b5-4454-a6bd-c238053dd3cc None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:43.381228 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-01609ea1-d5b5-4454-a6bd-c238053dd3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:43.409882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd3dae-b2eb-4dd7-8d7e-fd05a7811acd None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:43.455307 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b51625-2a16-427c-9ec2-a5fd12288722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:43.455951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b51625-2a16-427c-9ec2-a5fd12288722 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:43.456232 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b51625-2a16-427c-9ec2-a5fd12288722 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:43.456506 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b51625-2a16-427c-9ec2-a5fd12288722 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:43.466321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 397/793] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:36:43.466472 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b51625-2a16-427c-9ec2-a5fd12288722 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:43.466472 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b51625-2a16-427c-9ec2-a5fd12288722 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:43.468644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd487a98-747f-4027-827d-75cd454aa7c4 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:43.468927 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd487a98-747f-4027-827d-75cd454aa7c4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:43.469206 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd487a98-747f-4027-827d-75cd454aa7c4 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:43.474467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 398/794] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:43.481992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65078df-af90-49dd-9486-e6b465af5f03 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:43.481992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65078df-af90-49dd-9486-e6b465af5f03 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:43.481992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65078df-af90-49dd-9486-e6b465af5f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-f0b51625-2a16-427c-9ec2-a5fd12288722 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:43.487047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:43.487943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:43.489100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:43.489100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:43.489100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:43.489100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:43.489100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:43.489100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:43.489100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:43.489100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:43.489100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 397/795] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:43.489689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b51625-2a16-427c-9ec2-a5fd12288722 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:43.508406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b65078df-af90-49dd-9486-e6b465af5f03 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:43.510157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b65078df-af90-49dd-9486-e6b465af5f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:43.546260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:43.600520 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 399/796] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:36:43.601485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65078df-af90-49dd-9486-e6b465af5f03 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:43.628622 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:43.647595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b51625-2a16-427c-9ec2-a5fd12288722 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:43.694214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e1dbe-6560-45e2-aa3d-eb806e525fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:43.695173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e1dbe-6560-45e2-aa3d-eb806e525fc7 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:43.695636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e1dbe-6560-45e2-aa3d-eb806e525fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:43.696089 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e1dbe-6560-45e2-aa3d-eb806e525fc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:43.709295 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e1dbe-6560-45e2-aa3d-eb806e525fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-b92e1dbe-6560-45e2-aa3d-eb806e525fc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:43.717041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:43.718357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:43.719498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:43.719498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:43.719498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:43.719498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:43.719498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:43.719498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:43.719498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:43.719498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:43.719498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:43.719498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:43.719498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:36:43.719498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:43.723786 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 398/797] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:43.724822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e1dbe-6560-45e2-aa3d-eb806e525fc7 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:43.743863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65078df-af90-49dd-9486-e6b465af5f03 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:43.784021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef210ee-45e8-4ad6-950a-143b95a33ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:43.785017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef210ee-45e8-4ad6-950a-143b95a33ffb None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:43.785501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef210ee-45e8-4ad6-950a-143b95a33ffb None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:43.785975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef210ee-45e8-4ad6-950a-143b95a33ffb None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:43.787064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef210ee-45e8-4ad6-950a-143b95a33ffb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:43.787648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef210ee-45e8-4ad6-950a-143b95a33ffb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:43.789278 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef210ee-45e8-4ad6-950a-143b95a33ffb None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:43.808628 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 400/798] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:43.810000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef210ee-45e8-4ad6-950a-143b95a33ffb None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:43.834750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e1dbe-6560-45e2-aa3d-eb806e525fc7 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:43.839461 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:43.872207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d7364-1286-4f68-a04c-bdce57834063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:43.872601 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d7364-1286-4f68-a04c-bdce57834063 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:43.873485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d7364-1286-4f68-a04c-bdce57834063 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:43.873747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d7364-1286-4f68-a04c-bdce57834063 None admin] PATH_INFO: `/v3/services/network` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:43.874757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d7364-1286-4f68-a04c-bdce57834063 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:43.876019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d7364-1286-4f68-a04c-bdce57834063 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-367d7364-1286-4f68-a04c-bdce57834063 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:43.885880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:43.886930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:43.887805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 399/799] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:43 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:43.888668 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d7364-1286-4f68-a04c-bdce57834063 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:43.906287 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:43.930338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef210ee-45e8-4ad6-950a-143b95a33ffb None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:43.965000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ccbf6-6512-4647-a969-f6721a7dc3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:43.965626 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ccbf6-6512-4647-a969-f6721a7dc3c5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:43.965909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ccbf6-6512-4647-a969-f6721a7dc3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:43.966213 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ccbf6-6512-4647-a969-f6721a7dc3c5 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:43.967009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ccbf6-6512-4647-a969-f6721a7dc3c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:43.967374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ccbf6-6512-4647-a969-f6721a7dc3c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:43.968816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ccbf6-6512-4647-a969-f6721a7dc3c5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:43.977233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 401/800] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:36:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:43.978448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0769059-f1a0-4264-8b8e-9aca2ae963e5 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:43.978741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0769059-f1a0-4264-8b8e-9aca2ae963e5 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:43.979020 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0769059-f1a0-4264-8b8e-9aca2ae963e5 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:43.980387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 402/801] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:43.981233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118e89c-4974-4e20-9635-9922c5deaad7 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:43.981589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118e89c-4974-4e20-9635-9922c5deaad7 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:43.981872 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118e89c-4974-4e20-9635-9922c5deaad7 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:43.983625 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 403/802] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:43.984148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118e89c-4974-4e20-9635-9922c5deaad7 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:44.003632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d7364-1286-4f68-a04c-bdce57834063 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:44.039439 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c84f4-c698-483f-8aa9-c86fb460409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:44.040159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c84f4-c698-483f-8aa9-c86fb460409f None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:44.040512 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c84f4-c698-483f-8aa9-c86fb460409f None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:44.040854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c84f4-c698-483f-8aa9-c86fb460409f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:44.041713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c84f4-c698-483f-8aa9-c86fb460409f None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=3bb16c9232464cc2aeee12b7fa918b8e) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:44.042092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c84f4-c698-483f-8aa9-c86fb460409f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:44.043612 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c84f4-c698-483f-8aa9-c86fb460409f None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:44.049995 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 400/803] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:43 2022] GET /identity/v3/role_assignments?user.id=3bb16c9232464cc2aeee12b7fa918b8e&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=36208a24005e4ff98d827138292bea37 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:44.051200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea3731-665f-479c-8a02-96c66da7cb70 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:44.051486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea3731-665f-479c-8a02-96c66da7cb70 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:44.051761 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea3731-665f-479c-8a02-96c66da7cb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:44.071408 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-ebea3731-665f-479c-8a02-96c66da7cb70 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:44.072644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ebea3731-665f-479c-8a02-96c66da7cb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:44.090016 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:44.111424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118e89c-4974-4e20-9635-9922c5deaad7 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:44.152341 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e0394-3651-47f2-8323-9e86019ef5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:44.153112 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e0394-3651-47f2-8323-9e86019ef5bc None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:44.153405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e0394-3651-47f2-8323-9e86019ef5bc None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:44.153684 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e0394-3651-47f2-8323-9e86019ef5bc None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:44.154609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e0394-3651-47f2-8323-9e86019ef5bc None admin] RBAC: Adding query filter params (name=network) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:44.154930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e0394-3651-47f2-8323-9e86019ef5bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:44.162554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 401/804] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:44.162554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea3731-665f-479c-8a02-96c66da7cb70 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:44.162844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e0394-3651-47f2-8323-9e86019ef5bc None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:44.168551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:44.174381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 404/805] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jul 27 10:36:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:44.175838 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecbefd-c2a7-4396-bef6-ba34edc33e29 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:44.176126 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecbefd-c2a7-4396-bef6-ba34edc33e29 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:44.176406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecbefd-c2a7-4396-bef6-ba34edc33e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:44.197710 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-01ecbefd-c2a7-4396-bef6-ba34edc33e29 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:44.198964 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-01ecbefd-c2a7-4396-bef6-ba34edc33e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:44.276360 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea3731-665f-479c-8a02-96c66da7cb70 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:44.279224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 405/806] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:44.279855 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecbefd-c2a7-4396-bef6-ba34edc33e29 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:44.325937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893db29c-053f-4ec7-ad39-2e47d1cbcdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:44.326645 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db29c-053f-4ec7-ad39-2e47d1cbcdcf None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:44.326929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db29c-053f-4ec7-ad39-2e47d1cbcdcf None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:44.327202 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893db29c-053f-4ec7-ad39-2e47d1cbcdcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:44.338990 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893db29c-053f-4ec7-ad39-2e47d1cbcdcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:44.340630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893db29c-053f-4ec7-ad39-2e47d1cbcdcf None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-893db29c-053f-4ec7-ad39-2e47d1cbcdcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:44.357012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:44.358696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:44.359630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:44.359630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:44.359630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:44.359630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:44.359630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 402/807] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:44.359921 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893db29c-053f-4ec7-ad39-2e47d1cbcdcf None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:44.375064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:44.396683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecbefd-c2a7-4396-bef6-ba34edc33e29 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:44.426633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:44.436224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8273a-bb89-40ca-8797-ff4e46304c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:44.436857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8273a-bb89-40ca-8797-ff4e46304c15 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:44.437129 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8273a-bb89-40ca-8797-ff4e46304c15 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:44.437407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8273a-bb89-40ca-8797-ff4e46304c15 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:44.438099 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8273a-bb89-40ca-8797-ff4e46304c15 None admin] RBAC: Adding query filter params (type=network) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:44.438439 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8273a-bb89-40ca-8797-ff4e46304c15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:44.439917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8273a-bb89-40ca-8797-ff4e46304c15 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:44.445414 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 406/808] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jul 27 10:36:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:44.446249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8273a-bb89-40ca-8797-ff4e46304c15 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:44.472413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893db29c-053f-4ec7-ad39-2e47d1cbcdcf None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:44.510893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69565da9-be41-4794-9119-61065c32f2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:44.511655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69565da9-be41-4794-9119-61065c32f2db None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:44.511942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69565da9-be41-4794-9119-61065c32f2db None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:44.512220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69565da9-be41-4794-9119-61065c32f2db None admin] PATH_INFO: `/v3/roles/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:44.523449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69565da9-be41-4794-9119-61065c32f2db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-69565da9-be41-4794-9119-61065c32f2db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:44.530633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:44.531617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:44.532495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:44.532495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:44.532495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:44.532495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:44.532495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:44.532495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:44.532495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:44.532495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:44.532495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:44.532495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:44.532495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:44.532495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:44.532495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 403/809] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:44.533228 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69565da9-be41-4794-9119-61065c32f2db None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:44.562593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8273a-bb89-40ca-8797-ff4e46304c15 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:44.599899 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83f113-fdb3-4d4c-8c0c-b3a7ff9cb504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:44.600972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83f113-fdb3-4d4c-8c0c-b3a7ff9cb504 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:44.601324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83f113-fdb3-4d4c-8c0c-b3a7ff9cb504 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:44.601607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83f113-fdb3-4d4c-8c0c-b3a7ff9cb504 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:44.602276 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83f113-fdb3-4d4c-8c0c-b3a7ff9cb504 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:44.603658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83f113-fdb3-4d4c-8c0c-b3a7ff9cb504 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-ec83f113-fdb3-4d4c-8c0c-b3a7ff9cb504 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:44.615168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:44.616157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:44.623035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 407/810] 10.222.0.43 () {56 vars in 1129 bytes} [Wed Jul 27 10:36:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:44.624170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83f113-fdb3-4d4c-8c0c-b3a7ff9cb504 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:44.634566 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:44.650982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69565da9-be41-4794-9119-61065c32f2db None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:44.669713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:44.689012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376577e3-3373-4f25-b814-e9f7d8a6b9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:44.689725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376577e3-3373-4f25-b814-e9f7d8a6b9a6 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:44.690010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376577e3-3373-4f25-b814-e9f7d8a6b9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:44.690317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376577e3-3373-4f25-b814-e9f7d8a6b9a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:44.691011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376577e3-3373-4f25-b814-e9f7d8a6b9a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:44.691328 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376577e3-3373-4f25-b814-e9f7d8a6b9a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:44.692693 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376577e3-3373-4f25-b814-e9f7d8a6b9a6 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:44.706322 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 404/811] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:44.707908 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376577e3-3373-4f25-b814-e9f7d8a6b9a6 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:44.734046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83f113-fdb3-4d4c-8c0c-b3a7ff9cb504 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:44.770494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd00fe3-dd5e-45e1-a408-13cf1a67ebda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:44.771116 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd00fe3-dd5e-45e1-a408-13cf1a67ebda None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:44.771397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd00fe3-dd5e-45e1-a408-13cf1a67ebda None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:44.771683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd00fe3-dd5e-45e1-a408-13cf1a67ebda None admin] PATH_INFO: `/v3/endpoints` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:44.772398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd00fe3-dd5e-45e1-a408-13cf1a67ebda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:44.773767 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd00fe3-dd5e-45e1-a408-13cf1a67ebda None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:44.798742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 408/812] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:36:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:36:44.799544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd00fe3-dd5e-45e1-a408-13cf1a67ebda None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:44.837169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376577e3-3373-4f25-b814-e9f7d8a6b9a6 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:44.883640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:44.931287 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ba036-ba6f-43e1-a1d8-61fde46e1d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:44.932023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ba036-ba6f-43e1-a1d8-61fde46e1d4b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:44.932305 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ba036-ba6f-43e1-a1d8-61fde46e1d4b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:44.932635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ba036-ba6f-43e1-a1d8-61fde46e1d4b None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:44.934233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ba036-ba6f-43e1-a1d8-61fde46e1d4b None admin] RBAC: Adding query filter params (name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:44.934789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ba036-ba6f-43e1-a1d8-61fde46e1d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:44.936400 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ba036-ba6f-43e1-a1d8-61fde46e1d4b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:44.937689 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd00fe3-dd5e-45e1-a408-13cf1a67ebda None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:44.953919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 405/813] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:44.953919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ba036-ba6f-43e1-a1d8-61fde46e1d4b None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:44.985603 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafce1d2-b809-44ea-a297-0a235a890ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:44.986271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafce1d2-b809-44ea-a297-0a235a890ccc None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:44.986550 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafce1d2-b809-44ea-a297-0a235a890ccc None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:44.986826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafce1d2-b809-44ea-a297-0a235a890ccc None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:44.987513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafce1d2-b809-44ea-a297-0a235a890ccc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:44.987822 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafce1d2-b809-44ea-a297-0a235a890ccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:44.989976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafce1d2-b809-44ea-a297-0a235a890ccc None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:44.995372 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 409/814] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Jul 27 10:36:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:44.996524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:45.002533 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafce1d2-b809-44ea-a297-0a235a890ccc None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:45.093246 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ba036-ba6f-43e1-a1d8-61fde46e1d4b None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:45.131073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512ef48-7025-4a22-9755-eee8c18a6dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:45.131829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512ef48-7025-4a22-9755-eee8c18a6dd9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:45.132255 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512ef48-7025-4a22-9755-eee8c18a6dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:45.132522 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512ef48-7025-4a22-9755-eee8c18a6dd9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:45.132862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafce1d2-b809-44ea-a297-0a235a890ccc None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:45.140896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512ef48-7025-4a22-9755-eee8c18a6dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:45.142563 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512ef48-7025-4a22-9755-eee8c18a6dd9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-b512ef48-7025-4a22-9755-eee8c18a6dd9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:45.154746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:45.155958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:45.157241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:45.157241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:45.157241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:45.157241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:45.157241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:45.157241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:45.157241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:45.157241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:45.157241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 10:36:45.157241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:45.157241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 406/815] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:36:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:45.157241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512ef48-7025-4a22-9755-eee8c18a6dd9 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:45.174145 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:45.184389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1c69b-5eda-4a6f-b2d1-91feede52e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:45.185048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1c69b-5eda-4a6f-b2d1-91feede52e49 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:45.185335 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1c69b-5eda-4a6f-b2d1-91feede52e49 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:45.185676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1c69b-5eda-4a6f-b2d1-91feede52e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:45.198394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1c69b-5eda-4a6f-b2d1-91feede52e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:45.199853 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1c69b-5eda-4a6f-b2d1-91feede52e49 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-dbd1c69b-5eda-4a6f-b2d1-91feede52e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:45.216582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:45.218176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:45.219159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:45.219159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:45.219159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:45.219159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:45.223310 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 410/816] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:45.224197 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1c69b-5eda-4a6f-b2d1-91feede52e49 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:45.270798 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:45.277389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512ef48-7025-4a22-9755-eee8c18a6dd9 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:45.313220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4c6a2-eb3b-4742-bbd5-74ecf54aec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:45.313844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4c6a2-eb3b-4742-bbd5-74ecf54aec37 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:45.314207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4c6a2-eb3b-4742-bbd5-74ecf54aec37 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:45.314500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4c6a2-eb3b-4742-bbd5-74ecf54aec37 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:45.315207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4c6a2-eb3b-4742-bbd5-74ecf54aec37 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:45.315515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4c6a2-eb3b-4742-bbd5-74ecf54aec37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:45.316879 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4c6a2-eb3b-4742-bbd5-74ecf54aec37 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:45.322088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 407/817] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Jul 27 10:36:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:45.322742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4c6a2-eb3b-4742-bbd5-74ecf54aec37 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:45.339272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1c69b-5eda-4a6f-b2d1-91feede52e49 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:45.377076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa3234-f014-4a52-9d78-9d14373f51cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:45.377702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa3234-f014-4a52-9d78-9d14373f51cf None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:45.377984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa3234-f014-4a52-9d78-9d14373f51cf None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:45.378289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa3234-f014-4a52-9d78-9d14373f51cf None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:45.379108 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa3234-f014-4a52-9d78-9d14373f51cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:45.379418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa3234-f014-4a52-9d78-9d14373f51cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:45.380852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa3234-f014-4a52-9d78-9d14373f51cf None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:45.398674 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 411/818] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Jul 27 10:36:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:45.399480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa3234-f014-4a52-9d78-9d14373f51cf None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:45.441363 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:45.444336 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4c6a2-eb3b-4742-bbd5-74ecf54aec37 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:45.482243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c9ad4-d30c-49eb-b6d2-02cf1d3a031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:45.482940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c9ad4-d30c-49eb-b6d2-02cf1d3a031c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:45.483224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c9ad4-d30c-49eb-b6d2-02cf1d3a031c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:45.483494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c9ad4-d30c-49eb-b6d2-02cf1d3a031c None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:45.484184 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c9ad4-d30c-49eb-b6d2-02cf1d3a031c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:45.484494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c9ad4-d30c-49eb-b6d2-02cf1d3a031c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:45.485857 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c9ad4-d30c-49eb-b6d2-02cf1d3a031c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:45.499012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 408/819] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:45.500766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c9ad4-d30c-49eb-b6d2-02cf1d3a031c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:45.527732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:45.528683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa3234-f014-4a52-9d78-9d14373f51cf None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:45.569730 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cf699-0d03-4989-ac57-afe8fe011f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:45.570850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cf699-0d03-4989-ac57-afe8fe011f01 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:45.571359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cf699-0d03-4989-ac57-afe8fe011f01 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:45.571778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cf699-0d03-4989-ac57-afe8fe011f01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:45.572644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cf699-0d03-4989-ac57-afe8fe011f01 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:45.574341 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cf699-0d03-4989-ac57-afe8fe011f01 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:45.597863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 412/820] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:36:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:36:45.599014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cf699-0d03-4989-ac57-afe8fe011f01 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:45.622686 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c9ad4-d30c-49eb-b6d2-02cf1d3a031c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:45.675012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2ea22-c602-45fe-9576-13d6edfb48e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:45.675594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2ea22-c602-45fe-9576-13d6edfb48e5 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:45.675976 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2ea22-c602-45fe-9576-13d6edfb48e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:45.676259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2ea22-c602-45fe-9576-13d6edfb48e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:45.692222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2ea22-c602-45fe-9576-13d6edfb48e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:45.694270 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2ea22-c602-45fe-9576-13d6edfb48e5 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-55f2ea22-c602-45fe-9576-13d6edfb48e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:45.716181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:45.717830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:45.718847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:45.718847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:45.718847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:45.718847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:45.718847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 409/821] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:45.724046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2ea22-c602-45fe-9576-13d6edfb48e5 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:45.762594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:45.774797 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cf699-0d03-4989-ac57-afe8fe011f01 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:45.808468 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:45.825222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce34d-8156-4a83-8ca7-467c249d98d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:45.826298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce34d-8156-4a83-8ca7-467c249d98d2 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:45.826767 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce34d-8156-4a83-8ca7-467c249d98d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:45.827209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce34d-8156-4a83-8ca7-467c249d98d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:45.836489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ce34d-8156-4a83-8ca7-467c249d98d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:45.838272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ce34d-8156-4a83-8ca7-467c249d98d2 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-714ce34d-8156-4a83-8ca7-467c249d98d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:45.853019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:45.854034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:45.855124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:45.855124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:45.855124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:45.855124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:45.855124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:45.855124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:45.855124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:45.855124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:45.855124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 10:36:45.855124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:45.855124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 413/822] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jul 27 10:36:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:45.858701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2ea22-c602-45fe-9576-13d6edfb48e5 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:45.866207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce34d-8156-4a83-8ca7-467c249d98d2 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:45.909469 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75ae06-7ccd-41cd-8c72-b8dcbdd11241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:45.910214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75ae06-7ccd-41cd-8c72-b8dcbdd11241 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:45.910589 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75ae06-7ccd-41cd-8c72-b8dcbdd11241 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:45.910937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75ae06-7ccd-41cd-8c72-b8dcbdd11241 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:45.911707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75ae06-7ccd-41cd-8c72-b8dcbdd11241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:45.912080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75ae06-7ccd-41cd-8c72-b8dcbdd11241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:45.913519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75ae06-7ccd-41cd-8c72-b8dcbdd11241 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:45.928969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 410/823] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:45.936486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75ae06-7ccd-41cd-8c72-b8dcbdd11241 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:45.991956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce34d-8156-4a83-8ca7-467c249d98d2 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:46.031294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02430ebc-173f-441a-84f0-a398a3f36d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:46.031922 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02430ebc-173f-441a-84f0-a398a3f36d19 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:46.032203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02430ebc-173f-441a-84f0-a398a3f36d19 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:46.032836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02430ebc-173f-441a-84f0-a398a3f36d19 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:46.033346 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02430ebc-173f-441a-84f0-a398a3f36d19 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:46.033661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02430ebc-173f-441a-84f0-a398a3f36d19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:46.035243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02430ebc-173f-441a-84f0-a398a3f36d19 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:46.053363 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75ae06-7ccd-41cd-8c72-b8dcbdd11241 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:46.059234 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 414/824] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Jul 27 10:36:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:46.060254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02430ebc-173f-441a-84f0-a398a3f36d19 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:46.081595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:46.097604 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:46.108605 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2c9af-826e-4925-bc97-7d6646ed6899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:46.109345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2c9af-826e-4925-bc97-7d6646ed6899 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:46.109657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2c9af-826e-4925-bc97-7d6646ed6899 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:46.110203 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2c9af-826e-4925-bc97-7d6646ed6899 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:46.118990 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2c9af-826e-4925-bc97-7d6646ed6899 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:46.120447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2c9af-826e-4925-bc97-7d6646ed6899 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-b4e2c9af-826e-4925-bc97-7d6646ed6899 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:46.136130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:46.137076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:46.137966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:46.137966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:46.137966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:46.137966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:46.137966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:46.137966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:46.137966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:46.137966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:46.137966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 411/825] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:46.139928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81796b7-d537-4592-914a-714bcfae68b3 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:46.139928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81796b7-d537-4592-914a-714bcfae68b3 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:46.139928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81796b7-d537-4592-914a-714bcfae68b3 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:46.141019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 412/826] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:46.145111 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81796b7-d537-4592-914a-714bcfae68b3 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:46.195674 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02430ebc-173f-441a-84f0-a398a3f36d19 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:46.232920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b30ac8-195b-434f-bbbb-087bfd8e8ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:46.233572 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b30ac8-195b-434f-bbbb-087bfd8e8ba7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:46.233859 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b30ac8-195b-434f-bbbb-087bfd8e8ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:46.234131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b30ac8-195b-434f-bbbb-087bfd8e8ba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:46.246107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b30ac8-195b-434f-bbbb-087bfd8e8ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:46.247588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b30ac8-195b-434f-bbbb-087bfd8e8ba7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:46.255970 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81796b7-d537-4592-914a-714bcfae68b3 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-01b30ac8-195b-434f-bbbb-087bfd8e8ba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:46.263265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:46.264897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:46.265828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:46.265828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:46.265828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:46.265828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:46.265828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 415/827] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:46.266259 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f85b2-1651-4165-8244-bd23a6de4028 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:46.266551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f85b2-1651-4165-8244-bd23a6de4028 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:46.266827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f85b2-1651-4165-8244-bd23a6de4028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:46.284593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-ae9f85b2-1651-4165-8244-bd23a6de4028 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:46.285795 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ae9f85b2-1651-4165-8244-bd23a6de4028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:46.301696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0e2f3-8776-4869-a80d-9e9aebfaabb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:46.302383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0e2f3-8776-4869-a80d-9e9aebfaabb8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:46.302665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0e2f3-8776-4869-a80d-9e9aebfaabb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:46.302939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0e2f3-8776-4869-a80d-9e9aebfaabb8 None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:46.303688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0e2f3-8776-4869-a80d-9e9aebfaabb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:46.303998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0e2f3-8776-4869-a80d-9e9aebfaabb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:46.305548 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0e2f3-8776-4869-a80d-9e9aebfaabb8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:46.319582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 413/828] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:46.324929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0e2f3-8776-4869-a80d-9e9aebfaabb8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:46.352474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:46.363819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 416/829] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:46.364909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f85b2-1651-4165-8244-bd23a6de4028 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:46.394236 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:46.455780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0e2f3-8776-4869-a80d-9e9aebfaabb8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:46.482654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f85b2-1651-4165-8244-bd23a6de4028 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:46.494792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50e367-f282-4a36-b501-966aa0268299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:46.495418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50e367-f282-4a36-b501-966aa0268299 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:46.495703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50e367-f282-4a36-b501-966aa0268299 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:46.495988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50e367-f282-4a36-b501-966aa0268299 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:46.496672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50e367-f282-4a36-b501-966aa0268299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:46.496992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50e367-f282-4a36-b501-966aa0268299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:46.498905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50e367-f282-4a36-b501-966aa0268299 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:46.511086 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 414/830] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:46.516368 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50e367-f282-4a36-b501-966aa0268299 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:46.526385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef89b6-fb2b-49d5-b7ea-2ef683c889c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:46.527145 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef89b6-fb2b-49d5-b7ea-2ef683c889c9 None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:46.527428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef89b6-fb2b-49d5-b7ea-2ef683c889c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:46.527705 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef89b6-fb2b-49d5-b7ea-2ef683c889c9 None admin] PATH_INFO: `/v3/projects/52e68e1a140146e28b504864955367c1/users/dc3b05867de6493e94c01e3c478e1d8e/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:46.529842 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef89b6-fb2b-49d5-b7ea-2ef683c889c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=52e68e1a140146e28b504864955367c1, user_id=dc3b05867de6493e94c01e3c478e1d8e, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:46.531599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef89b6-fb2b-49d5-b7ea-2ef683c889c9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:46.558233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 417/831] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:36:46 2022] PUT /identity/v3/projects/52e68e1a140146e28b504864955367c1/users/dc3b05867de6493e94c01e3c478e1d8e/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:36:46.558233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef89b6-fb2b-49d5-b7ea-2ef683c889c9 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:46.627550 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:46.631071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50e367-f282-4a36-b501-966aa0268299 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:46.645920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:46.678659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca43f73-dab5-4993-ac2e-dd36699a1510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:46.679642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca43f73-dab5-4993-ac2e-dd36699a1510 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:46.680204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca43f73-dab5-4993-ac2e-dd36699a1510 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:46.680619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca43f73-dab5-4993-ac2e-dd36699a1510 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:46.681424 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca43f73-dab5-4993-ac2e-dd36699a1510 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:46.683097 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca43f73-dab5-4993-ac2e-dd36699a1510 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-9ca43f73-dab5-4993-ac2e-dd36699a1510 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:46.693863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:46.695121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 10:36:46.695968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:46.698000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef89b6-fb2b-49d5-b7ea-2ef683c889c9 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:46.700366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 415/832] 10.222.0.43 () {56 vars in 1132 bytes} [Wed Jul 27 10:36:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:46.702884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca43f73-dab5-4993-ac2e-dd36699a1510 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:46.749773 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcce66-0dac-4ad0-b563-4107f597af1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:46.751145 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcce66-0dac-4ad0-b563-4107f597af1f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:46.751631 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcce66-0dac-4ad0-b563-4107f597af1f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:46.752104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcce66-0dac-4ad0-b563-4107f597af1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:46.760946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcce66-0dac-4ad0-b563-4107f597af1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:46.762515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcce66-0dac-4ad0-b563-4107f597af1f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-c1bcce66-0dac-4ad0-b563-4107f597af1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:46.777600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:46.778591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:46.780059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:46.780059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:46.780059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:46.780059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:46.780059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:46.780059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:46.780059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:46.780059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:46.780497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 418/833] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:46.787359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcce66-0dac-4ad0-b563-4107f597af1f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:46.831641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca43f73-dab5-4993-ac2e-dd36699a1510 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:46.882381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b9eee-9ad5-4a80-9301-ffa6aa07a4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:46.885090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b9eee-9ad5-4a80-9301-ffa6aa07a4e7 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:46.885521 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b9eee-9ad5-4a80-9301-ffa6aa07a4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:46.885938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b9eee-9ad5-4a80-9301-ffa6aa07a4e7 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:46.886843 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b9eee-9ad5-4a80-9301-ffa6aa07a4e7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:46.887291 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b9eee-9ad5-4a80-9301-ffa6aa07a4e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:46.889410 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b9eee-9ad5-4a80-9301-ffa6aa07a4e7 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:46.895184 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 416/834] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jul 27 10:36:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:46.903622 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b9eee-9ad5-4a80-9301-ffa6aa07a4e7 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:46.921530 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcce66-0dac-4ad0-b563-4107f597af1f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:46.941423 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:46.955238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:46.972272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994acc83-6b56-4abc-b5e8-3fa551c97440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:46.973184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994acc83-6b56-4abc-b5e8-3fa551c97440 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:46.974419 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994acc83-6b56-4abc-b5e8-3fa551c97440 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:46.974899 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994acc83-6b56-4abc-b5e8-3fa551c97440 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:46.975985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994acc83-6b56-4abc-b5e8-3fa551c97440 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:46.977575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994acc83-6b56-4abc-b5e8-3fa551c97440 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:46.980225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994acc83-6b56-4abc-b5e8-3fa551c97440 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:47.000566 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 419/835] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:47.007183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994acc83-6b56-4abc-b5e8-3fa551c97440 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:47.044190 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b9eee-9ad5-4a80-9301-ffa6aa07a4e7 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:47.082649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25158f94-1767-46dc-96d6-a38a1624dcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:47.083627 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158f94-1767-46dc-96d6-a38a1624dcfd None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:47.084082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158f94-1767-46dc-96d6-a38a1624dcfd None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:47.084586 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158f94-1767-46dc-96d6-a38a1624dcfd None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:47.085449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25158f94-1767-46dc-96d6-a38a1624dcfd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:47.085929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25158f94-1767-46dc-96d6-a38a1624dcfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:47.087581 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25158f94-1767-46dc-96d6-a38a1624dcfd None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:47.099576 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 417/836] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jul 27 10:36:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:47.116538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994acc83-6b56-4abc-b5e8-3fa551c97440 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:47.164859 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84e2c7-9a46-4a4c-a3b1-b6d5c17eb25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:47.165561 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84e2c7-9a46-4a4c-a3b1-b6d5c17eb25c None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:47.165843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84e2c7-9a46-4a4c-a3b1-b6d5c17eb25c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:47.166119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84e2c7-9a46-4a4c-a3b1-b6d5c17eb25c None admin] PATH_INFO: `/v3/projects/52e68e1a140146e28b504864955367c1/users/8cfba665ebb9497bad355c0c24f2ccfc/roles/02a6ae14988149d38f9e819dc66b2f48` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:47.183947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84e2c7-9a46-4a4c-a3b1-b6d5c17eb25c None admin] RBAC: Authorizing `identity:create_grant(project_id=52e68e1a140146e28b504864955367c1, user_id=8cfba665ebb9497bad355c0c24f2ccfc, role_id=02a6ae14988149d38f9e819dc66b2f48)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:47.185415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84e2c7-9a46-4a4c-a3b1-b6d5c17eb25c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:47.203015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 420/837] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:36:47 2022] PUT /identity/v3/projects/52e68e1a140146e28b504864955367c1/users/8cfba665ebb9497bad355c0c24f2ccfc/roles/02a6ae14988149d38f9e819dc66b2f48 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:36:47.736478 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c813e81-a1cb-47aa-9d69-09d01b46f4ce None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:47.736872 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c813e81-a1cb-47aa-9d69-09d01b46f4ce None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:47.737050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c813e81-a1cb-47aa-9d69-09d01b46f4ce None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:47.739662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 418/838] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:47.744294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c8a85-1ee3-44c1-be10-1f59a6320561 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:47.744589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c8a85-1ee3-44c1-be10-1f59a6320561 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:47.744865 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c8a85-1ee3-44c1-be10-1f59a6320561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:47.764276 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-4f3c8a85-1ee3-44c1-be10-1f59a6320561 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:47.764276 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4f3c8a85-1ee3-44c1-be10-1f59a6320561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:47.786980 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:47.840614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 421/839] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:47.862805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c813e81-a1cb-47aa-9d69-09d01b46f4ce None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:47.973023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:47.978858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c813e81-a1cb-47aa-9d69-09d01b46f4ce None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:48.014814 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d893296-6183-480c-83b3-5195ba3701ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:48.015725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d893296-6183-480c-83b3-5195ba3701ef None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:48.016189 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d893296-6183-480c-83b3-5195ba3701ef None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:48.016618 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d893296-6183-480c-83b3-5195ba3701ef None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:48.017381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d893296-6183-480c-83b3-5195ba3701ef None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:48.019327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d893296-6183-480c-83b3-5195ba3701ef None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-6d893296-6183-480c-83b3-5195ba3701ef None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:48.028644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:48.029974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:48.030916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:48.030916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:48.030916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:48.030916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:48.030916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:48.030916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:48.030916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:48.030916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:48.030916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:48.030916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:48.030916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:48.030916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:48.030916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 10:36:48.030916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:48.035226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 419/840] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:36:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:48.041428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c8a85-1ee3-44c1-be10-1f59a6320561 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:48.150784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c8a85-1ee3-44c1-be10-1f59a6320561 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:48.187834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a4a5d-70bf-4db1-8c44-7d4f94d3b227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:48.188466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4a5d-70bf-4db1-8c44-7d4f94d3b227 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:48.188748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4a5d-70bf-4db1-8c44-7d4f94d3b227 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:48.189026 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4a5d-70bf-4db1-8c44-7d4f94d3b227 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:48.189713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a4a5d-70bf-4db1-8c44-7d4f94d3b227 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:48.190019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a4a5d-70bf-4db1-8c44-7d4f94d3b227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:48.191432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a4a5d-70bf-4db1-8c44-7d4f94d3b227 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:48.196602 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 422/841] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:36:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:48.202042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d893296-6183-480c-83b3-5195ba3701ef None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:48.309265 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d893296-6183-480c-83b3-5195ba3701ef None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:48.347623 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233c6a0-1f45-4d54-a284-b578c14ae94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:48.348679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233c6a0-1f45-4d54-a284-b578c14ae94f None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:48.349171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233c6a0-1f45-4d54-a284-b578c14ae94f None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:48.349756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233c6a0-1f45-4d54-a284-b578c14ae94f None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:48.350729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233c6a0-1f45-4d54-a284-b578c14ae94f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:48.351372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233c6a0-1f45-4d54-a284-b578c14ae94f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:48.353039 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233c6a0-1f45-4d54-a284-b578c14ae94f None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:48.360297 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 420/842] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:36:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:48.707543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0acf24-ff6c-4755-b472-da4b3a156714 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:48.708095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0acf24-ff6c-4755-b472-da4b3a156714 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:48.708095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0acf24-ff6c-4755-b472-da4b3a156714 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:48.709694 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 423/843] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:48.715046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba84cc-9818-4219-96d2-b05405a5d579 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:48.715328 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba84cc-9818-4219-96d2-b05405a5d579 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:48.715607 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba84cc-9818-4219-96d2-b05405a5d579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:48.734788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-77ba84cc-9818-4219-96d2-b05405a5d579 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:48.735967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-77ba84cc-9818-4219-96d2-b05405a5d579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:48.760424 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:48.814329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 421/844] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:48.834123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0acf24-ff6c-4755-b472-da4b3a156714 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:48.854443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:48.965882 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0acf24-ff6c-4755-b472-da4b3a156714 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:49.004570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d0b14-1104-4299-a74d-c3b584a61e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:49.005474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d0b14-1104-4299-a74d-c3b584a61e07 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:49.005905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d0b14-1104-4299-a74d-c3b584a61e07 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:49.006385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d0b14-1104-4299-a74d-c3b584a61e07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:49.020400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d0b14-1104-4299-a74d-c3b584a61e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-cd6d0b14-1104-4299-a74d-c3b584a61e07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:49.025647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:49.026819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:49.027867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:49.027867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:49.027867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:49.027867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:49.027867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:49.027867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:49.027867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:49.027867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:49.027867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:49.027867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:49.027867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:36:49.027867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:49.030540 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 424/845] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:36:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:49.039321 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba84cc-9818-4219-96d2-b05405a5d579 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:49.152724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba84cc-9818-4219-96d2-b05405a5d579 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:49.191742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3372d5-0546-4aa2-83f0-b6faefeef3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:49.192643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3372d5-0546-4aa2-83f0-b6faefeef3bc None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:49.193077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3372d5-0546-4aa2-83f0-b6faefeef3bc None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:49.193518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3372d5-0546-4aa2-83f0-b6faefeef3bc None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:49.194419 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3372d5-0546-4aa2-83f0-b6faefeef3bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:49.194873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3372d5-0546-4aa2-83f0-b6faefeef3bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:49.196382 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3372d5-0546-4aa2-83f0-b6faefeef3bc None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:49.205762 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 422/846] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:49.214226 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d0b14-1104-4299-a74d-c3b584a61e07 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:49.298878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:49.303181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3055468-0cea-4f61-a444-b6fc42ebe07f None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:49.303753 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3055468-0cea-4f61-a444-b6fc42ebe07f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:49.304235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3055468-0cea-4f61-a444-b6fc42ebe07f None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:49.306046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 423/847] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:36:49.311742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72394d9-0fa6-4921-8db5-83e324b891c5 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:49.312121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72394d9-0fa6-4921-8db5-83e324b891c5 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:49.314935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72394d9-0fa6-4921-8db5-83e324b891c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:49.326547 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d0b14-1104-4299-a74d-c3b584a61e07 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:49.331779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-f72394d9-0fa6-4921-8db5-83e324b891c5 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:49.333243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f72394d9-0fa6-4921-8db5-83e324b891c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:49.349757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:49.366911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f26dd8-6deb-4567-becb-42416aeddf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:49.367104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f26dd8-6deb-4567-becb-42416aeddf67 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:49.367431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f26dd8-6deb-4567-becb-42416aeddf67 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:49.367657 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f26dd8-6deb-4567-becb-42416aeddf67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:49.378806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f26dd8-6deb-4567-becb-42416aeddf67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:49.380258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f26dd8-6deb-4567-becb-42416aeddf67 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-03f26dd8-6deb-4567-becb-42416aeddf67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:49.396019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:49.396977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:49.397896 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:49.397896 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:49.397896 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:49.397896 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:49.397896 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 425/848] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:49.399056 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8cb27-ddae-4550-96f6-a4e3fe344620 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:49.399056 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8cb27-ddae-4550-96f6-a4e3fe344620 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:49.399220 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8cb27-ddae-4550-96f6-a4e3fe344620 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:49.400621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 426/849] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:49.404921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8cb27-ddae-4550-96f6-a4e3fe344620 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:49.415652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 424/850] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:36:49.417169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408d3f6-74f0-42b1-9469-20198433f3c4 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:49.417460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408d3f6-74f0-42b1-9469-20198433f3c4 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:49.417736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408d3f6-74f0-42b1-9469-20198433f3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:49.439728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-5408d3f6-74f0-42b1-9469-20198433f3c4 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:49.441617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5408d3f6-74f0-42b1-9469-20198433f3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:49.526220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 425/851] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:49.526220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408d3f6-74f0-42b1-9469-20198433f3c4 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:49.532496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8cb27-ddae-4550-96f6-a4e3fe344620 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:49.568800 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:49.575693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1934c-431f-4fba-b141-948cb78315e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:49.576920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1934c-431f-4fba-b141-948cb78315e3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:49.577250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1934c-431f-4fba-b141-948cb78315e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:49.577530 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1934c-431f-4fba-b141-948cb78315e3 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:49.578279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1934c-431f-4fba-b141-948cb78315e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:49.578590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1934c-431f-4fba-b141-948cb78315e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:49.580218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1934c-431f-4fba-b141-948cb78315e3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:49.594352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 427/852] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:49.595163 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1934c-431f-4fba-b141-948cb78315e3 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:49.609693 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:49.632212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408d3f6-74f0-42b1-9469-20198433f3c4 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:49.672586 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e49016-daf6-4e47-99a9-2f7dfe0a56ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:49.673269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e49016-daf6-4e47-99a9-2f7dfe0a56ab None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:49.673555 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e49016-daf6-4e47-99a9-2f7dfe0a56ab None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:49.673844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e49016-daf6-4e47-99a9-2f7dfe0a56ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:49.685342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e49016-daf6-4e47-99a9-2f7dfe0a56ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-03e49016-daf6-4e47-99a9-2f7dfe0a56ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:49.690894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:49.691810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:49.692678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:49.692678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:49.692678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:49.692678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:49.692678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:49.692678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:49.692678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:49.692678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:49.692678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:49.692678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:49.692678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:36:49.692678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:49.692678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 426/853] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:36:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:49.694032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e49016-daf6-4e47-99a9-2f7dfe0a56ab None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:49.714575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1934c-431f-4fba-b141-948cb78315e3 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:49.753353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce86b7-0666-4fd9-9322-eb21f131717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:49.753983 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce86b7-0666-4fd9-9322-eb21f131717d None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:49.754297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce86b7-0666-4fd9-9322-eb21f131717d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:49.754580 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce86b7-0666-4fd9-9322-eb21f131717d None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:49.755288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce86b7-0666-4fd9-9322-eb21f131717d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:49.756659 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce86b7-0666-4fd9-9322-eb21f131717d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:49.772548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 428/854] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jul 27 10:36:49 2022] POST /identity/v3/services => generated 269 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:36:49.780251 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce86b7-0666-4fd9-9322-eb21f131717d None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:49.809851 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e49016-daf6-4e47-99a9-2f7dfe0a56ab None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:49.861404 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:49.863816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce88314-fb5e-49a3-9d99-898e8e4a125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:49.864684 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce88314-fb5e-49a3-9d99-898e8e4a125a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:49.865147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce88314-fb5e-49a3-9d99-898e8e4a125a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:49.865527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce88314-fb5e-49a3-9d99-898e8e4a125a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:49.871154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:49.879018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce88314-fb5e-49a3-9d99-898e8e4a125a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:49.881154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce88314-fb5e-49a3-9d99-898e8e4a125a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-9ce88314-fb5e-49a3-9d99-898e8e4a125a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:49.896907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:49.898006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:49.899002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:49.899002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:49.899002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:49.899002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:49.899002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:49.899002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:49.899002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:49.899002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:49.899002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 10:36:49.899002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:49.903539 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 427/855] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:36:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:49.905209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce88314-fb5e-49a3-9d99-898e8e4a125a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:49.946949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce86b7-0666-4fd9-9322-eb21f131717d None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:49.992990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7204326-b1a6-4b44-ac5c-46b263fea9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:49.993621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7204326-b1a6-4b44-ac5c-46b263fea9d9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:49.993906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7204326-b1a6-4b44-ac5c-46b263fea9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:49.994208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7204326-b1a6-4b44-ac5c-46b263fea9d9 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:49.994947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7204326-b1a6-4b44-ac5c-46b263fea9d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:49.995258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7204326-b1a6-4b44-ac5c-46b263fea9d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:49.996644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7204326-b1a6-4b44-ac5c-46b263fea9d9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:50.007350 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 429/856] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:36:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:50.014470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7204326-b1a6-4b44-ac5c-46b263fea9d9 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:50.038255 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce88314-fb5e-49a3-9d99-898e8e4a125a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:50.082155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69394b14-0736-4f39-a641-d63262b0ed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:50.082819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69394b14-0736-4f39-a641-d63262b0ed79 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:50.083099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69394b14-0736-4f39-a641-d63262b0ed79 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:50.083371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69394b14-0736-4f39-a641-d63262b0ed79 None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:50.084233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69394b14-0736-4f39-a641-d63262b0ed79 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:50.084543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69394b14-0736-4f39-a641-d63262b0ed79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:50.086039 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69394b14-0736-4f39-a641-d63262b0ed79 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:50.107617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 428/857] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Jul 27 10:36:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:50.116482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69394b14-0736-4f39-a641-d63262b0ed79 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:50.131478 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7204326-b1a6-4b44-ac5c-46b263fea9d9 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:50.148309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:50.178647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa71f0-e38b-4a4c-8eea-20a70019f68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:50.179297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa71f0-e38b-4a4c-8eea-20a70019f68e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:50.179623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa71f0-e38b-4a4c-8eea-20a70019f68e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:50.179906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa71f0-e38b-4a4c-8eea-20a70019f68e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:50.194405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:50.196953 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa71f0-e38b-4a4c-8eea-20a70019f68e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:50.200342 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa71f0-e38b-4a4c-8eea-20a70019f68e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-9dfa71f0-e38b-4a4c-8eea-20a70019f68e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:50.220001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:50.221041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:50.222032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:50.222032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:50.222032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:50.222032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:50.224330 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 430/858] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:50.230123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa71f0-e38b-4a4c-8eea-20a70019f68e None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:50.260718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69394b14-0736-4f39-a641-d63262b0ed79 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:50.312025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f4861-45f9-4134-9263-2114bfde2437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:50.312775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4861-45f9-4134-9263-2114bfde2437 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:50.313178 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4861-45f9-4134-9263-2114bfde2437 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:50.313521 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4861-45f9-4134-9263-2114bfde2437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:50.361022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa71f0-e38b-4a4c-8eea-20a70019f68e None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:50.386280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f4861-45f9-4134-9263-2114bfde2437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:50.387749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f4861-45f9-4134-9263-2114bfde2437 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:50.401325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2897fa-217d-4896-aa70-9c211df89974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:50.402321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2897fa-217d-4896-aa70-9c211df89974 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:50.402788 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2897fa-217d-4896-aa70-9c211df89974 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:50.403338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2897fa-217d-4896-aa70-9c211df89974 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:50.404559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2897fa-217d-4896-aa70-9c211df89974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:50.405184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2897fa-217d-4896-aa70-9c211df89974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:50.406824 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2897fa-217d-4896-aa70-9c211df89974 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:50.421175 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 431/859] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:50.427298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2897fa-217d-4896-aa70-9c211df89974 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:50.455793 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:50.465477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:50.509782 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 429/860] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:50 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:36:50.514329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fef1d-4c67-46f6-a543-84544d71b9bf None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:50.514329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fef1d-4c67-46f6-a543-84544d71b9bf None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:50.514329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fef1d-4c67-46f6-a543-84544d71b9bf None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:50.514329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 430/861] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:50.517299 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fef1d-4c67-46f6-a543-84544d71b9bf None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:50.557997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2897fa-217d-4896-aa70-9c211df89974 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:50.595948 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67118907-b817-422a-b43e-a0bfc2f01bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:50.596596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67118907-b817-422a-b43e-a0bfc2f01bba None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:50.596919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67118907-b817-422a-b43e-a0bfc2f01bba None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:50.597213 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67118907-b817-422a-b43e-a0bfc2f01bba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:50.606163 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67118907-b817-422a-b43e-a0bfc2f01bba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:50.608189 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67118907-b817-422a-b43e-a0bfc2f01bba None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-67118907-b817-422a-b43e-a0bfc2f01bba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:50.620938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:50.628829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:50.629849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:50.629849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:50.629849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:50.629849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:50.629849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:50.629849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:50.629849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:50.629849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:50.629849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 10:36:50.629849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:50.629849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 432/862] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jul 27 10:36:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:50.629849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9ae71-6503-4429-be74-9c4a0b3e6369 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:50.629849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9ae71-6503-4429-be74-9c4a0b3e6369 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:50.631148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9ae71-6503-4429-be74-9c4a0b3e6369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:50.643452 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fef1d-4c67-46f6-a543-84544d71b9bf None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:50.644307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-29d9ae71-6503-4429-be74-9c4a0b3e6369 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:50.645555 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-29d9ae71-6503-4429-be74-9c4a0b3e6369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:50.681732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac38bf-c510-40b4-8377-e3a3d8d6e129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:50.682403 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac38bf-c510-40b4-8377-e3a3d8d6e129 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:50.682955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac38bf-c510-40b4-8377-e3a3d8d6e129 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:50.683222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac38bf-c510-40b4-8377-e3a3d8d6e129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:50.697376 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac38bf-c510-40b4-8377-e3a3d8d6e129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:50.699407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac38bf-c510-40b4-8377-e3a3d8d6e129 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:50.722215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 433/863] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:50 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:50.722215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9ae71-6503-4429-be74-9c4a0b3e6369 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-8eac38bf-c510-40b4-8377-e3a3d8d6e129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:50.722806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:50.723628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:50.724519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:50.724519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:50.724519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:50.724519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:50.725446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 431/864] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:50.734293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac38bf-c510-40b4-8377-e3a3d8d6e129 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:50.735483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:50.744969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:50.833070 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9ae71-6503-4429-be74-9c4a0b3e6369 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:50.847891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac38bf-c510-40b4-8377-e3a3d8d6e129 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:50.875552 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfdc55-73bc-48dc-bdd3-c89006399e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:50.876258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfdc55-73bc-48dc-bdd3-c89006399e15 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:50.876880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfdc55-73bc-48dc-bdd3-c89006399e15 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:50.876880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfdc55-73bc-48dc-bdd3-c89006399e15 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:50.877828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfdc55-73bc-48dc-bdd3-c89006399e15 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:50.878228 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfdc55-73bc-48dc-bdd3-c89006399e15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:50.879754 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfdc55-73bc-48dc-bdd3-c89006399e15 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:50.888024 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eedd4-18b5-42f3-8b50-a7ebd28bbe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:50.888669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eedd4-18b5-42f3-8b50-a7ebd28bbe09 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:50.892133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eedd4-18b5-42f3-8b50-a7ebd28bbe09 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:50.892133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eedd4-18b5-42f3-8b50-a7ebd28bbe09 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:50.892133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eedd4-18b5-42f3-8b50-a7ebd28bbe09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:50.892133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eedd4-18b5-42f3-8b50-a7ebd28bbe09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:50.892133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6eedd4-18b5-42f3-8b50-a7ebd28bbe09 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:50.903189 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 434/865] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Jul 27 10:36:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:50.908087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 432/866] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:50.909215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfdc55-73bc-48dc-bdd3-c89006399e15 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:50.911256 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eedd4-18b5-42f3-8b50-a7ebd28bbe09 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:50.987514 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:50.989370 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:51.025271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfdc55-73bc-48dc-bdd3-c89006399e15 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:51.031850 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eedd4-18b5-42f3-8b50-a7ebd28bbe09 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:51.064563 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab817b22-6bd6-4b1d-86a2-7ad7971539d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:51.065428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab817b22-6bd6-4b1d-86a2-7ad7971539d7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:51.065890 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab817b22-6bd6-4b1d-86a2-7ad7971539d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:51.066244 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab817b22-6bd6-4b1d-86a2-7ad7971539d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:51.068647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb638bcf-1369-4e89-b9db-a0084c371c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:51.069420 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb638bcf-1369-4e89-b9db-a0084c371c03 None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:51.070325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb638bcf-1369-4e89-b9db-a0084c371c03 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:51.070629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb638bcf-1369-4e89-b9db-a0084c371c03 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:51.071340 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb638bcf-1369-4e89-b9db-a0084c371c03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:51.072736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb638bcf-1369-4e89-b9db-a0084c371c03 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:51.089439 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 433/867] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jul 27 10:36:50 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:36:51.090544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb638bcf-1369-4e89-b9db-a0084c371c03 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:51.163376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab817b22-6bd6-4b1d-86a2-7ad7971539d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:51.165535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab817b22-6bd6-4b1d-86a2-7ad7971539d7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:51.254101 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:51.260028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb638bcf-1369-4e89-b9db-a0084c371c03 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:51.291581 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:51.298265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 435/868] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:50 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:36:51.304551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab817b22-6bd6-4b1d-86a2-7ad7971539d7 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:51.309837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41dcd6-f4a5-4aa6-a88d-f971c131562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:51.311167 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41dcd6-f4a5-4aa6-a88d-f971c131562c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:51.311456 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41dcd6-f4a5-4aa6-a88d-f971c131562c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:51.311744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41dcd6-f4a5-4aa6-a88d-f971c131562c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:51.324500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41dcd6-f4a5-4aa6-a88d-f971c131562c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:51.326400 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41dcd6-f4a5-4aa6-a88d-f971c131562c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-8a41dcd6-f4a5-4aa6-a88d-f971c131562c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:51.341819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:51.343136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:51.344018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:51.344018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:51.344018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:51.344018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:51.344018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:51.344018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:51.344018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:51.344018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:51.344018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 434/869] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:51.348594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41dcd6-f4a5-4aa6-a88d-f971c131562c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:51.422122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab817b22-6bd6-4b1d-86a2-7ad7971539d7 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:51.460552 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0676945-8f03-4f84-8eb2-24736c6029a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:51.461572 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0676945-8f03-4f84-8eb2-24736c6029a9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:51.462072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0676945-8f03-4f84-8eb2-24736c6029a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:51.462594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0676945-8f03-4f84-8eb2-24736c6029a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:51.463121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41dcd6-f4a5-4aa6-a88d-f971c131562c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:51.478382 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0676945-8f03-4f84-8eb2-24736c6029a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:51.479908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0676945-8f03-4f84-8eb2-24736c6029a9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-e0676945-8f03-4f84-8eb2-24736c6029a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:51.495916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:51.496908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:51.498413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:51.498413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:51.498413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:51.498413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:51.498413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 436/870] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:51.505719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c1327-9905-4236-a57f-30544ac43944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:51.506716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c1327-9905-4236-a57f-30544ac43944 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:51.507220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c1327-9905-4236-a57f-30544ac43944 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:51.507721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c1327-9905-4236-a57f-30544ac43944 None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:51.508737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c1327-9905-4236-a57f-30544ac43944 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:51.509267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c1327-9905-4236-a57f-30544ac43944 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:51.511050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c1327-9905-4236-a57f-30544ac43944 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:51.511257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0676945-8f03-4f84-8eb2-24736c6029a9 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:51.531770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 435/871] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:51.533082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c1327-9905-4236-a57f-30544ac43944 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:51.539239 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:51.580589 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:51.621615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0676945-8f03-4f84-8eb2-24736c6029a9 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:51.644710 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c1327-9905-4236-a57f-30544ac43944 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:51.659704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4c05-2c19-4a8c-bf24-40a9cf9cd5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:51.660329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4c05-2c19-4a8c-bf24-40a9cf9cd5be None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:51.660612 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4c05-2c19-4a8c-bf24-40a9cf9cd5be None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:51.660888 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4c05-2c19-4a8c-bf24-40a9cf9cd5be None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:51.661587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc4c05-2c19-4a8c-bf24-40a9cf9cd5be None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:51.661893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc4c05-2c19-4a8c-bf24-40a9cf9cd5be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:51.663301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc4c05-2c19-4a8c-bf24-40a9cf9cd5be None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:51.676273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 437/872] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:51.681127 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4c05-2c19-4a8c-bf24-40a9cf9cd5be None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:51.689134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1ca10-6e96-40c0-92ce-631a642f350c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:51.689779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1ca10-6e96-40c0-92ce-631a642f350c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:51.690242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1ca10-6e96-40c0-92ce-631a642f350c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:51.690434 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1ca10-6e96-40c0-92ce-631a642f350c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:51.691288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1ca10-6e96-40c0-92ce-631a642f350c None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=dc3b05867de6493e94c01e3c478e1d8e) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:51.691607 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1ca10-6e96-40c0-92ce-631a642f350c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:51.696657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1ca10-6e96-40c0-92ce-631a642f350c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:51.706398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 436/873] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:51 2022] GET /identity/v3/role_assignments?user.id=dc3b05867de6493e94c01e3c478e1d8e&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=36208a24005e4ff98d827138292bea37 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:51.791428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:51.811144 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4c05-2c19-4a8c-bf24-40a9cf9cd5be None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:51.853041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c02f33-d58b-4b9b-a7f2-debb0a844439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:51.853710 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c02f33-d58b-4b9b-a7f2-debb0a844439 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:51.853990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c02f33-d58b-4b9b-a7f2-debb0a844439 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:51.854290 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c02f33-d58b-4b9b-a7f2-debb0a844439 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:51.862481 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c02f33-d58b-4b9b-a7f2-debb0a844439 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:51.863956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c02f33-d58b-4b9b-a7f2-debb0a844439 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-f7c02f33-d58b-4b9b-a7f2-debb0a844439 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:51.877909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:51.878906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:51.879812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:51.879812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:51.879812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:51.879812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:51.879812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:51.879812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:51.879812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:51.879812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:51.879812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 438/874] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:51.885120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1ca10-6e96-40c0-92ce-631a642f350c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:51.965275 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e18c34-6614-4c4b-9a44-f32ed9039fe8 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:51.965455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e18c34-6614-4c4b-9a44-f32ed9039fe8 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:51.965731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e18c34-6614-4c4b-9a44-f32ed9039fe8 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:51.967526 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 439/875] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:51.975664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351521fa-2173-4193-bf08-c1df8605b368 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:51.976005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351521fa-2173-4193-bf08-c1df8605b368 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:51.976279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351521fa-2173-4193-bf08-c1df8605b368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:51.999430 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-351521fa-2173-4193-bf08-c1df8605b368 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:52.001020 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-351521fa-2173-4193-bf08-c1df8605b368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:52.014912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1ca10-6e96-40c0-92ce-631a642f350c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:52.026964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:52.057175 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f4908-4384-4102-bd60-6330d4f65ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:52.058075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f4908-4384-4102-bd60-6330d4f65ff9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:52.058488 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f4908-4384-4102-bd60-6330d4f65ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:52.058769 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f4908-4384-4102-bd60-6330d4f65ff9 None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:52.059869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f4908-4384-4102-bd60-6330d4f65ff9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:52.060002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f4908-4384-4102-bd60-6330d4f65ff9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:52.061889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f4908-4384-4102-bd60-6330d4f65ff9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:52.075780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 437/876] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:52.083211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f4908-4384-4102-bd60-6330d4f65ff9 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:52.091165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 440/877] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:36:52.117906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351521fa-2173-4193-bf08-c1df8605b368 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:52.189636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f4908-4384-4102-bd60-6330d4f65ff9 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:52.204019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:52.225097 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deee24d-5366-4c4a-b1c1-46eed4e87164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:52.225642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deee24d-5366-4c4a-b1c1-46eed4e87164 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:52.225919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deee24d-5366-4c4a-b1c1-46eed4e87164 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:52.226210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deee24d-5366-4c4a-b1c1-46eed4e87164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:52.227002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deee24d-5366-4c4a-b1c1-46eed4e87164 None admin] RBAC: Adding query filter params (role.id=02a6ae14988149d38f9e819dc66b2f48, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=8cfba665ebb9497bad355c0c24f2ccfc) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:52.227310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deee24d-5366-4c4a-b1c1-46eed4e87164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:52.228737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deee24d-5366-4c4a-b1c1-46eed4e87164 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:52.242242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 438/878] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:52 2022] GET /identity/v3/role_assignments?user.id=8cfba665ebb9497bad355c0c24f2ccfc&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=02a6ae14988149d38f9e819dc66b2f48 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:52.242464 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351521fa-2173-4193-bf08-c1df8605b368 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:52.282350 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f906b-c4fa-4665-9fad-48b3540b5c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:52.283019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f906b-c4fa-4665-9fad-48b3540b5c4a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:52.283298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f906b-c4fa-4665-9fad-48b3540b5c4a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:52.283630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f906b-c4fa-4665-9fad-48b3540b5c4a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:52.284275 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f906b-c4fa-4665-9fad-48b3540b5c4a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:52.285714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f906b-c4fa-4665-9fad-48b3540b5c4a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-d89f906b-c4fa-4665-9fad-48b3540b5c4a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:52.296048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:52.297263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:52.298366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 441/879] 10.222.0.43 () {56 vars in 1132 bytes} [Wed Jul 27 10:36:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:52.305089 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deee24d-5366-4c4a-b1c1-46eed4e87164 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:52.346806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:52.428825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deee24d-5366-4c4a-b1c1-46eed4e87164 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:52.468315 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e87bcf-d709-4231-83dd-9339ae1a5841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:52.468942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e87bcf-d709-4231-83dd-9339ae1a5841 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:52.469219 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e87bcf-d709-4231-83dd-9339ae1a5841 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:52.469491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e87bcf-d709-4231-83dd-9339ae1a5841 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:52.470216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e87bcf-d709-4231-83dd-9339ae1a5841 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:52.470514 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e87bcf-d709-4231-83dd-9339ae1a5841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:52.471910 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e87bcf-d709-4231-83dd-9339ae1a5841 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:52.477344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 439/880] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jul 27 10:36:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:52.483377 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f906b-c4fa-4665-9fad-48b3540b5c4a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:52.596692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f906b-c4fa-4665-9fad-48b3540b5c4a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:52.633389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd41cd-854b-481b-a04c-1948504946ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:52.634010 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd41cd-854b-481b-a04c-1948504946ed None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:52.634329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd41cd-854b-481b-a04c-1948504946ed None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:52.634604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd41cd-854b-481b-a04c-1948504946ed None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:52.635288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd41cd-854b-481b-a04c-1948504946ed None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:52.635587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd41cd-854b-481b-a04c-1948504946ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:52.636964 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd41cd-854b-481b-a04c-1948504946ed None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:52.643264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 442/881] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jul 27 10:36:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:52.651290 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e87bcf-d709-4231-83dd-9339ae1a5841 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:52.758137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:52.767318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e87bcf-d709-4231-83dd-9339ae1a5841 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:52.805095 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed678f-e9bf-4f8e-af02-e98230979da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:52.806045 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed678f-e9bf-4f8e-af02-e98230979da6 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:52.806599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed678f-e9bf-4f8e-af02-e98230979da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:52.807067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed678f-e9bf-4f8e-af02-e98230979da6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:52.808698 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed678f-e9bf-4f8e-af02-e98230979da6 None admin] RBAC: Adding query filter params (interface=public, service_id=2ebe443a19c6417a8d2d890182fdea80, region_id=RegionOne) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:52.809224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed678f-e9bf-4f8e-af02-e98230979da6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:52.811848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed678f-e9bf-4f8e-af02-e98230979da6 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:52.826362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 440/882] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jul 27 10:36:52 2022] GET /identity/v3/endpoints?service_id=2ebe443a19c6417a8d2d890182fdea80&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:52.831415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd41cd-854b-481b-a04c-1948504946ed None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:52.836083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:52.962793 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd41cd-854b-481b-a04c-1948504946ed None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:53.001513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ce844-49c4-4568-953f-31b26061256d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:53.002147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ce844-49c4-4568-953f-31b26061256d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:53.002464 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ce844-49c4-4568-953f-31b26061256d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:53.002738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ce844-49c4-4568-953f-31b26061256d None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:53.003421 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ce844-49c4-4568-953f-31b26061256d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:53.005742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ce844-49c4-4568-953f-31b26061256d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:53.012082 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 443/883] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jul 27 10:36:52 2022] GET /identity/v3/services => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:36:53.324204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af1251-6c30-43cb-9438-06e6002233fe None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:53.324699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af1251-6c30-43cb-9438-06e6002233fe None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:53.324699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af1251-6c30-43cb-9438-06e6002233fe None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:53.326464 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 441/884] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:53.331926 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea6ec0-f85a-4280-a982-23fd17b65cb5 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:53.332224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea6ec0-f85a-4280-a982-23fd17b65cb5 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:53.332508 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea6ec0-f85a-4280-a982-23fd17b65cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:53.351318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-69ea6ec0-f85a-4280-a982-23fd17b65cb5 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:53.352526 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-69ea6ec0-f85a-4280-a982-23fd17b65cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:53.417770 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:53.430513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 444/885] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:53.450350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af1251-6c30-43cb-9438-06e6002233fe None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:53.566072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af1251-6c30-43cb-9438-06e6002233fe None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:53.604011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84f265-7684-49c5-bb28-0448e484c1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:53.604602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84f265-7684-49c5-bb28-0448e484c1fe None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:53.604884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84f265-7684-49c5-bb28-0448e484c1fe None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:53.605160 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84f265-7684-49c5-bb28-0448e484c1fe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:53.605817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84f265-7684-49c5-bb28-0448e484c1fe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:53.607304 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84f265-7684-49c5-bb28-0448e484c1fe None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-9a84f265-7684-49c5-bb28-0448e484c1fe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:53.617466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:53.618602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:53.619559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 442/886] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:36:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:53.626040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea6ec0-f85a-4280-a982-23fd17b65cb5 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:53.733624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea6ec0-f85a-4280-a982-23fd17b65cb5 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:53.770753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315714c-a133-47c3-b8ff-224dda9c2c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:53.771378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315714c-a133-47c3-b8ff-224dda9c2c81 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:53.771662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315714c-a133-47c3-b8ff-224dda9c2c81 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:53.771942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315714c-a133-47c3-b8ff-224dda9c2c81 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:53.772631 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315714c-a133-47c3-b8ff-224dda9c2c81 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:53.772941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315714c-a133-47c3-b8ff-224dda9c2c81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:53.774342 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315714c-a133-47c3-b8ff-224dda9c2c81 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:53.780040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 445/887] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:36:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:53.785629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84f265-7684-49c5-bb28-0448e484c1fe None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:53.812661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:53.897895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84f265-7684-49c5-bb28-0448e484c1fe None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:53.933000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439f891-33b8-4332-81b0-b449f78e85c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:53.933827 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439f891-33b8-4332-81b0-b449f78e85c9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:53.934346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439f891-33b8-4332-81b0-b449f78e85c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:53.934817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439f891-33b8-4332-81b0-b449f78e85c9 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:53.935822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439f891-33b8-4332-81b0-b449f78e85c9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:53.936205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439f891-33b8-4332-81b0-b449f78e85c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:53.937677 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439f891-33b8-4332-81b0-b449f78e85c9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:53.943728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 443/888] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:36:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:53.949486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315714c-a133-47c3-b8ff-224dda9c2c81 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:53.998608 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15437-cc09-494e-8eac-1e965632e2fc None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:53.998887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15437-cc09-494e-8eac-1e965632e2fc None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:53.999409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15437-cc09-494e-8eac-1e965632e2fc None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:54.001305 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 444/889] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:54.006918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da59f0-b767-450d-b056-f5b10e5c0447 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:54.007471 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da59f0-b767-450d-b056-f5b10e5c0447 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:54.007940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da59f0-b767-450d-b056-f5b10e5c0447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:54.017435 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:54.031523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-36da59f0-b767-450d-b056-f5b10e5c0447 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:54.033333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-36da59f0-b767-450d-b056-f5b10e5c0447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:54.072135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315714c-a133-47c3-b8ff-224dda9c2c81 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:54.122287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bc879-e45d-4c44-95d6-42cd2d02a657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:54.123389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bc879-e45d-4c44-95d6-42cd2d02a657 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:54.123904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bc879-e45d-4c44-95d6-42cd2d02a657 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:54.124407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bc879-e45d-4c44-95d6-42cd2d02a657 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:54.125383 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bc879-e45d-4c44-95d6-42cd2d02a657 None admin] RBAC: Adding query filter params (interface=public, service_id=a73e97e165c045d2973ea4fbe771bbcc, region_id=RegionOne) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:54.125910 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bc879-e45d-4c44-95d6-42cd2d02a657 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:54.127623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bc879-e45d-4c44-95d6-42cd2d02a657 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:54.130525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 445/890] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:54.134027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 446/891] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jul 27 10:36:53 2022] GET /identity/v3/endpoints?service_id=a73e97e165c045d2973ea4fbe771bbcc&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:54.140123 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da59f0-b767-450d-b056-f5b10e5c0447 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:54.146775 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bc879-e45d-4c44-95d6-42cd2d02a657 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:54.162269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:54.274441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da59f0-b767-450d-b056-f5b10e5c0447 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:54.282919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bc879-e45d-4c44-95d6-42cd2d02a657 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:54.315219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:54.324620 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7bb0d-9a25-4616-b9a4-7c503c803626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:54.325269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7bb0d-9a25-4616-b9a4-7c503c803626 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:54.325558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7bb0d-9a25-4616-b9a4-7c503c803626 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:54.326479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7bb0d-9a25-4616-b9a4-7c503c803626 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:54.327144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7bb0d-9a25-4616-b9a4-7c503c803626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:54.328507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7bb0d-9a25-4616-b9a4-7c503c803626 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:54.330050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780de338-d2af-4089-a709-6cfb5ab7e5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:54.331250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780de338-d2af-4089-a709-6cfb5ab7e5a3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:54.332031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780de338-d2af-4089-a709-6cfb5ab7e5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:54.332518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780de338-d2af-4089-a709-6cfb5ab7e5a3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:54.333368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780de338-d2af-4089-a709-6cfb5ab7e5a3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:54.334923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 446/892] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jul 27 10:36:54 2022] GET /identity/v3/services => generated 1268 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:36:54.335215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780de338-d2af-4089-a709-6cfb5ab7e5a3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-780de338-d2af-4089-a709-6cfb5ab7e5a3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:54.345256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:54.346374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:54.347222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:54.347222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:54.347222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:54.347222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:54.347222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:54.347222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:54.347222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:54.347222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:54.347222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:54.347222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:54.347222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:54.347222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:54.347222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:36:54.347222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:54.355240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 447/893] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jul 27 10:36:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:54.357553 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7bb0d-9a25-4616-b9a4-7c503c803626 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:54.452057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:54.474618 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7bb0d-9a25-4616-b9a4-7c503c803626 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:54.512478 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8cee8-d4ef-44dd-8e48-4627340d135a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:54.513163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8cee8-d4ef-44dd-8e48-4627340d135a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:54.513571 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8cee8-d4ef-44dd-8e48-4627340d135a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:54.514052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8cee8-d4ef-44dd-8e48-4627340d135a None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:54.514747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8cee8-d4ef-44dd-8e48-4627340d135a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:54.515057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8cee8-d4ef-44dd-8e48-4627340d135a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:54.516423 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8cee8-d4ef-44dd-8e48-4627340d135a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:54.521846 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 447/894] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jul 27 10:36:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:54.527709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780de338-d2af-4089-a709-6cfb5ab7e5a3 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:54.531593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018a1ba-5c12-4af4-bd8f-7442acf44dee None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:54.531886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018a1ba-5c12-4af4-bd8f-7442acf44dee None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:54.532170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018a1ba-5c12-4af4-bd8f-7442acf44dee None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:54.533714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 448/895] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:36:54.539303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcf811-6e6d-4d15-aacc-2530c78726a6 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:54.539908 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcf811-6e6d-4d15-aacc-2530c78726a6 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:54.540384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcf811-6e6d-4d15-aacc-2530c78726a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:54.561607 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-2fbcf811-6e6d-4d15-aacc-2530c78726a6 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:54.563176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2fbcf811-6e6d-4d15-aacc-2530c78726a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:54.646124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 449/896] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:36:54.662820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780de338-d2af-4089-a709-6cfb5ab7e5a3 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:54.671873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcf811-6e6d-4d15-aacc-2530c78726a6 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:54.705070 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa72ba-b35a-4c04-9b8c-2ccf7792df03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:54.705764 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa72ba-b35a-4c04-9b8c-2ccf7792df03 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:54.706065 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa72ba-b35a-4c04-9b8c-2ccf7792df03 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:54.706381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa72ba-b35a-4c04-9b8c-2ccf7792df03 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:54.707082 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa72ba-b35a-4c04-9b8c-2ccf7792df03 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:54.707718 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa72ba-b35a-4c04-9b8c-2ccf7792df03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:54.709394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa72ba-b35a-4c04-9b8c-2ccf7792df03 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:54.716254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 448/897] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jul 27 10:36:54 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:54.766095 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:54.796914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcf811-6e6d-4d15-aacc-2530c78726a6 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:54.836866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11ad02-b6f3-4643-be11-eb94a1959f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:54.837956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11ad02-b6f3-4643-be11-eb94a1959f6d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:54.838509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11ad02-b6f3-4643-be11-eb94a1959f6d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:54.839009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11ad02-b6f3-4643-be11-eb94a1959f6d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:54.852855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11ad02-b6f3-4643-be11-eb94a1959f6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-6c11ad02-b6f3-4643-be11-eb94a1959f6d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:54.860014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:54.861059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:54.861902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:54.861902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:54.861902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:54.861902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:54.861902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:54.861902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:54.861902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:54.861902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:54.861902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:54.861902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:54.861902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 10:36:54.861902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:54.864891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 450/898] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Jul 27 10:36:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:54.871212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa72ba-b35a-4c04-9b8c-2ccf7792df03 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:54.944562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:54.996242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa72ba-b35a-4c04-9b8c-2ccf7792df03 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:55.035484 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db016d-3213-4d62-8f3f-02ba4b89d4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:55.036592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db016d-3213-4d62-8f3f-02ba4b89d4e9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:55.037246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db016d-3213-4d62-8f3f-02ba4b89d4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:55.038021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db016d-3213-4d62-8f3f-02ba4b89d4e9 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:55.039663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db016d-3213-4d62-8f3f-02ba4b89d4e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:55.040494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db016d-3213-4d62-8f3f-02ba4b89d4e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:55.043329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db016d-3213-4d62-8f3f-02ba4b89d4e9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:55.056444 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 449/899] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Jul 27 10:36:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:55.063358 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11ad02-b6f3-4643-be11-eb94a1959f6d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:55.178933 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11ad02-b6f3-4643-be11-eb94a1959f6d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:55.179456 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba962-360a-45c4-b427-ac86a99bd964 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:55.179743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba962-360a-45c4-b427-ac86a99bd964 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:55.180021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba962-360a-45c4-b427-ac86a99bd964 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:55.181616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 450/900] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:36:55.187426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f388638-277e-4d6e-bfdf-c94cc52def83 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:55.187709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f388638-277e-4d6e-bfdf-c94cc52def83 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:55.187990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f388638-277e-4d6e-bfdf-c94cc52def83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:55.207298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-5f388638-277e-4d6e-bfdf-c94cc52def83 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:55.208489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5f388638-277e-4d6e-bfdf-c94cc52def83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:55.219148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6b616-4ace-4f35-b2bc-763808e2bc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:55.219810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b616-4ace-4f35-b2bc-763808e2bc93 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:55.220098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b616-4ace-4f35-b2bc-763808e2bc93 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:55.220426 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6b616-4ace-4f35-b2bc-763808e2bc93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:55.222460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:55.232160 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6b616-4ace-4f35-b2bc-763808e2bc93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:55.233703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6b616-4ace-4f35-b2bc-763808e2bc93 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-89a6b616-4ace-4f35-b2bc-763808e2bc93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:55.251716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:55.252669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:55.253551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:55.253551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:55.253551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:55.253551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:55.253551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 451/901] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:55.258649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6b616-4ace-4f35-b2bc-763808e2bc93 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:55.306239 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 451/902] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:55.322084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f388638-277e-4d6e-bfdf-c94cc52def83 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:55.382073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:55.394271 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6b616-4ace-4f35-b2bc-763808e2bc93 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:55.444121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28350435-4a40-493a-bea2-c8a1184bd458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:55.445295 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28350435-4a40-493a-bea2-c8a1184bd458 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:55.446118 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28350435-4a40-493a-bea2-c8a1184bd458 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:55.446903 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28350435-4a40-493a-bea2-c8a1184bd458 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:55.447811 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28350435-4a40-493a-bea2-c8a1184bd458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:55.448438 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28350435-4a40-493a-bea2-c8a1184bd458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:55.450675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28350435-4a40-493a-bea2-c8a1184bd458 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:55.456566 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f388638-277e-4d6e-bfdf-c94cc52def83 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:55.468191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 452/903] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:55.474028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28350435-4a40-493a-bea2-c8a1184bd458 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:55.498996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac8787-3608-4ff8-905d-dd171c960e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:55.500014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8787-3608-4ff8-905d-dd171c960e96 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:55.500450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8787-3608-4ff8-905d-dd171c960e96 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:55.500893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8787-3608-4ff8-905d-dd171c960e96 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:55.501695 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac8787-3608-4ff8-905d-dd171c960e96 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:55.503412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac8787-3608-4ff8-905d-dd171c960e96 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-90ac8787-3608-4ff8-905d-dd171c960e96 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:55.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:55.515658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 10:36:55.516497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:55.519685 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 452/904] 10.222.0.43 () {56 vars in 1132 bytes} [Wed Jul 27 10:36:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:55.530227 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac8787-3608-4ff8-905d-dd171c960e96 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:55.542961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:55.617010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28350435-4a40-493a-bea2-c8a1184bd458 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:55.642976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac8787-3608-4ff8-905d-dd171c960e96 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:55.654338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:55.670928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc6e69-df9f-412c-8ad4-bd6f5e33528c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:55.672430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6e69-df9f-412c-8ad4-bd6f5e33528c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:55.673200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6e69-df9f-412c-8ad4-bd6f5e33528c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:55.673720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc6e69-df9f-412c-8ad4-bd6f5e33528c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:55.685792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc6e69-df9f-412c-8ad4-bd6f5e33528c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:55.687482 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e950db1-162b-405f-8477-6957e0d37da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:55.688106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e950db1-162b-405f-8477-6957e0d37da8 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:55.688384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e950db1-162b-405f-8477-6957e0d37da8 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:55.688653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e950db1-162b-405f-8477-6957e0d37da8 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:55.688929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc6e69-df9f-412c-8ad4-bd6f5e33528c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:55.689337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e950db1-162b-405f-8477-6957e0d37da8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:55.689637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e950db1-162b-405f-8477-6957e0d37da8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:55.691008 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e950db1-162b-405f-8477-6957e0d37da8 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:55.701323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 453/905] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jul 27 10:36:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:55.702393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e950db1-162b-405f-8477-6957e0d37da8 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-b4bc6e69-df9f-412c-8ad4-bd6f5e33528c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:36:55.704707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:55.705669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:55.706653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:55.706653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:55.706653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:36:55.706653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:36:55.706653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:36:55.706653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:36:55.706653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:36:55.706653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:36:55.706653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 10:36:55.706653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:55.712183 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 453/906] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jul 27 10:36:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:55.713872 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc6e69-df9f-412c-8ad4-bd6f5e33528c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:55.836562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e950db1-162b-405f-8477-6957e0d37da8 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:55.836757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc6e69-df9f-412c-8ad4-bd6f5e33528c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:55.845070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:55.876070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689b1d8-76f3-4493-bab2-cdc5448cfcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:55.876808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689b1d8-76f3-4493-bab2-cdc5448cfcc7 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:55.877090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689b1d8-76f3-4493-bab2-cdc5448cfcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:55.877364 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689b1d8-76f3-4493-bab2-cdc5448cfcc7 None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:55.878169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689b1d8-76f3-4493-bab2-cdc5448cfcc7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:55.878503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689b1d8-76f3-4493-bab2-cdc5448cfcc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:55.879930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689b1d8-76f3-4493-bab2-cdc5448cfcc7 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:55.885133 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db4d3f-b9c9-4f5e-a0f3-1d8bd2ed6c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:55.885997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db4d3f-b9c9-4f5e-a0f3-1d8bd2ed6c68 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:55.886502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db4d3f-b9c9-4f5e-a0f3-1d8bd2ed6c68 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:55.887307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db4d3f-b9c9-4f5e-a0f3-1d8bd2ed6c68 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:55.888889 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db4d3f-b9c9-4f5e-a0f3-1d8bd2ed6c68 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:55.889618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db4d3f-b9c9-4f5e-a0f3-1d8bd2ed6c68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:55.892131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db4d3f-b9c9-4f5e-a0f3-1d8bd2ed6c68 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:55.899032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 454/907] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jul 27 10:36:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:55.907358 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 454/908] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Jul 27 10:36:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:55.907551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db4d3f-b9c9-4f5e-a0f3-1d8bd2ed6c68 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:55.908476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689b1d8-76f3-4493-bab2-cdc5448cfcc7 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:55.955222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:56.030845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db4d3f-b9c9-4f5e-a0f3-1d8bd2ed6c68 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:56.041485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689b1d8-76f3-4493-bab2-cdc5448cfcc7 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:56.069754 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17d26b-f79e-40d5-8b90-a3792f4c5b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:56.070557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d26b-f79e-40d5-8b90-a3792f4c5b31 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:56.070957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d26b-f79e-40d5-8b90-a3792f4c5b31 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:56.071503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d26b-f79e-40d5-8b90-a3792f4c5b31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:56.072133 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17d26b-f79e-40d5-8b90-a3792f4c5b31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:56.073582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17d26b-f79e-40d5-8b90-a3792f4c5b31 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:56.091652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83c7b9-4f67-4ed1-9da6-99459b246f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:56.092182 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83c7b9-4f67-4ed1-9da6-99459b246f49 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:56.092463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83c7b9-4f67-4ed1-9da6-99459b246f49 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:56.092741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83c7b9-4f67-4ed1-9da6-99459b246f49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:56.106173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 455/909] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:36:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:36:56.134284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:56.177519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83c7b9-4f67-4ed1-9da6-99459b246f49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:56.179031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83c7b9-4f67-4ed1-9da6-99459b246f49 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:56.290706 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 455/910] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:36:55 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:36:56.297377 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17d26b-f79e-40d5-8b90-a3792f4c5b31 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:56.405286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:56.421383 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17d26b-f79e-40d5-8b90-a3792f4c5b31 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:56.448611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57d41-1187-4754-9ea6-9e613da7f7be None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:56.449155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57d41-1187-4754-9ea6-9e613da7f7be None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:56.449155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57d41-1187-4754-9ea6-9e613da7f7be None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:56.451324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 456/911] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:56.460087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8305183-8ebd-471e-ac2e-2bdc99ebd573 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:56.460675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8305183-8ebd-471e-ac2e-2bdc99ebd573 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:56.461175 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8305183-8ebd-471e-ac2e-2bdc99ebd573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:56.466238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc63b-77bd-418d-976a-549199984c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:56.467307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc63b-77bd-418d-976a-549199984c6a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:56.467605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc63b-77bd-418d-976a-549199984c6a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:56.467888 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc63b-77bd-418d-976a-549199984c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:56.479741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fc63b-77bd-418d-976a-549199984c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:56.481359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fc63b-77bd-418d-976a-549199984c6a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:56.482689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-d8305183-8ebd-471e-ac2e-2bdc99ebd573 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:56.484232 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-d8305183-8ebd-471e-ac2e-2bdc99ebd573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-2b0fc63b-77bd-418d-976a-549199984c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:36:56.497535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:56.498794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:56.499711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:36:56.499711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:36:56.499711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:36:56.499711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:56.499711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 456/912] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:56.505849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc63b-77bd-418d-976a-549199984c6a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:56.555401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:56.570210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 457/913] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:36:56.595198 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8305183-8ebd-471e-ac2e-2bdc99ebd573 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:56.632732 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc63b-77bd-418d-976a-549199984c6a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:56.684671 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8492280-af3b-4bcf-9905-676926591ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:56.686753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8492280-af3b-4bcf-9905-676926591ed9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:56.687255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8492280-af3b-4bcf-9905-676926591ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:56.688093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8492280-af3b-4bcf-9905-676926591ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:56.689021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8492280-af3b-4bcf-9905-676926591ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:56.689847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8492280-af3b-4bcf-9905-676926591ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:56.691796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8492280-af3b-4bcf-9905-676926591ed9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:56.708663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 457/914] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:56.708663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:56.718309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8492280-af3b-4bcf-9905-676926591ed9 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:56.719023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8305183-8ebd-471e-ac2e-2bdc99ebd573 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:56.763789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19558c0-0397-4b3d-8828-7d7be8fcbf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:56.764480 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19558c0-0397-4b3d-8828-7d7be8fcbf1c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:56.764765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19558c0-0397-4b3d-8828-7d7be8fcbf1c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:56.765043 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19558c0-0397-4b3d-8828-7d7be8fcbf1c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:56.765840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19558c0-0397-4b3d-8828-7d7be8fcbf1c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:56.768088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19558c0-0397-4b3d-8828-7d7be8fcbf1c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-f19558c0-0397-4b3d-8828-7d7be8fcbf1c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:56.779639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:56.780725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:56.781808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 458/915] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:36:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:56.786951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19558c0-0397-4b3d-8828-7d7be8fcbf1c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:56.846526 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8492280-af3b-4bcf-9905-676926591ed9 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:56.878859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:56.892206 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bc502-3962-4fb5-88ad-e50a3fca57c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:56.892773 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bc502-3962-4fb5-88ad-e50a3fca57c2 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:56.893055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bc502-3962-4fb5-88ad-e50a3fca57c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:56.893331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bc502-3962-4fb5-88ad-e50a3fca57c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:56.900696 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243bc502-3962-4fb5-88ad-e50a3fca57c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:56.902153 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243bc502-3962-4fb5-88ad-e50a3fca57c2 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-243bc502-3962-4fb5-88ad-e50a3fca57c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:36:56.914691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:56.915639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:56.916571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:36:56.916571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:36:56.916571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:36:56.916571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:36:56.916571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:36:56.916571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:36:56.916571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:36:56.916571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:56.921348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 458/916] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:36:56.922637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f724b0-cfa6-4372-8d69-bbc49f460034 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:56.922887 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f724b0-cfa6-4372-8d69-bbc49f460034 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:56.923165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f724b0-cfa6-4372-8d69-bbc49f460034 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:56.926307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 459/917] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:56.926307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f724b0-cfa6-4372-8d69-bbc49f460034 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:56.936350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19558c0-0397-4b3d-8828-7d7be8fcbf1c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:56.975604 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e5690-65f0-4dde-b164-c290138e9e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:56.976583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e5690-65f0-4dde-b164-c290138e9e62 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:56.977015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e5690-65f0-4dde-b164-c290138e9e62 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:56.977352 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e5690-65f0-4dde-b164-c290138e9e62 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:56.978048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e5690-65f0-4dde-b164-c290138e9e62 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:56.978401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e5690-65f0-4dde-b164-c290138e9e62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:56.979763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e5690-65f0-4dde-b164-c290138e9e62 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:56.985278 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 459/918] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:36:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:36:56.986490 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c360e-93b1-4333-91ab-0d084a53562a None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:56.986777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c360e-93b1-4333-91ab-0d084a53562a None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:56.987053 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c360e-93b1-4333-91ab-0d084a53562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:56.998699 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:57.006098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-2a3c360e-93b1-4333-91ab-0d084a53562a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:57.007373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2a3c360e-93b1-4333-91ab-0d084a53562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:57.043845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f724b0-cfa6-4372-8d69-bbc49f460034 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:57.084646 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783eab9f-e7cd-493b-be0b-687d4afb4226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:57.085315 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eab9f-e7cd-493b-be0b-687d4afb4226 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:57.085559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eab9f-e7cd-493b-be0b-687d4afb4226 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:57.085836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eab9f-e7cd-493b-be0b-687d4afb4226 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:57.086798 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783eab9f-e7cd-493b-be0b-687d4afb4226 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:57.087109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783eab9f-e7cd-493b-be0b-687d4afb4226 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:57.088538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783eab9f-e7cd-493b-be0b-687d4afb4226 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:57.098234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 460/919] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:57.098234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c360e-93b1-4333-91ab-0d084a53562a None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:57.102371 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 460/920] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:57.108483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783eab9f-e7cd-493b-be0b-687d4afb4226 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:57.155245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:57.212115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c360e-93b1-4333-91ab-0d084a53562a None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:57.224484 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783eab9f-e7cd-493b-be0b-687d4afb4226 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:57.247572 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:57.248725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30054607-9c6f-41bd-af22-00302ddfd7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:57.249354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30054607-9c6f-41bd-af22-00302ddfd7e1 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:57.249634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30054607-9c6f-41bd-af22-00302ddfd7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:57.250025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30054607-9c6f-41bd-af22-00302ddfd7e1 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:57.251147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30054607-9c6f-41bd-af22-00302ddfd7e1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:57.251455 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30054607-9c6f-41bd-af22-00302ddfd7e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:57.252816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30054607-9c6f-41bd-af22-00302ddfd7e1 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:57.258479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 461/921] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jul 27 10:36:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:57.259526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30054607-9c6f-41bd-af22-00302ddfd7e1 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:57.269174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba7433-aebb-441b-a266-853217ec1004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:57.270131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba7433-aebb-441b-a266-853217ec1004 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:57.270584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba7433-aebb-441b-a266-853217ec1004 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:57.271105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba7433-aebb-441b-a266-853217ec1004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:57.272081 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba7433-aebb-441b-a266-853217ec1004 None admin] RBAC: Adding query filter params (role.id=569a224091254f49a695cfe9bad598c8, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=8cfba665ebb9497bad355c0c24f2ccfc) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:57.272593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba7433-aebb-441b-a266-853217ec1004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:57.274165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba7433-aebb-441b-a266-853217ec1004 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:57.281207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 461/922] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:36:57 2022] GET /identity/v3/role_assignments?user.id=8cfba665ebb9497bad355c0c24f2ccfc&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=569a224091254f49a695cfe9bad598c8 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:57.282168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba7433-aebb-441b-a266-853217ec1004 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:57.400454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30054607-9c6f-41bd-af22-00302ddfd7e1 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:57.422870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:57.432249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba7433-aebb-441b-a266-853217ec1004 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:57.446592 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe240a3-03dc-4d1c-8226-e59d0d3799ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:57.447252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe240a3-03dc-4d1c-8226-e59d0d3799ab None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:57.447566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe240a3-03dc-4d1c-8226-e59d0d3799ab None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:57.448565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe240a3-03dc-4d1c-8226-e59d0d3799ab None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:57.449281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe240a3-03dc-4d1c-8226-e59d0d3799ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:57.451048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe240a3-03dc-4d1c-8226-e59d0d3799ab None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:57.478725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 462/923] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jul 27 10:36:57 2022] POST /identity/v3/services => generated 241 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:36:57.483585 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb0ac5-b5be-4067-85b8-951bd1cedad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:57.484299 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb0ac5-b5be-4067-85b8-951bd1cedad9 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:57.484583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb0ac5-b5be-4067-85b8-951bd1cedad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:57.484863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb0ac5-b5be-4067-85b8-951bd1cedad9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:57.485667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb0ac5-b5be-4067-85b8-951bd1cedad9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:57.487208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb0ac5-b5be-4067-85b8-951bd1cedad9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:57.513174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 462/924] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:36:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:36:58.277589 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207ba6d-9311-48e4-a7b2-391b6a8cd1b9 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:58.277955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207ba6d-9311-48e4-a7b2-391b6a8cd1b9 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:58.278060 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207ba6d-9311-48e4-a7b2-391b6a8cd1b9 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:58.280309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 463/925] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:58.285700 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4394748-9c16-4cd8-a3cf-5a46a85794a4 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:58.286148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4394748-9c16-4cd8-a3cf-5a46a85794a4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:58.286362 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4394748-9c16-4cd8-a3cf-5a46a85794a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:58.309198 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b4394748-9c16-4cd8-a3cf-5a46a85794a4 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:58.311070 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b4394748-9c16-4cd8-a3cf-5a46a85794a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:58.342007 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:58.388860 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 463/926] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:36:58.411306 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207ba6d-9311-48e4-a7b2-391b6a8cd1b9 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:58.519406 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207ba6d-9311-48e4-a7b2-391b6a8cd1b9 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:58.554819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21bece-38a2-4ec7-92d8-c6cff455b888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:58.555805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21bece-38a2-4ec7-92d8-c6cff455b888 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:58.556281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21bece-38a2-4ec7-92d8-c6cff455b888 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:58.556746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21bece-38a2-4ec7-92d8-c6cff455b888 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:58.557827 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21bece-38a2-4ec7-92d8-c6cff455b888 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:58.559413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21bece-38a2-4ec7-92d8-c6cff455b888 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-4b21bece-38a2-4ec7-92d8-c6cff455b888 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:58.568944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:58.569956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:58.570844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:58.570844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:58.570844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:58.570844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:58.570844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:58.570844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:58.570844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:58.570844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:58.570844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:58.570844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:58.570844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:58.570844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:58.570844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 10:36:58.570844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:36:58.573604 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 464/927] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:36:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:58.580186 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4394748-9c16-4cd8-a3cf-5a46a85794a4 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:58.689099 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4394748-9c16-4cd8-a3cf-5a46a85794a4 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:58.726806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2a369-2011-49e9-b5a8-4a3bb531e889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:58.727440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2a369-2011-49e9-b5a8-4a3bb531e889 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:58.727724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2a369-2011-49e9-b5a8-4a3bb531e889 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:58.727997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2a369-2011-49e9-b5a8-4a3bb531e889 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:58.728691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2a369-2011-49e9-b5a8-4a3bb531e889 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:58.728998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2a369-2011-49e9-b5a8-4a3bb531e889 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:58.730399 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2a369-2011-49e9-b5a8-4a3bb531e889 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:58.736469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 464/928] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jul 27 10:36:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:58.742100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21bece-38a2-4ec7-92d8-c6cff455b888 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:58.787752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:58.853355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21bece-38a2-4ec7-92d8-c6cff455b888 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:58.892042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77828a22-cbe5-4c20-81f6-6b30c5824a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:58.892042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77828a22-cbe5-4c20-81f6-6b30c5824a8d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:58.892042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77828a22-cbe5-4c20-81f6-6b30c5824a8d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:58.892042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77828a22-cbe5-4c20-81f6-6b30c5824a8d None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:58.892475 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77828a22-cbe5-4c20-81f6-6b30c5824a8d None admin] RBAC: Adding query filter params (type=compute) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:58.892475 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77828a22-cbe5-4c20-81f6-6b30c5824a8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:58.892727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77828a22-cbe5-4c20-81f6-6b30c5824a8d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:58.902246 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 465/929] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jul 27 10:36:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:59.427635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7cc5d-9d5f-4e2c-8757-8f229ff43caf None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:59.428208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7cc5d-9d5f-4e2c-8757-8f229ff43caf None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:59.428428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7cc5d-9d5f-4e2c-8757-8f229ff43caf None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:59.430124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 465/930] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:59.436746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105eb4-9b89-4846-9fd0-d893b9051bda None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:59.437182 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105eb4-9b89-4846-9fd0-d893b9051bda None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:59.437553 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa105eb4-9b89-4846-9fd0-d893b9051bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:59.456344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-fa105eb4-9b89-4846-9fd0-d893b9051bda None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:59.457527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-fa105eb4-9b89-4846-9fd0-d893b9051bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:59.527524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 466/931] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:59.550396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7cc5d-9d5f-4e2c-8757-8f229ff43caf None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:59.562346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535dce-298a-4a58-ac0a-8f70eafb86f5 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:59.562965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535dce-298a-4a58-ac0a-8f70eafb86f5 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:59.563445 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535dce-298a-4a58-ac0a-8f70eafb86f5 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:59.565251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 467/932] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:36:59.570662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f97d-2ac6-461b-a078-09112dd30952 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:59.571195 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f97d-2ac6-461b-a078-09112dd30952 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:59.571653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6f97d-2ac6-461b-a078-09112dd30952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:59.581966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:59.591629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-38a6f97d-2ac6-461b-a078-09112dd30952 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:59.593030 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-38a6f97d-2ac6-461b-a078-09112dd30952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:59.623715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:59.678498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 468/933] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:36:59.681456 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7cc5d-9d5f-4e2c-8757-8f229ff43caf None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:59.686791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd3a85-d795-42ce-8ca3-b36261529f91 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:59.687080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd3a85-d795-42ce-8ca3-b36261529f91 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:59.687357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd3a85-d795-42ce-8ca3-b36261529f91 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:59.688968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 469/934] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:36:59.693967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cd0f0-47f8-4f26-ada5-ca941dfc8ffb None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:59.694292 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cd0f0-47f8-4f26-ada5-ca941dfc8ffb None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:59.694928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cd0f0-47f8-4f26-ada5-ca941dfc8ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:59.718002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-301cd0f0-47f8-4f26-ada5-ca941dfc8ffb None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:36:59.719338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-301cd0f0-47f8-4f26-ada5-ca941dfc8ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:36:59.719828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e8a16-5255-4675-845d-9d80592f1c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:59.720472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e8a16-5255-4675-845d-9d80592f1c44 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:59.720748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e8a16-5255-4675-845d-9d80592f1c44 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:59.721019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e8a16-5255-4675-845d-9d80592f1c44 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:59.731459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e8a16-5255-4675-845d-9d80592f1c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-417e8a16-5255-4675-845d-9d80592f1c44 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:36:59.736593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:59.737704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:59.738780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:59.738780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:59.738780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:59.738780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:59.738780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:36:59.738780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:36:59.738780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:36:59.738780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:36:59.738780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:36:59.738780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:36:59.738780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 10:36:59.738780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:59.742688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 466/935] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Jul 27 10:36:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:59.743424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e8a16-5255-4675-845d-9d80592f1c44 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:59.806099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 470/936] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:36:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:36:59.810574 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cd0f0-47f8-4f26-ada5-ca941dfc8ffb None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:59.855382 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:59.877839 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e8a16-5255-4675-845d-9d80592f1c44 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:59.922201 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff204f70-6dce-4f50-a2e0-2607efd4457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:59.922884 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff204f70-6dce-4f50-a2e0-2607efd4457a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:59.923425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff204f70-6dce-4f50-a2e0-2607efd4457a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:59.923540 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff204f70-6dce-4f50-a2e0-2607efd4457a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:59.924219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff204f70-6dce-4f50-a2e0-2607efd4457a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:59.925671 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff204f70-6dce-4f50-a2e0-2607efd4457a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:59.932960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-ff204f70-6dce-4f50-a2e0-2607efd4457a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:36:59.936379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:36:59.937405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:36:59.938978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 467/937] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jul 27 10:36:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:36:59.939818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff204f70-6dce-4f50-a2e0-2607efd4457a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:36:59.946232 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cd0f0-47f8-4f26-ada5-ca941dfc8ffb None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:36:59.983851 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d76ecc-f010-4799-a25a-d526ac37aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:36:59.984479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d76ecc-f010-4799-a25a-d526ac37aa94 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:36:59.984758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d76ecc-f010-4799-a25a-d526ac37aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:36:59.985041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d76ecc-f010-4799-a25a-d526ac37aa94 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:36:59.985766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d76ecc-f010-4799-a25a-d526ac37aa94 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:36:59.986074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d76ecc-f010-4799-a25a-d526ac37aa94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:36:59.987470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d76ecc-f010-4799-a25a-d526ac37aa94 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:36:59.995774 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 471/938] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Jul 27 10:36:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:36:59.996587 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d76ecc-f010-4799-a25a-d526ac37aa94 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:00.055121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff204f70-6dce-4f50-a2e0-2607efd4457a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:00.097357 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e40baf-4fd3-4ce6-85cc-fa710f52f764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:00.098042 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e40baf-4fd3-4ce6-85cc-fa710f52f764 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:00.098364 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e40baf-4fd3-4ce6-85cc-fa710f52f764 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:00.098645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e40baf-4fd3-4ce6-85cc-fa710f52f764 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:00.099347 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e40baf-4fd3-4ce6-85cc-fa710f52f764 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:00.100804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e40baf-4fd3-4ce6-85cc-fa710f52f764 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:00.103579 dv-cinder-850840-3-smb devstack@keystone.service[86616]: WARNING keystone.server.flask.common [None req-44e40baf-4fd3-4ce6-85cc-fa710f52f764 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 10:37:00.113512 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d76ecc-f010-4799-a25a-d526ac37aa94 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:00.122853 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.sql.core [None req-44e40baf-4fd3-4ce6-85cc-fa710f52f764 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 10:37:00.122853 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 10:37:00.122853 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [parameters: {'id': 'a70c96414f45494898eeac67639925af', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 10:37:00.122853 dv-cinder-850840-3-smb devstack@keystone.service[86616]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86616) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 10:37:00.131122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-44e40baf-4fd3-4ce6-85cc-fa710f52f764 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a70c96414f45494898eeac67639925af.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a70c96414f45494898eeac67639925af. Jul 27 10:37:00.131122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:00.131122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 10:37:00.131122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 10:37:00.131122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 10:37:00.131122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 10:37:00.131122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 10:37:00.131122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 10:37:00.131122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 10:37:00.131122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application conn.query(q) Jul 27 10:37:00.131122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 10:37:00.131122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 10:37:00.131122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application result.read() Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 10:37:00.132013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application next(self.gen) Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application yield resource Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application next(self.gen) Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise self.value Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application session.commit() Jul 27 10:37:00.133178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.session.flush() Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application compat.raise_( Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 10:37:00.134142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 10:37:00.135130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application conn.query(q) Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application result.read() Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 10:37:00.135947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [parameters: {'id': 'a70c96414f45494898eeac67639925af', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:00.136831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:00.137617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:00.140269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:00.140269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 10:37:00.140269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 10:37:00.140269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:00.140269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:00.140269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 10:37:00.140269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 10:37:00.140269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a70c96414f45494898eeac67639925af. Jul 27 10:37:00.140269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:00.140269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 468/939] 10.222.0.43 () {60 vars in 1140 bytes} [Wed Jul 27 10:36:59 2022] POST /identity/v3/projects => generated 262 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:00.140269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e40baf-4fd3-4ce6-85cc-fa710f52f764 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:00.149730 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:00.161590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb5fb5-21a2-42a1-8ddf-c2d89baf58b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:00.162301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb5fb5-21a2-42a1-8ddf-c2d89baf58b9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:00.162575 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb5fb5-21a2-42a1-8ddf-c2d89baf58b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:00.162853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb5fb5-21a2-42a1-8ddf-c2d89baf58b9 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:00.163534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb5fb5-21a2-42a1-8ddf-c2d89baf58b9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:00.163836 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb5fb5-21a2-42a1-8ddf-c2d89baf58b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:00.165184 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb5fb5-21a2-42a1-8ddf-c2d89baf58b9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:00.171739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 472/940] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jul 27 10:36:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:00.172478 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb5fb5-21a2-42a1-8ddf-c2d89baf58b9 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:00.196869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:00.266711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e40baf-4fd3-4ce6-85cc-fa710f52f764 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:00.286659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb5fb5-21a2-42a1-8ddf-c2d89baf58b9 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:00.316529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08a155-5cd5-4a0a-bd4d-5d3e0ce9dc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:00.317185 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08a155-5cd5-4a0a-bd4d-5d3e0ce9dc43 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:00.317472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08a155-5cd5-4a0a-bd4d-5d3e0ce9dc43 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:00.317744 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08a155-5cd5-4a0a-bd4d-5d3e0ce9dc43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:00.326610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45592d70-c4fd-414b-8787-d7ddb99de3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:00.327255 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592d70-c4fd-414b-8787-d7ddb99de3c5 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:00.327535 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592d70-c4fd-414b-8787-d7ddb99de3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:00.327806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592d70-c4fd-414b-8787-d7ddb99de3c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:00.330584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08a155-5cd5-4a0a-bd4d-5d3e0ce9dc43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:00.332264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08a155-5cd5-4a0a-bd4d-5d3e0ce9dc43 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:00.335259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45592d70-c4fd-414b-8787-d7ddb99de3c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:00.336675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45592d70-c4fd-414b-8787-d7ddb99de3c5 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-2f08a155-5cd5-4a0a-bd4d-5d3e0ce9dc43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:37:00.347938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:00.348843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:00.349904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:37:00.349904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:37:00.349904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:00.349904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-45592d70-c4fd-414b-8787-d7ddb99de3c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:37:00.350129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:00.351440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:00.352324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:37:00.352324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:37:00.352324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:37:00.352324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:37:00.352324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:37:00.352324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:37:00.352324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:37:00.352324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:00.353949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 469/941] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:00.354471 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 473/942] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:00.354638 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08a155-5cd5-4a0a-bd4d-5d3e0ce9dc43 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:00.355795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45592d70-c4fd-414b-8787-d7ddb99de3c5 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:00.421211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:00.451913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:00.469270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08a155-5cd5-4a0a-bd4d-5d3e0ce9dc43 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:00.473077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45592d70-c4fd-414b-8787-d7ddb99de3c5 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:00.506920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43067081-a84b-4a36-8822-5f79f650e931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:00.507549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43067081-a84b-4a36-8822-5f79f650e931 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:00.507840 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43067081-a84b-4a36-8822-5f79f650e931 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:00.508114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43067081-a84b-4a36-8822-5f79f650e931 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:00.508632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4770ea-b176-48cf-81a9-04016eff01a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:00.508855 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43067081-a84b-4a36-8822-5f79f650e931 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:00.509105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43067081-a84b-4a36-8822-5f79f650e931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:00.509261 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4770ea-b176-48cf-81a9-04016eff01a8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:00.509537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4770ea-b176-48cf-81a9-04016eff01a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:00.509816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4770ea-b176-48cf-81a9-04016eff01a8 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:00.510538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4770ea-b176-48cf-81a9-04016eff01a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:00.510637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43067081-a84b-4a36-8822-5f79f650e931 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:00.510847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4770ea-b176-48cf-81a9-04016eff01a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:00.512197 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4770ea-b176-48cf-81a9-04016eff01a8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:00.519904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 470/943] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jul 27 10:37:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:00.520779 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43067081-a84b-4a36-8822-5f79f650e931 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:00.528923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 474/944] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:00.530424 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4770ea-b176-48cf-81a9-04016eff01a8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:00.633693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43067081-a84b-4a36-8822-5f79f650e931 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:00.641397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4770ea-b176-48cf-81a9-04016eff01a8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:00.666478 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:00.679819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f3816-e0dd-4a9b-b943-9ed8d5f17ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:00.680019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb83605-5948-428d-9ac5-acc72fc81610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:00.680445 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb83605-5948-428d-9ac5-acc72fc81610 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:00.680569 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f3816-e0dd-4a9b-b943-9ed8d5f17ad5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:00.680733 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f3816-e0dd-4a9b-b943-9ed8d5f17ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:00.680828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb83605-5948-428d-9ac5-acc72fc81610 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:00.680993 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb83605-5948-428d-9ac5-acc72fc81610 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:00.681088 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f3816-e0dd-4a9b-b943-9ed8d5f17ad5 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:00.681727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f3816-e0dd-4a9b-b943-9ed8d5f17ad5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:00.681822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb83605-5948-428d-9ac5-acc72fc81610 None admin] RBAC: Adding query filter params (interface=public, service_id=3ac42d0ed4834692ab092d60298b0d2c, region_id=RegionOne) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:00.682037 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f3816-e0dd-4a9b-b943-9ed8d5f17ad5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:00.682134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb83605-5948-428d-9ac5-acc72fc81610 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:00.683733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb83605-5948-428d-9ac5-acc72fc81610 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:00.683843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f3816-e0dd-4a9b-b943-9ed8d5f17ad5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:00.690196 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 475/945] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jul 27 10:37:00 2022] GET /identity/v3/endpoints?service_id=3ac42d0ed4834692ab092d60298b0d2c&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:00.690935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb83605-5948-428d-9ac5-acc72fc81610 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:00.695143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:00.718302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 471/946] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jul 27 10:37:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:00.718302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f3816-e0dd-4a9b-b943-9ed8d5f17ad5 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:00.820929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb83605-5948-428d-9ac5-acc72fc81610 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:00.860018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30018394-270e-4124-87a7-693dd94ea055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:00.860811 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30018394-270e-4124-87a7-693dd94ea055 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:00.861170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30018394-270e-4124-87a7-693dd94ea055 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:00.861528 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30018394-270e-4124-87a7-693dd94ea055 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:00.862076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f3816-e0dd-4a9b-b943-9ed8d5f17ad5 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:00.873728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30018394-270e-4124-87a7-693dd94ea055 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:00.875377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30018394-270e-4124-87a7-693dd94ea055 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-30018394-270e-4124-87a7-693dd94ea055 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:37:00.893280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:00.894550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:00.895729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:00.895729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:00.895729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:37:00.895729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:37:00.895729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:37:00.895729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:37:00.895729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:37:00.895729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:37:00.895729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 10:37:00.895729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:00.897709 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 476/947] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jul 27 10:37:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:00.904953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30018394-270e-4124-87a7-693dd94ea055 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:00.921739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d8c23-2aef-47aa-a692-035dc463f2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:00.922623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8c23-2aef-47aa-a692-035dc463f2ed None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:00.922761 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8c23-2aef-47aa-a692-035dc463f2ed None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:00.923051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8c23-2aef-47aa-a692-035dc463f2ed None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:00.923724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d8c23-2aef-47aa-a692-035dc463f2ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:00.925107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d8c23-2aef-47aa-a692-035dc463f2ed None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:00.931529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 472/948] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jul 27 10:37:00 2022] GET /identity/v3/services => generated 1497 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:37:00.994209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:01.000465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77203136-f28d-4070-919f-fffdfa8d029e None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:01.000802 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77203136-f28d-4070-919f-fffdfa8d029e None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:01.001023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77203136-f28d-4070-919f-fffdfa8d029e None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:01.002475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 473/949] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:37:01.009706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554c5cc-4a0b-443f-9064-83a4c0bceafa None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:01.009706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554c5cc-4a0b-443f-9064-83a4c0bceafa None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:01.010019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554c5cc-4a0b-443f-9064-83a4c0bceafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:01.032594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-3554c5cc-4a0b-443f-9064-83a4c0bceafa None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:01.034246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3554c5cc-4a0b-443f-9064-83a4c0bceafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:01.048240 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30018394-270e-4124-87a7-693dd94ea055 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:01.088318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd09075-6c22-44b7-99cd-e5dbabe73460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:01.089075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09075-6c22-44b7-99cd-e5dbabe73460 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:01.089425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09075-6c22-44b7-99cd-e5dbabe73460 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:01.089774 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd09075-6c22-44b7-99cd-e5dbabe73460 None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:01.090621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd09075-6c22-44b7-99cd-e5dbabe73460 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:01.090970 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd09075-6c22-44b7-99cd-e5dbabe73460 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:01.092427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd09075-6c22-44b7-99cd-e5dbabe73460 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:01.093323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:01.115657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 477/950] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Jul 27 10:37:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:01.123017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd09075-6c22-44b7-99cd-e5dbabe73460 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:01.129987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 474/951] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:37:01.152741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554c5cc-4a0b-443f-9064-83a4c0bceafa None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:01.236383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd09075-6c22-44b7-99cd-e5dbabe73460 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:01.262789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:01.276393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f004e0-97e9-4f5d-99a3-beebed444c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:01.277047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f004e0-97e9-4f5d-99a3-beebed444c05 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:01.277326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f004e0-97e9-4f5d-99a3-beebed444c05 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:01.277602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f004e0-97e9-4f5d-99a3-beebed444c05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:01.285501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554c5cc-4a0b-443f-9064-83a4c0bceafa None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:01.291496 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f004e0-97e9-4f5d-99a3-beebed444c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:01.292967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f004e0-97e9-4f5d-99a3-beebed444c05 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-67f004e0-97e9-4f5d-99a3-beebed444c05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:37:01.312835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:01.313791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:01.314749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:37:01.314749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:37:01.314749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:01.314749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:01.314749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 478/952] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:37:01.326210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f004e0-97e9-4f5d-99a3-beebed444c05 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:01.331604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f508c8-c8d1-4d82-a8a2-70d1793d8752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:01.332230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f508c8-c8d1-4d82-a8a2-70d1793d8752 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:01.332514 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f508c8-c8d1-4d82-a8a2-70d1793d8752 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:01.332791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f508c8-c8d1-4d82-a8a2-70d1793d8752 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:01.333485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f508c8-c8d1-4d82-a8a2-70d1793d8752 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:01.335045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f508c8-c8d1-4d82-a8a2-70d1793d8752 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:01.353236 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 475/953] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jul 27 10:37:01 2022] POST /identity/v3/services => generated 242 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:37:01.456558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f004e0-97e9-4f5d-99a3-beebed444c05 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:01.503578 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df32870-db0a-49bd-8f25-6a7403f7e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:01.504212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df32870-db0a-49bd-8f25-6a7403f7e789 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:01.504490 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df32870-db0a-49bd-8f25-6a7403f7e789 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:01.504761 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df32870-db0a-49bd-8f25-6a7403f7e789 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:01.505462 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df32870-db0a-49bd-8f25-6a7403f7e789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:01.505765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df32870-db0a-49bd-8f25-6a7403f7e789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:01.507166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df32870-db0a-49bd-8f25-6a7403f7e789 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:01.521666 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 479/954] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:01.527314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f508c8-c8d1-4d82-a8a2-70d1793d8752 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:01.568577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:01.643739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f508c8-c8d1-4d82-a8a2-70d1793d8752 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:01.679549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15537d4-bb43-4ae2-a212-136d397cd2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:01.680206 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15537d4-bb43-4ae2-a212-136d397cd2e2 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:01.680486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15537d4-bb43-4ae2-a212-136d397cd2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:01.680762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15537d4-bb43-4ae2-a212-136d397cd2e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:01.689080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15537d4-bb43-4ae2-a212-136d397cd2e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:01.690685 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15537d4-bb43-4ae2-a212-136d397cd2e2 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-d15537d4-bb43-4ae2-a212-136d397cd2e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:37:01.704125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:01.705190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:01.706174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:37:01.706174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:37:01.706174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:37:01.706174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:37:01.706174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:37:01.706174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:37:01.706174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:37:01.706174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:01.706174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 476/955] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:37:01.711385 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df32870-db0a-49bd-8f25-6a7403f7e789 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:01.744527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:01.816107 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df32870-db0a-49bd-8f25-6a7403f7e789 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:01.851009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193efea-c57e-400c-9b0a-5169df25bf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:01.851630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193efea-c57e-400c-9b0a-5169df25bf10 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:01.851908 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193efea-c57e-400c-9b0a-5169df25bf10 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:01.852181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193efea-c57e-400c-9b0a-5169df25bf10 None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:01.852924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193efea-c57e-400c-9b0a-5169df25bf10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:01.853230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193efea-c57e-400c-9b0a-5169df25bf10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:01.854686 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193efea-c57e-400c-9b0a-5169df25bf10 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:01.867344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 480/956] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:37:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:01.873391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15537d4-bb43-4ae2-a212-136d397cd2e2 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:01.986150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:01.992214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15537d4-bb43-4ae2-a212-136d397cd2e2 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:02.027032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d990eb-045f-4145-8154-bd2ae059dc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:02.027706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d990eb-045f-4145-8154-bd2ae059dc32 None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:02.027992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d990eb-045f-4145-8154-bd2ae059dc32 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:02.028804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d990eb-045f-4145-8154-bd2ae059dc32 None admin] PATH_INFO: `/v3/projects/52e68e1a140146e28b504864955367c1/users/8cfba665ebb9497bad355c0c24f2ccfc/roles/569a224091254f49a695cfe9bad598c8` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:02.031097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d990eb-045f-4145-8154-bd2ae059dc32 None admin] RBAC: Authorizing `identity:create_grant(project_id=52e68e1a140146e28b504864955367c1, user_id=8cfba665ebb9497bad355c0c24f2ccfc, role_id=569a224091254f49a695cfe9bad598c8)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:02.032587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d990eb-045f-4145-8154-bd2ae059dc32 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:02.051058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 477/957] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:37:01 2022] PUT /identity/v3/projects/52e68e1a140146e28b504864955367c1/users/8cfba665ebb9497bad355c0c24f2ccfc/roles/569a224091254f49a695cfe9bad598c8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:37:03.033155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6ac36-12a8-44a9-ae77-979906e115a9 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:03.033677 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6ac36-12a8-44a9-ae77-979906e115a9 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:03.033787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6ac36-12a8-44a9-ae77-979906e115a9 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:03.035372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 481/958] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:03.036856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787dff7-f623-46c3-877f-1e1aac95740d None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:03.037240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787dff7-f623-46c3-877f-1e1aac95740d None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:03.037427 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787dff7-f623-46c3-877f-1e1aac95740d None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:03.039047 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 478/959] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:03.044319 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c5e01-1bfd-46be-a8f8-3d8a821e8890 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:03.044664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cbf14-1553-49f7-92e7-90ed26400f49 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:03.045140 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cbf14-1553-49f7-92e7-90ed26400f49 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:03.045375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c5e01-1bfd-46be-a8f8-3d8a821e8890 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:03.045607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cbf14-1553-49f7-92e7-90ed26400f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:03.046068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c5e01-1bfd-46be-a8f8-3d8a821e8890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:03.067515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-b77c5e01-1bfd-46be-a8f8-3d8a821e8890 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:03.069040 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b77c5e01-1bfd-46be-a8f8-3d8a821e8890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:03.069285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-3b7cbf14-1553-49f7-92e7-90ed26400f49 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:03.070489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3b7cbf14-1553-49f7-92e7-90ed26400f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:03.146697 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 482/960] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:03.156246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 479/961] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:37:03.169806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c5e01-1bfd-46be-a8f8-3d8a821e8890 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:03.185285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cbf14-1553-49f7-92e7-90ed26400f49 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:03.194355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:03.295897 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c5e01-1bfd-46be-a8f8-3d8a821e8890 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:03.302410 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:03.322266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cbf14-1553-49f7-92e7-90ed26400f49 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:03.336568 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87711487-7b52-4fb4-8abc-fb1e29b6bf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:03.337345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87711487-7b52-4fb4-8abc-fb1e29b6bf6b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:03.337712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87711487-7b52-4fb4-8abc-fb1e29b6bf6b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:03.337992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87711487-7b52-4fb4-8abc-fb1e29b6bf6b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:03.338651 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87711487-7b52-4fb4-8abc-fb1e29b6bf6b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:03.340025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87711487-7b52-4fb4-8abc-fb1e29b6bf6b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-87711487-7b52-4fb4-8abc-fb1e29b6bf6b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:03.350678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:03.351912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:03.352794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 483/962] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jul 27 10:37:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:03.361038 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87711487-7b52-4fb4-8abc-fb1e29b6bf6b None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:03.364780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6233c2-736d-41ea-9d3d-aa4fa2a90872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:03.365420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6233c2-736d-41ea-9d3d-aa4fa2a90872 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:03.365716 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6233c2-736d-41ea-9d3d-aa4fa2a90872 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:03.365989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6233c2-736d-41ea-9d3d-aa4fa2a90872 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:03.366727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6233c2-736d-41ea-9d3d-aa4fa2a90872 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:03.368177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6233c2-736d-41ea-9d3d-aa4fa2a90872 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:03.383543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.sql.core [None req-dd6233c2-736d-41ea-9d3d-aa4fa2a90872 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 10:37:03.383543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 10:37:03.383543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [parameters: {'user_id': '2d7a62a4fb58459ca70e5b31c4aef3bd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 10:37:03.383543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86616) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-dd6233c2-736d-41ea-9d3d-aa4fa2a90872 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application conn.query(q) Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application result.read() Jul 27 10:37:03.392608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 10:37:03.393532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application next(self.gen) Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application yield resource Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application next(self.gen) Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise self.value Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application session.commit() Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 10:37:03.394522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.session.flush() Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application compat.raise_( Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 10:37:03.395437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 10:37:03.397130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application conn.query(q) Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application result.read() Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 10:37:03.399183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [parameters: {'user_id': '2d7a62a4fb58459ca70e5b31c4aef3bd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:03.401332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 10:37:03.404462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 10:37:03.407222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 10:37:03.407222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 10:37:03.407222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 10:37:03.407222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 10:37:03.407222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 10:37:03.407222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:03.413254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 480/963] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Jul 27 10:37:03 2022] POST /identity/v3/users => generated 160 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:37:03.417122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6233c2-736d-41ea-9d3d-aa4fa2a90872 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:03.480644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:03.501791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87711487-7b52-4fb4-8abc-fb1e29b6bf6b None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:03.532664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6233c2-736d-41ea-9d3d-aa4fa2a90872 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:03.538073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f203d-3d0f-44e1-bcc3-d62217207a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:03.538734 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f203d-3d0f-44e1-bcc3-d62217207a0b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:03.539018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f203d-3d0f-44e1-bcc3-d62217207a0b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:03.539297 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f203d-3d0f-44e1-bcc3-d62217207a0b None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:03.539991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f203d-3d0f-44e1-bcc3-d62217207a0b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:03.540665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f203d-3d0f-44e1-bcc3-d62217207a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:03.541673 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f203d-3d0f-44e1-bcc3-d62217207a0b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:03.551330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 484/964] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jul 27 10:37:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:03.551330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655d220-6ded-4797-8839-0cc921574f42 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:03.551330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655d220-6ded-4797-8839-0cc921574f42 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:03.551330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655d220-6ded-4797-8839-0cc921574f42 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:03.551330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 485/965] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:03.552900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655d220-6ded-4797-8839-0cc921574f42 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:03.578557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbde6ce-b929-41c0-a5b4-14ccc5ad7533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:03.579147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbde6ce-b929-41c0-a5b4-14ccc5ad7533 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:03.579431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbde6ce-b929-41c0-a5b4-14ccc5ad7533 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:03.579721 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbde6ce-b929-41c0-a5b4-14ccc5ad7533 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:03.587809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbde6ce-b929-41c0-a5b4-14ccc5ad7533 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:03.589450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbde6ce-b929-41c0-a5b4-14ccc5ad7533 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-4fbde6ce-b929-41c0-a5b4-14ccc5ad7533 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:37:03.602940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:03.603920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:03.604878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:03.604878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:03.604878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:37:03.604878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:37:03.604878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:37:03.604878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:37:03.604878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:37:03.604878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:37:03.604878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 10:37:03.604878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:03.604878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 481/966] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:37:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:03.605488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc39800-be7b-4e7e-b961-d109dfdc4a65 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:03.606053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc39800-be7b-4e7e-b961-d109dfdc4a65 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:03.606053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc39800-be7b-4e7e-b961-d109dfdc4a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:03.625366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-0cc39800-be7b-4e7e-b961-d109dfdc4a65 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:03.626966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0cc39800-be7b-4e7e-b961-d109dfdc4a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:03.629467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:03.672919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655d220-6ded-4797-8839-0cc921574f42 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:03.708286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 482/967] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:03.709205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc39800-be7b-4e7e-b961-d109dfdc4a65 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:03.720245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c64c3a-b731-47f5-93c6-733ef8be7bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:03.721177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c64c3a-b731-47f5-93c6-733ef8be7bbb None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:03.721769 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c64c3a-b731-47f5-93c6-733ef8be7bbb None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:03.722156 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c64c3a-b731-47f5-93c6-733ef8be7bbb None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:03.723063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c64c3a-b731-47f5-93c6-733ef8be7bbb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:03.723470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c64c3a-b731-47f5-93c6-733ef8be7bbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:03.725022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c64c3a-b731-47f5-93c6-733ef8be7bbb None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:03.732094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 486/968] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jul 27 10:37:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:03.736906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c64c3a-b731-47f5-93c6-733ef8be7bbb None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:03.754736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:03.830416 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc39800-be7b-4e7e-b961-d109dfdc4a65 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:03.850775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c64c3a-b731-47f5-93c6-733ef8be7bbb None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:03.875474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f6fde-7657-44cc-8e9e-4efc89560795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:03.876105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6fde-7657-44cc-8e9e-4efc89560795 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:03.876386 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6fde-7657-44cc-8e9e-4efc89560795 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:03.876660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f6fde-7657-44cc-8e9e-4efc89560795 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:03.877445 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f6fde-7657-44cc-8e9e-4efc89560795 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:03.877760 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f6fde-7657-44cc-8e9e-4efc89560795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:03.879234 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f6fde-7657-44cc-8e9e-4efc89560795 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:03.896322 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafab2a-9e95-467b-b65d-7b850617b73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:03.897023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafab2a-9e95-467b-b65d-7b850617b73c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:03.897310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafab2a-9e95-467b-b65d-7b850617b73c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:03.897588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafab2a-9e95-467b-b65d-7b850617b73c None admin] PATH_INFO: `/v3/services/compute` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:03.898251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafab2a-9e95-467b-b65d-7b850617b73c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:03.899633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafab2a-9e95-467b-b65d-7b850617b73c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:03.900556 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-3cafab2a-9e95-467b-b65d-7b850617b73c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:03.909583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:03.910741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:03.911754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:03.911754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:03.911754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:03.911754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:03.911754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:03.911754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:03.911754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:03.911754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:03.911754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:03.911754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:03.911754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:37:03.911754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:03.911754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 10:37:03.911754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:03.915901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 487/969] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:37:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:03.916819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafab2a-9e95-467b-b65d-7b850617b73c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:03.928257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 483/970] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jul 27 10:37:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:03.934254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f6fde-7657-44cc-8e9e-4efc89560795 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:04.022173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:04.039359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafab2a-9e95-467b-b65d-7b850617b73c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:04.050558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f6fde-7657-44cc-8e9e-4efc89560795 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:04.093542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677b73d-7db7-4df6-b6f0-d88f4e2d5762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:04.094069 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677b73d-7db7-4df6-b6f0-d88f4e2d5762 None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:04.094390 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677b73d-7db7-4df6-b6f0-d88f4e2d5762 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:04.094793 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677b73d-7db7-4df6-b6f0-d88f4e2d5762 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:04.097444 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677b73d-7db7-4df6-b6f0-d88f4e2d5762 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:04.097444 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677b73d-7db7-4df6-b6f0-d88f4e2d5762 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:04.099155 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00f330-81d1-4358-8427-db6175360b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:04.099619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00f330-81d1-4358-8427-db6175360b3e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:04.099903 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00f330-81d1-4358-8427-db6175360b3e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:04.100179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00f330-81d1-4358-8427-db6175360b3e None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:04.100873 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00f330-81d1-4358-8427-db6175360b3e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:04.101180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00f330-81d1-4358-8427-db6175360b3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:04.103028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00f330-81d1-4358-8427-db6175360b3e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:04.112310 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 484/971] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jul 27 10:37:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:04.118990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00f330-81d1-4358-8427-db6175360b3e None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:04.127218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 488/972] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:37:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:37:04.158856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697829a6-ed65-4b7a-ac9b-d699cd725638 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:04.159145 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697829a6-ed65-4b7a-ac9b-d699cd725638 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:04.159432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697829a6-ed65-4b7a-ac9b-d699cd725638 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:04.163486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 489/973] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:04.167206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18e9ab-b204-4951-bcfe-ffe1ad5a0454 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:04.167756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18e9ab-b204-4951-bcfe-ffe1ad5a0454 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:04.167756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18e9ab-b204-4951-bcfe-ffe1ad5a0454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:04.190588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-9a18e9ab-b204-4951-bcfe-ffe1ad5a0454 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:04.191907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9a18e9ab-b204-4951-bcfe-ffe1ad5a0454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:04.195122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:04.264662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00f330-81d1-4358-8427-db6175360b3e None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:04.291196 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 490/974] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:04.311402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953380fb-838a-463c-b899-20d898f847aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:04.311848 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953380fb-838a-463c-b899-20d898f847aa None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:04.312144 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953380fb-838a-463c-b899-20d898f847aa None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:04.312418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953380fb-838a-463c-b899-20d898f847aa None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:04.313112 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953380fb-838a-463c-b899-20d898f847aa None admin] RBAC: Adding query filter params (type=compute) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:04.313693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953380fb-838a-463c-b899-20d898f847aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:04.314708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18e9ab-b204-4951-bcfe-ffe1ad5a0454 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:04.314824 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953380fb-838a-463c-b899-20d898f847aa None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:04.325987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 485/975] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jul 27 10:37:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:04.332820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953380fb-838a-463c-b899-20d898f847aa None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:04.382740 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:04.430377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18e9ab-b204-4951-bcfe-ffe1ad5a0454 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:04.447680 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953380fb-838a-463c-b899-20d898f847aa None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:04.468086 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a92365-844e-4ad0-9e33-11f260a7b97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:04.468739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a92365-844e-4ad0-9e33-11f260a7b97a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:04.469019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a92365-844e-4ad0-9e33-11f260a7b97a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:04.469294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a92365-844e-4ad0-9e33-11f260a7b97a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:04.476942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:04.480289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a92365-844e-4ad0-9e33-11f260a7b97a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-d7a92365-844e-4ad0-9e33-11f260a7b97a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:37:04.486353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:04.487486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:04.488538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:04.488538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:04.488538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:04.488538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:04.488538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:37:04.488538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:37:04.488538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:37:04.488538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:37:04.488538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:37:04.488538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:37:04.488538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 10:37:04.488538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:04.494039 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 491/976] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Jul 27 10:37:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:37:04.494167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13e5dd-ada3-49aa-81ec-0ac6b2752a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:04.494167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13e5dd-ada3-49aa-81ec-0ac6b2752a8a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:04.494167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13e5dd-ada3-49aa-81ec-0ac6b2752a8a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:04.494167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13e5dd-ada3-49aa-81ec-0ac6b2752a8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:04.494552 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13e5dd-ada3-49aa-81ec-0ac6b2752a8a None admin] RBAC: Adding query filter params (interface=public, service_id=28b09dd4045a42cfaaf3a2c122cd2d3e, region_id=RegionOne) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:04.494804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13e5dd-ada3-49aa-81ec-0ac6b2752a8a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:04.495092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a92365-844e-4ad0-9e33-11f260a7b97a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:04.496408 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13e5dd-ada3-49aa-81ec-0ac6b2752a8a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:04.507141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 486/977] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jul 27 10:37:04 2022] GET /identity/v3/endpoints?service_id=28b09dd4045a42cfaaf3a2c122cd2d3e&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:04.508077 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13e5dd-ada3-49aa-81ec-0ac6b2752a8a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:04.600332 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a92365-844e-4ad0-9e33-11f260a7b97a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:04.620889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:04.622887 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13e5dd-ada3-49aa-81ec-0ac6b2752a8a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:04.642230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da350dc0-d5aa-414a-8781-82ebca637678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:04.642997 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da350dc0-d5aa-414a-8781-82ebca637678 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:04.643308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da350dc0-d5aa-414a-8781-82ebca637678 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:04.643658 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da350dc0-d5aa-414a-8781-82ebca637678 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:04.644460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da350dc0-d5aa-414a-8781-82ebca637678 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:04.644844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da350dc0-d5aa-414a-8781-82ebca637678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:04.646465 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da350dc0-d5aa-414a-8781-82ebca637678 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:04.659616 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 492/978] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Jul 27 10:37:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:04.660900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da350dc0-d5aa-414a-8781-82ebca637678 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:04.670816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591fa17-998d-4727-af95-7937ae6cb9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:04.671526 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591fa17-998d-4727-af95-7937ae6cb9ae None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:04.671921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591fa17-998d-4727-af95-7937ae6cb9ae None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:04.672258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591fa17-998d-4727-af95-7937ae6cb9ae None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:04.673042 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591fa17-998d-4727-af95-7937ae6cb9ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:04.674555 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591fa17-998d-4727-af95-7937ae6cb9ae None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:04.681558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 487/979] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jul 27 10:37:04 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:37:04.783491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da350dc0-d5aa-414a-8781-82ebca637678 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:04.822059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ffbdf-04e4-420a-bd62-f41086f8053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:04.822861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ffbdf-04e4-420a-bd62-f41086f8053c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:04.823221 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ffbdf-04e4-420a-bd62-f41086f8053c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:04.823561 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ffbdf-04e4-420a-bd62-f41086f8053c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:04.836463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ffbdf-04e4-420a-bd62-f41086f8053c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:04.838001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ffbdf-04e4-420a-bd62-f41086f8053c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-6f2ffbdf-04e4-420a-bd62-f41086f8053c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:37:04.854176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:04.855254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:04.856264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:37:04.856264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:37:04.856264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:04.856264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:04.856264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 493/980] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:37:04.862418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591fa17-998d-4727-af95-7937ae6cb9ae None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:04.928294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:04.978524 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591fa17-998d-4727-af95-7937ae6cb9ae None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:05.013963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6466f-1bb4-4064-a5e5-862dc5bade46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:05.014705 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6466f-1bb4-4064-a5e5-862dc5bade46 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:05.015060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6466f-1bb4-4064-a5e5-862dc5bade46 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:05.015407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6466f-1bb4-4064-a5e5-862dc5bade46 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:05.016238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6466f-1bb4-4064-a5e5-862dc5bade46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:05.016619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6466f-1bb4-4064-a5e5-862dc5bade46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:05.018080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6466f-1bb4-4064-a5e5-862dc5bade46 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:05.034688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 488/981] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:05.036064 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ffbdf-04e4-420a-bd62-f41086f8053c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:05.070062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:05.144552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ffbdf-04e4-420a-bd62-f41086f8053c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:05.181891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c211c6-c37f-4ef1-8951-64f1e9e57166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:05.182991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c211c6-c37f-4ef1-8951-64f1e9e57166 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:05.183373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c211c6-c37f-4ef1-8951-64f1e9e57166 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:05.183748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c211c6-c37f-4ef1-8951-64f1e9e57166 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:05.193422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c211c6-c37f-4ef1-8951-64f1e9e57166 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:05.195025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c211c6-c37f-4ef1-8951-64f1e9e57166 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-98c211c6-c37f-4ef1-8951-64f1e9e57166 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:37:05.207530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:05.208868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:05.210061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:05.210061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:05.210061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:37:05.210061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:37:05.210061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:37:05.210061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:37:05.210061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:37:05.210061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:37:05.210061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 10:37:05.210061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:05.211692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 494/982] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jul 27 10:37:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:37:05.217561 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6466f-1bb4-4064-a5e5-862dc5bade46 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:05.328696 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6466f-1bb4-4064-a5e5-862dc5bade46 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:05.342930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:05.366547 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88841a9a-4354-4778-9f6b-6c1cc0049ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:05.367176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88841a9a-4354-4778-9f6b-6c1cc0049ac0 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:05.367462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88841a9a-4354-4778-9f6b-6c1cc0049ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:05.367742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88841a9a-4354-4778-9f6b-6c1cc0049ac0 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:05.368560 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88841a9a-4354-4778-9f6b-6c1cc0049ac0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:05.368869 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88841a9a-4354-4778-9f6b-6c1cc0049ac0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:05.370335 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88841a9a-4354-4778-9f6b-6c1cc0049ac0 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:05.393571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 489/983] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Jul 27 10:37:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:05.395198 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c211c6-c37f-4ef1-8951-64f1e9e57166 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:05.495144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:05.505956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c211c6-c37f-4ef1-8951-64f1e9e57166 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:05.540042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf030b-4f21-4c48-9171-c7d9710f80c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:05.540815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf030b-4f21-4c48-9171-c7d9710f80c5 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:05.541208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf030b-4f21-4c48-9171-c7d9710f80c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:05.541594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf030b-4f21-4c48-9171-c7d9710f80c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:05.610600 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf030b-4f21-4c48-9171-c7d9710f80c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:05.612009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf030b-4f21-4c48-9171-c7d9710f80c5 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:05.705171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:05.717758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 495/984] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:37:05 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 10:37:05.722673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88841a9a-4354-4778-9f6b-6c1cc0049ac0 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:05.830613 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88841a9a-4354-4778-9f6b-6c1cc0049ac0 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:05.871052 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d08b7-f0d3-4979-a7f3-5f97f177f750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:05.871720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d08b7-f0d3-4979-a7f3-5f97f177f750 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:05.872008 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d08b7-f0d3-4979-a7f3-5f97f177f750 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:05.872283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d08b7-f0d3-4979-a7f3-5f97f177f750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:05.883802 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d08b7-f0d3-4979-a7f3-5f97f177f750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:05.885266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d08b7-f0d3-4979-a7f3-5f97f177f750 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-804d08b7-f0d3-4979-a7f3-5f97f177f750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:37:05.901318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:05.902462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:05.908905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:37:05.908905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:37:05.908905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:05.908905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:05.908905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 490/985] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:05.910431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf030b-4f21-4c48-9171-c7d9710f80c5 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:06.015346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf030b-4f21-4c48-9171-c7d9710f80c5 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:06.049967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f03a20-75bc-4551-947a-8b43a7ede0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:06.050626 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f03a20-75bc-4551-947a-8b43a7ede0f9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:06.050911 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f03a20-75bc-4551-947a-8b43a7ede0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:06.051264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f03a20-75bc-4551-947a-8b43a7ede0f9 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:06.051883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f03a20-75bc-4551-947a-8b43a7ede0f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:06.052190 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f03a20-75bc-4551-947a-8b43a7ede0f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:06.053552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f03a20-75bc-4551-947a-8b43a7ede0f9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:06.070138 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 496/986] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:06.072203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d08b7-f0d3-4979-a7f3-5f97f177f750 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:06.100023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:06.181727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d08b7-f0d3-4979-a7f3-5f97f177f750 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:06.200996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4967f6-637c-4677-b845-501eb7a0653a None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:06.201344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4967f6-637c-4677-b845-501eb7a0653a None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:06.201615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4967f6-637c-4677-b845-501eb7a0653a None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:06.203135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 497/987] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:37:06.208175 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b0b87-33b2-4c96-bd2f-8a6b4c28f0fe None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:06.208479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b0b87-33b2-4c96-bd2f-8a6b4c28f0fe None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:06.208758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b0b87-33b2-4c96-bd2f-8a6b4c28f0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:06.218834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b6066-fb90-4cd3-ae69-b4299b7b9f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:06.219454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b6066-fb90-4cd3-ae69-b4299b7b9f02 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:06.219729 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b6066-fb90-4cd3-ae69-b4299b7b9f02 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:06.220005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b6066-fb90-4cd3-ae69-b4299b7b9f02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:06.227542 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b6066-fb90-4cd3-ae69-b4299b7b9f02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:06.228188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-ce6b0b87-33b2-4c96-bd2f-8a6b4c28f0fe None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:06.229005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b6066-fb90-4cd3-ae69-b4299b7b9f02 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:06.229423 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ce6b0b87-33b2-4c96-bd2f-8a6b4c28f0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-e16b6066-fb90-4cd3-ae69-b4299b7b9f02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:37:06.243326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:06.244302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:06.245961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:37:06.245961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:37:06.245961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:37:06.245961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:37:06.245961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:37:06.245961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:37:06.245961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:37:06.245961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:06.245961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 491/988] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:37:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:06.250215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b6066-fb90-4cd3-ae69-b4299b7b9f02 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:06.283921 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:06.310231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 498/989] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:37:06.329756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b0b87-33b2-4c96-bd2f-8a6b4c28f0fe None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:06.347659 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:06.368406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b6066-fb90-4cd3-ae69-b4299b7b9f02 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:06.408574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff83666-1bc6-4818-8279-efb78bb65cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:06.409593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff83666-1bc6-4818-8279-efb78bb65cec None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:06.410079 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff83666-1bc6-4818-8279-efb78bb65cec None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:06.410758 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff83666-1bc6-4818-8279-efb78bb65cec None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:06.411723 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff83666-1bc6-4818-8279-efb78bb65cec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:06.412251 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff83666-1bc6-4818-8279-efb78bb65cec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:06.414040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff83666-1bc6-4818-8279-efb78bb65cec None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:06.428475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 492/990] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:37:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:06.435260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff83666-1bc6-4818-8279-efb78bb65cec None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:06.442900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b0b87-33b2-4c96-bd2f-8a6b4c28f0fe None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:06.480585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d218ff-014e-4292-b96e-1e2c24c0ba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:06.481326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d218ff-014e-4292-b96e-1e2c24c0ba59 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:06.481588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d218ff-014e-4292-b96e-1e2c24c0ba59 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:06.481906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d218ff-014e-4292-b96e-1e2c24c0ba59 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:06.482608 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d218ff-014e-4292-b96e-1e2c24c0ba59 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:06.483983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d218ff-014e-4292-b96e-1e2c24c0ba59 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-02d218ff-014e-4292-b96e-1e2c24c0ba59 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:06.493074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:06.494108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:06.495002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 499/991] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jul 27 10:37:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:06.500972 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d218ff-014e-4292-b96e-1e2c24c0ba59 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:06.544077 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff83666-1bc6-4818-8279-efb78bb65cec None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:06.551229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:06.583559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6576a46-30c9-4856-99c3-8cb29f3589a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:06.584189 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6576a46-30c9-4856-99c3-8cb29f3589a7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:06.584474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6576a46-30c9-4856-99c3-8cb29f3589a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:06.584754 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6576a46-30c9-4856-99c3-8cb29f3589a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:06.585562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6576a46-30c9-4856-99c3-8cb29f3589a7 None admin] RBAC: Adding query filter params (role.id=569a224091254f49a695cfe9bad598c8, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=8cfba665ebb9497bad355c0c24f2ccfc) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:06.585879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6576a46-30c9-4856-99c3-8cb29f3589a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:06.587348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6576a46-30c9-4856-99c3-8cb29f3589a7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:06.594663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 493/992] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:37:06 2022] GET /identity/v3/role_assignments?user.id=8cfba665ebb9497bad355c0c24f2ccfc&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=569a224091254f49a695cfe9bad598c8 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:06.616688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d218ff-014e-4292-b96e-1e2c24c0ba59 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:06.660525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905685a9-7375-454c-b1d2-89231a00ed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:06.661176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905685a9-7375-454c-b1d2-89231a00ed55 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:06.661455 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905685a9-7375-454c-b1d2-89231a00ed55 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:06.661718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905685a9-7375-454c-b1d2-89231a00ed55 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:06.662463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905685a9-7375-454c-b1d2-89231a00ed55 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:06.662773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905685a9-7375-454c-b1d2-89231a00ed55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:06.664329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905685a9-7375-454c-b1d2-89231a00ed55 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:06.670044 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 500/993] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jul 27 10:37:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:06.675685 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6576a46-30c9-4856-99c3-8cb29f3589a7 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:06.686420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:06.725736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e9644-3569-42c1-babf-e1dbca5c7989 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:06.726077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e9644-3569-42c1-babf-e1dbca5c7989 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:06.726334 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e9644-3569-42c1-babf-e1dbca5c7989 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:06.727704 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 501/994] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:06.733378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16076bd2-c509-40af-a3dd-f3c68c2a5395 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:06.733663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16076bd2-c509-40af-a3dd-f3c68c2a5395 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:06.733950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16076bd2-c509-40af-a3dd-f3c68c2a5395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:06.753780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-16076bd2-c509-40af-a3dd-f3c68c2a5395 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:06.755056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-16076bd2-c509-40af-a3dd-f3c68c2a5395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:06.797587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6576a46-30c9-4856-99c3-8cb29f3589a7 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:06.833598 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 502/995] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:37:06.836409 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04642256-6458-4585-b960-e8aef930dad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:06.837038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04642256-6458-4585-b960-e8aef930dad1 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:06.837323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04642256-6458-4585-b960-e8aef930dad1 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:06.837599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04642256-6458-4585-b960-e8aef930dad1 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:06.838318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04642256-6458-4585-b960-e8aef930dad1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:06.838618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04642256-6458-4585-b960-e8aef930dad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:06.839992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04642256-6458-4585-b960-e8aef930dad1 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:06.850076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 494/996] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jul 27 10:37:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:06.851304 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16076bd2-c509-40af-a3dd-f3c68c2a5395 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:06.857015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04642256-6458-4585-b960-e8aef930dad1 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:06.905940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:06.940605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:06.974179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16076bd2-c509-40af-a3dd-f3c68c2a5395 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:06.974432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04642256-6458-4585-b960-e8aef930dad1 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:07.010366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef807919-73cb-4f5a-ab0d-65218a1b9645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:07.010949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1d371-accd-4e75-9b51-0f828fb3ec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:07.011095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef807919-73cb-4f5a-ab0d-65218a1b9645 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:07.011267 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef807919-73cb-4f5a-ab0d-65218a1b9645 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:07.011539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef807919-73cb-4f5a-ab0d-65218a1b9645 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:07.011646 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1d371-accd-4e75-9b51-0f828fb3ec2d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:07.011853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1d371-accd-4e75-9b51-0f828fb3ec2d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:07.012127 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1d371-accd-4e75-9b51-0f828fb3ec2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:07.012787 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef807919-73cb-4f5a-ab0d-65218a1b9645 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:07.013797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1d371-accd-4e75-9b51-0f828fb3ec2d None admin] RBAC: Adding query filter params (interface=admin, service_id=3ac42d0ed4834692ab092d60298b0d2c, region_id=RegionOne) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:07.014116 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1d371-accd-4e75-9b51-0f828fb3ec2d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:07.014243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef807919-73cb-4f5a-ab0d-65218a1b9645 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:07.015502 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1d371-accd-4e75-9b51-0f828fb3ec2d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:07.025611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 503/997] 10.222.0.43 () {56 vars in 1249 bytes} [Wed Jul 27 10:37:06 2022] GET /identity/v3/endpoints?service_id=3ac42d0ed4834692ab092d60298b0d2c&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-ef807919-73cb-4f5a-ab0d-65218a1b9645 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:07.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:07.026792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:07.027642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 495/998] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:37:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:07.028621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1d371-accd-4e75-9b51-0f828fb3ec2d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:07.031459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef807919-73cb-4f5a-ab0d-65218a1b9645 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:07.137972 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1d371-accd-4e75-9b51-0f828fb3ec2d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:07.142609 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:07.148279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef807919-73cb-4f5a-ab0d-65218a1b9645 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:07.186098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563da923-33e0-4282-8510-7f9fc3cc49e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:07.186765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563da923-33e0-4282-8510-7f9fc3cc49e9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:07.187051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563da923-33e0-4282-8510-7f9fc3cc49e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:07.187252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd2e10-f633-43c2-9570-77f1450c8e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:07.187372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563da923-33e0-4282-8510-7f9fc3cc49e9 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:07.187857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd2e10-f633-43c2-9570-77f1450c8e5b None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:07.188026 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563da923-33e0-4282-8510-7f9fc3cc49e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:07.188125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd2e10-f633-43c2-9570-77f1450c8e5b None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:07.188387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd2e10-f633-43c2-9570-77f1450c8e5b None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:07.189243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd2e10-f633-43c2-9570-77f1450c8e5b None admin] RBAC: Adding query filter params (name=compute) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:07.189347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563da923-33e0-4282-8510-7f9fc3cc49e9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:07.189420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd2e10-f633-43c2-9570-77f1450c8e5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:07.190847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd2e10-f633-43c2-9570-77f1450c8e5b None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:07.192337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:07.197022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 504/999] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jul 27 10:37:07 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:37:07.203670 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 496/1000] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jul 27 10:37:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:07.209829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563da923-33e0-4282-8510-7f9fc3cc49e9 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:07.325711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563da923-33e0-4282-8510-7f9fc3cc49e9 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:07.363906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07420215-bacc-4527-b278-7279cd1b556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:07.364529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07420215-bacc-4527-b278-7279cd1b556b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:07.364809 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07420215-bacc-4527-b278-7279cd1b556b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:07.365083 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07420215-bacc-4527-b278-7279cd1b556b None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:07.365785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07420215-bacc-4527-b278-7279cd1b556b None admin] RBAC: Adding query filter params (type=compute) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:07.366053 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07420215-bacc-4527-b278-7279cd1b556b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:07.367441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07420215-bacc-4527-b278-7279cd1b556b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:07.373580 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 505/1001] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jul 27 10:37:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:07.382061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd2e10-f633-43c2-9570-77f1450c8e5b None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:07.487284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd2e10-f633-43c2-9570-77f1450c8e5b None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:07.520846 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f4fb1-d05d-41ec-994e-0a727c2544da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:07.521467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f4fb1-d05d-41ec-994e-0a727c2544da None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:07.521747 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f4fb1-d05d-41ec-994e-0a727c2544da None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:07.522022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f4fb1-d05d-41ec-994e-0a727c2544da None admin] PATH_INFO: `/v3/endpoints` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:07.522769 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f4fb1-d05d-41ec-994e-0a727c2544da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:07.524135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f4fb1-d05d-41ec-994e-0a727c2544da None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:07.546558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 497/1002] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:37:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:37:08.676436 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d205ac-703c-414d-a2d5-c2ad404acbc8 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:08.677004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d205ac-703c-414d-a2d5-c2ad404acbc8 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:08.677004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d205ac-703c-414d-a2d5-c2ad404acbc8 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:08.678558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 506/1003] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:08.683767 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947524-b4c6-4485-85a2-6b83493763ba None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:08.684771 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947524-b4c6-4485-85a2-6b83493763ba None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:08.684867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947524-b4c6-4485-85a2-6b83493763ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:08.703992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-f2947524-b4c6-4485-85a2-6b83493763ba None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:08.705176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f2947524-b4c6-4485-85a2-6b83493763ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:08.761339 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:08.787493 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 498/1004] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:08 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:08.810739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d205ac-703c-414d-a2d5-c2ad404acbc8 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:08.843503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:08.926404 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d205ac-703c-414d-a2d5-c2ad404acbc8 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:08.961724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b664c-bc90-43c3-823e-819341f0b798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:08.962317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b664c-bc90-43c3-823e-819341f0b798 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:08.962599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b664c-bc90-43c3-823e-819341f0b798 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:08.962872 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b664c-bc90-43c3-823e-819341f0b798 None admin] PATH_INFO: `/v3/services/image` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:08.963499 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b664c-bc90-43c3-823e-819341f0b798 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:08.964848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b664c-bc90-43c3-823e-819341f0b798 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-513b664c-bc90-43c3-823e-819341f0b798 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:08.974960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:08.976003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:08.976861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:08.976861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:08.976861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:08.976861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:08.976861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:08.976861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:08.976861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:08.976861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:08.976861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:08.976861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:08.976861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:37:08.976861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:08.976861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 10:37:08.976861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:08.981561 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 507/1005] 10.222.0.43 () {56 vars in 1105 bytes} [Wed Jul 27 10:37:08 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:08.982834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2947524-b4c6-4485-85a2-6b83493763ba None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:09.104057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2947524-b4c6-4485-85a2-6b83493763ba None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:09.141669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822768af-7ffe-4b40-b3f2-47ed8e477de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:09.142327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822768af-7ffe-4b40-b3f2-47ed8e477de9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:09.142613 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822768af-7ffe-4b40-b3f2-47ed8e477de9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:09.142895 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822768af-7ffe-4b40-b3f2-47ed8e477de9 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:09.143571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822768af-7ffe-4b40-b3f2-47ed8e477de9 None admin] RBAC: Adding query filter params (name=image) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:09.143876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822768af-7ffe-4b40-b3f2-47ed8e477de9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:09.145250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822768af-7ffe-4b40-b3f2-47ed8e477de9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:09.154415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 499/1006] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:09.157506 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b664c-bc90-43c3-823e-819341f0b798 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:09.251494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9b942-535f-444f-be7b-9954740d1b78 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:09.251678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9b942-535f-444f-be7b-9954740d1b78 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:09.251959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9b942-535f-444f-be7b-9954740d1b78 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:09.253562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 500/1007] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:37:09.258340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a1b40-370a-4947-9538-18125b7001f0 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:09.258630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a1b40-370a-4947-9538-18125b7001f0 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:09.258911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a1b40-370a-4947-9538-18125b7001f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:09.267174 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:09.275518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b664c-bc90-43c3-823e-819341f0b798 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:09.279982 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-051a1b40-370a-4947-9538-18125b7001f0 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:09.281190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-051a1b40-370a-4947-9538-18125b7001f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:09.313745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79925d-99fe-45e3-a910-14884d7352d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:09.314525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79925d-99fe-45e3-a910-14884d7352d3 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:09.314675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79925d-99fe-45e3-a910-14884d7352d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:09.314994 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79925d-99fe-45e3-a910-14884d7352d3 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:09.315761 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79925d-99fe-45e3-a910-14884d7352d3 None admin] RBAC: Adding query filter params (type=image) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:09.316184 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79925d-99fe-45e3-a910-14884d7352d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:09.317556 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79925d-99fe-45e3-a910-14884d7352d3 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:09.322809 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 508/1008] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:09.335915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:09.370361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 501/1009] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:09 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:37:09.393282 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79925d-99fe-45e3-a910-14884d7352d3 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:09.507380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79925d-99fe-45e3-a910-14884d7352d3 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:09.542825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc72ce6-20fe-422f-9751-6fe814bbb1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:09.543524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc72ce6-20fe-422f-9751-6fe814bbb1ca None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:09.543971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc72ce6-20fe-422f-9751-6fe814bbb1ca None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:09.544336 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc72ce6-20fe-422f-9751-6fe814bbb1ca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:09.544974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc72ce6-20fe-422f-9751-6fe814bbb1ca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:09.546373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc72ce6-20fe-422f-9751-6fe814bbb1ca None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-4bc72ce6-20fe-422f-9751-6fe814bbb1ca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:09.555409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:09.556447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:09.562871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 509/1010] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jul 27 10:37:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:09.566587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a1b40-370a-4947-9538-18125b7001f0 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:09.665668 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb49d3-0339-4359-b4f0-64a09b155aae None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:09.665958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb49d3-0339-4359-b4f0-64a09b155aae None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:09.666274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb49d3-0339-4359-b4f0-64a09b155aae None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:09.667752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 510/1011] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:09.673362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87cc5e-68af-4759-b96d-34bed48c0ddd None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:09.673626 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a1b40-370a-4947-9538-18125b7001f0 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:09.673732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87cc5e-68af-4759-b96d-34bed48c0ddd None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:09.673919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87cc5e-68af-4759-b96d-34bed48c0ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:09.692253 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6a87cc5e-68af-4759-b96d-34bed48c0ddd None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:09.693458 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6a87cc5e-68af-4759-b96d-34bed48c0ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:09.711332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8b797-9afd-47fb-88ba-73a1e406c3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:09.711966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b797-9afd-47fb-88ba-73a1e406c3a2 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:09.712249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b797-9afd-47fb-88ba-73a1e406c3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:09.712481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:09.712569 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b797-9afd-47fb-88ba-73a1e406c3a2 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:09.713200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8b797-9afd-47fb-88ba-73a1e406c3a2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:09.713586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8b797-9afd-47fb-88ba-73a1e406c3a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:09.714912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8b797-9afd-47fb-88ba-73a1e406c3a2 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:09.725221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 502/1012] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jul 27 10:37:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:09.726348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8b797-9afd-47fb-88ba-73a1e406c3a2 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:09.771460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 511/1013] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:09 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:37:09.772012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:09.795133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87cc5e-68af-4759-b96d-34bed48c0ddd None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:09.838211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8b797-9afd-47fb-88ba-73a1e406c3a2 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:09.877880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385d40a-098f-49c1-aaee-68930c2efb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:09.878558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385d40a-098f-49c1-aaee-68930c2efb0a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:09.878842 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385d40a-098f-49c1-aaee-68930c2efb0a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:09.879120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385d40a-098f-49c1-aaee-68930c2efb0a None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:09.879816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385d40a-098f-49c1-aaee-68930c2efb0a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:09.880139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385d40a-098f-49c1-aaee-68930c2efb0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:09.881503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385d40a-098f-49c1-aaee-68930c2efb0a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:09.886648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 503/1014] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jul 27 10:37:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:09.893006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385d40a-098f-49c1-aaee-68930c2efb0a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:09.918018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87cc5e-68af-4759-b96d-34bed48c0ddd None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:09.955408 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44acee4-eda6-4935-a3d6-13367b1bb10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:09.956314 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44acee4-eda6-4935-a3d6-13367b1bb10f None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:09.956594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44acee4-eda6-4935-a3d6-13367b1bb10f None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:09.956869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44acee4-eda6-4935-a3d6-13367b1bb10f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:09.968004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44acee4-eda6-4935-a3d6-13367b1bb10f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-d44acee4-eda6-4935-a3d6-13367b1bb10f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:37:09.972952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:09.973946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:09.979113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:09.979113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:09.979113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:09.979113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:09.979113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:37:09.979113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:37:09.979113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:37:09.979113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:37:09.979113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:37:09.979113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:37:09.979113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 10:37:09.979113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:09.979113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 512/1015] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Jul 27 10:37:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:37:09.980923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44acee4-eda6-4935-a3d6-13367b1bb10f None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:09.999222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:10.011564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385d40a-098f-49c1-aaee-68930c2efb0a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:10.014333 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:10.056633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29436cfb-71b5-4642-b3e6-dbcd2ba788c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:10.057451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29436cfb-71b5-4642-b3e6-dbcd2ba788c9 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:10.057716 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29436cfb-71b5-4642-b3e6-dbcd2ba788c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:10.057986 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29436cfb-71b5-4642-b3e6-dbcd2ba788c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:10.058735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29436cfb-71b5-4642-b3e6-dbcd2ba788c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:10.060267 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29436cfb-71b5-4642-b3e6-dbcd2ba788c9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:10.086225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 504/1016] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:37:09 2022] POST /identity/v3/endpoints => generated 325 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:37:10.096288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44acee4-eda6-4935-a3d6-13367b1bb10f None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:10.143248 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1a39d-55ad-4460-87ea-4762cd6e1ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:10.143979 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1a39d-55ad-4460-87ea-4762cd6e1ae1 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:10.144330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1a39d-55ad-4460-87ea-4762cd6e1ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:10.144674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1a39d-55ad-4460-87ea-4762cd6e1ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:10.145591 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1a39d-55ad-4460-87ea-4762cd6e1ae1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:10.145865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1a39d-55ad-4460-87ea-4762cd6e1ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:10.147472 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1a39d-55ad-4460-87ea-4762cd6e1ae1 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:10.161923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 513/1017] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Jul 27 10:37:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:10.163932 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29436cfb-71b5-4642-b3e6-dbcd2ba788c9 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:10.279031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29436cfb-71b5-4642-b3e6-dbcd2ba788c9 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:10.317211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734e9e2-fe6d-44b7-a694-f5e9d586cb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:10.317778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e9e2-fe6d-44b7-a694-f5e9d586cb1b None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:10.318065 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e9e2-fe6d-44b7-a694-f5e9d586cb1b None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:10.318377 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734e9e2-fe6d-44b7-a694-f5e9d586cb1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:10.331057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734e9e2-fe6d-44b7-a694-f5e9d586cb1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:10.332536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734e9e2-fe6d-44b7-a694-f5e9d586cb1b None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-5734e9e2-fe6d-44b7-a694-f5e9d586cb1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:37:10.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:10.348651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:10.349609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:37:10.349609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:37:10.349609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:10.349609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:10.349609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 505/1018] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:10.355528 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1a39d-55ad-4460-87ea-4762cd6e1ae1 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:10.429596 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:10.465873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1a39d-55ad-4460-87ea-4762cd6e1ae1 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:10.500500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd000180-50db-47c2-a1d1-4b96ddde39fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:10.501525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd000180-50db-47c2-a1d1-4b96ddde39fd None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:10.501525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd000180-50db-47c2-a1d1-4b96ddde39fd None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:10.502199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd000180-50db-47c2-a1d1-4b96ddde39fd None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:10.502662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd000180-50db-47c2-a1d1-4b96ddde39fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:10.503035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd000180-50db-47c2-a1d1-4b96ddde39fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:10.504475 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd000180-50db-47c2-a1d1-4b96ddde39fd None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:10.521846 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 514/1019] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:10.523055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734e9e2-fe6d-44b7-a694-f5e9d586cb1b None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:10.540179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:10.633642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734e9e2-fe6d-44b7-a694-f5e9d586cb1b None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:10.669401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b5d5d-e33f-4c08-8d5f-c7c55f2d01ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:10.670031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b5d5d-e33f-4c08-8d5f-c7c55f2d01ed None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:10.670347 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b5d5d-e33f-4c08-8d5f-c7c55f2d01ed None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:10.670628 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b5d5d-e33f-4c08-8d5f-c7c55f2d01ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:10.678489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b5d5d-e33f-4c08-8d5f-c7c55f2d01ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:10.679969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b5d5d-e33f-4c08-8d5f-c7c55f2d01ed None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-ec3b5d5d-e33f-4c08-8d5f-c7c55f2d01ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:37:10.692245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:10.693378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:10.694601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:10.694601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:10.694601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:37:10.694601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:37:10.694601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:37:10.694601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:37:10.694601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:37:10.694601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:37:10.694601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:37:10.694601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:10.694601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 506/1020] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jul 27 10:37:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:10.701231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd000180-50db-47c2-a1d1-4b96ddde39fd None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:10.805210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd000180-50db-47c2-a1d1-4b96ddde39fd None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:10.837162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:10.844180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea3e6f-56d6-4201-bbb8-b2d81f7d02ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:10.844871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3e6f-56d6-4201-bbb8-b2d81f7d02ac None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:10.845295 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3e6f-56d6-4201-bbb8-b2d81f7d02ac None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:10.845721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea3e6f-56d6-4201-bbb8-b2d81f7d02ac None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:10.846804 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea3e6f-56d6-4201-bbb8-b2d81f7d02ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:10.847287 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea3e6f-56d6-4201-bbb8-b2d81f7d02ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:10.849448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea3e6f-56d6-4201-bbb8-b2d81f7d02ac None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:10.880191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 515/1021] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jul 27 10:37:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:10.887420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b5d5d-e33f-4c08-8d5f-c7c55f2d01ed None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:10.973150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:11.002222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b5d5d-e33f-4c08-8d5f-c7c55f2d01ed None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:11.038906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90741100-de51-404f-a2c4-95e3c0bac7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:11.039525 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741100-de51-404f-a2c4-95e3c0bac7e2 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:11.039807 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741100-de51-404f-a2c4-95e3c0bac7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:11.040084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741100-de51-404f-a2c4-95e3c0bac7e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:11.112254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90741100-de51-404f-a2c4-95e3c0bac7e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:11.113702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90741100-de51-404f-a2c4-95e3c0bac7e2 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:11.190710 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:11.228786 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 507/1022] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:37:10 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:37:11.230120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea3e6f-56d6-4201-bbb8-b2d81f7d02ac None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:11.343320 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea3e6f-56d6-4201-bbb8-b2d81f7d02ac None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:11.355367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58bd51-cee3-477c-a17d-418a54bb66f6 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:11.355648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58bd51-cee3-477c-a17d-418a54bb66f6 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:11.356626 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58bd51-cee3-477c-a17d-418a54bb66f6 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:11.358326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 508/1023] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:37:11.363279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff8619-3cf4-4872-9c0b-2cf57a7b12aa None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:11.363567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff8619-3cf4-4872-9c0b-2cf57a7b12aa None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:11.363845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff8619-3cf4-4872-9c0b-2cf57a7b12aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:11.380387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407142e-bb62-437b-8113-97555a5caf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:11.381079 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407142e-bb62-437b-8113-97555a5caf19 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:11.381307 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407142e-bb62-437b-8113-97555a5caf19 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:11.381582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407142e-bb62-437b-8113-97555a5caf19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:11.383081 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-dcff8619-3cf4-4872-9c0b-2cf57a7b12aa None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:11.384288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-dcff8619-3cf4-4872-9c0b-2cf57a7b12aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:11.392833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407142e-bb62-437b-8113-97555a5caf19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:11.394211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407142e-bb62-437b-8113-97555a5caf19 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-7407142e-bb62-437b-8113-97555a5caf19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:37:11.409733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:11.410724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:11.411647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:37:11.411647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:37:11.411647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:11.411647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:11.411647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 516/1024] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:11.416644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407142e-bb62-437b-8113-97555a5caf19 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:11.461662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 509/1025] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:11 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:37:11.463823 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:11.484561 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff8619-3cf4-4872-9c0b-2cf57a7b12aa None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:11.523584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407142e-bb62-437b-8113-97555a5caf19 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:11.561131 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d0eb2-fbf6-4f66-8d13-b8a3a4ef38aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:11.561750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0eb2-fbf6-4f66-8d13-b8a3a4ef38aa None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:11.562530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0eb2-fbf6-4f66-8d13-b8a3a4ef38aa None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:11.562817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0eb2-fbf6-4f66-8d13-b8a3a4ef38aa None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:11.563521 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d0eb2-fbf6-4f66-8d13-b8a3a4ef38aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:11.563830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d0eb2-fbf6-4f66-8d13-b8a3a4ef38aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:11.565205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d0eb2-fbf6-4f66-8d13-b8a3a4ef38aa None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:11.581919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 517/1026] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:11.583218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d0eb2-fbf6-4f66-8d13-b8a3a4ef38aa None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:11.595723 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff8619-3cf4-4872-9c0b-2cf57a7b12aa None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:11.598980 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:11.635791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196a6a1-f513-4572-a5e0-573231c0a4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:11.636428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196a6a1-f513-4572-a5e0-573231c0a4fd None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:11.636710 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196a6a1-f513-4572-a5e0-573231c0a4fd None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:11.637070 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196a6a1-f513-4572-a5e0-573231c0a4fd None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:11.637812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196a6a1-f513-4572-a5e0-573231c0a4fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:11.639335 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196a6a1-f513-4572-a5e0-573231c0a4fd None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:11.658406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 510/1027] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jul 27 10:37:11 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:37:11.707309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d0eb2-fbf6-4f66-8d13-b8a3a4ef38aa None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:11.709661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:11.759091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc378492-3303-4a61-b8c3-e4ac2559bca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:11.759663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc378492-3303-4a61-b8c3-e4ac2559bca7 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:11.759948 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc378492-3303-4a61-b8c3-e4ac2559bca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:11.760223 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc378492-3303-4a61-b8c3-e4ac2559bca7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:11.768815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc378492-3303-4a61-b8c3-e4ac2559bca7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:11.770366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc378492-3303-4a61-b8c3-e4ac2559bca7 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-dc378492-3303-4a61-b8c3-e4ac2559bca7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:37:11.782964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:11.783974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:11.784922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:37:11.784922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:37:11.784922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:37:11.784922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:37:11.784922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:37:11.784922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:37:11.784922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:37:11.784922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:11.784922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 518/1028] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:37:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:37:11.790219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196a6a1-f513-4572-a5e0-573231c0a4fd None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:11.907398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196a6a1-f513-4572-a5e0-573231c0a4fd None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:11.948609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46edee-cecf-4630-9955-bdcdd702d882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:11.950107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46edee-cecf-4630-9955-bdcdd702d882 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:11.950698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46edee-cecf-4630-9955-bdcdd702d882 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:11.951152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46edee-cecf-4630-9955-bdcdd702d882 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:11.952078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46edee-cecf-4630-9955-bdcdd702d882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:11.952538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46edee-cecf-4630-9955-bdcdd702d882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:11.954120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46edee-cecf-4630-9955-bdcdd702d882 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:11.967113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 511/1029] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:37:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:11.972858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc378492-3303-4a61-b8c3-e4ac2559bca7 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:12.077575 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc378492-3303-4a61-b8c3-e4ac2559bca7 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:12.114166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a807991-d468-40bc-b37e-3a147954abb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:12.114818 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a807991-d468-40bc-b37e-3a147954abb5 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:12.115102 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a807991-d468-40bc-b37e-3a147954abb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:12.115376 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a807991-d468-40bc-b37e-3a147954abb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:12.116162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a807991-d468-40bc-b37e-3a147954abb5 None admin] RBAC: Adding query filter params (role.id=569a224091254f49a695cfe9bad598c8, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=3bb16c9232464cc2aeee12b7fa918b8e) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:12.116474 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a807991-d468-40bc-b37e-3a147954abb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:12.117973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a807991-d468-40bc-b37e-3a147954abb5 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:12.130215 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 519/1030] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:37:11 2022] GET /identity/v3/role_assignments?user.id=3bb16c9232464cc2aeee12b7fa918b8e&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=569a224091254f49a695cfe9bad598c8 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:12.175522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4786a-020c-4394-9be0-824d9870c21b None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:12.175805 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4786a-020c-4394-9be0-824d9870c21b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:12.176069 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4786a-020c-4394-9be0-824d9870c21b None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:12.177692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 512/1031] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:12.183614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c3786-076d-4243-a752-f411816e8e09 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:12.184550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c3786-076d-4243-a752-f411816e8e09 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:12.185023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c3786-076d-4243-a752-f411816e8e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:12.204325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-b06c3786-076d-4243-a752-f411816e8e09 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:12.205556 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b06c3786-076d-4243-a752-f411816e8e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:12.225509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:12.285085 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 520/1032] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:12.310328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4786a-020c-4394-9be0-824d9870c21b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:12.337981 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:12.423111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4786a-020c-4394-9be0-824d9870c21b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:12.460053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440d65f-9e11-480d-9538-85830a864ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:12.460701 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440d65f-9e11-480d-9538-85830a864ae9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:12.460987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440d65f-9e11-480d-9538-85830a864ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:12.461265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440d65f-9e11-480d-9538-85830a864ae9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:12.462476 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440d65f-9e11-480d-9538-85830a864ae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:12.463915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440d65f-9e11-480d-9538-85830a864ae9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:12.465735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 513/1033] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:12.471651 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c3786-076d-4243-a752-f411816e8e09 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:12.577245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c3786-076d-4243-a752-f411816e8e09 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:12.614620 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0be3a-3349-40e4-93ae-8657c703fb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:12.615323 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0be3a-3349-40e4-93ae-8657c703fb86 None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:12.615701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0be3a-3349-40e4-93ae-8657c703fb86 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:12.616083 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0be3a-3349-40e4-93ae-8657c703fb86 None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:12.616887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0be3a-3349-40e4-93ae-8657c703fb86 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:12.618461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0be3a-3349-40e4-93ae-8657c703fb86 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:12.654229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 521/1034] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jul 27 10:37:12 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:37:13.737575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdf009-7239-4cbd-90cd-afdcf21a4876 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:13.739895 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdf009-7239-4cbd-90cd-afdcf21a4876 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:13.739895 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdf009-7239-4cbd-90cd-afdcf21a4876 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:13.739895 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 514/1035] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:13.744972 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e19fa9-f3e3-40dc-9549-438951bf4e3c None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:13.745497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e19fa9-f3e3-40dc-9549-438951bf4e3c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:13.745497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e19fa9-f3e3-40dc-9549-438951bf4e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:13.754003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:13.765536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-a8e19fa9-f3e3-40dc-9549-438951bf4e3c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:13.766756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a8e19fa9-f3e3-40dc-9549-438951bf4e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:13.840613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 522/1036] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:13.863502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdf009-7239-4cbd-90cd-afdcf21a4876 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:13.965427 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:13.976379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdf009-7239-4cbd-90cd-afdcf21a4876 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:14.012187 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd1c8c-3cf7-4fc5-820d-dd2c60c6219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:14.012680 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1c8c-3cf7-4fc5-820d-dd2c60c6219b None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:14.012961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1c8c-3cf7-4fc5-820d-dd2c60c6219b None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:14.013233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1c8c-3cf7-4fc5-820d-dd2c60c6219b None admin] PATH_INFO: `/v3/services/image` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:14.013867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd1c8c-3cf7-4fc5-820d-dd2c60c6219b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:14.015265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd1c8c-3cf7-4fc5-820d-dd2c60c6219b None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-effd1c8c-3cf7-4fc5-820d-dd2c60c6219b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:14.024355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:14.025522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:14.026506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:14.026506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:14.026506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:14.026506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:14.026506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:14.026506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:14.026506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:14.026506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:14.026506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:14.026506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:14.026506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:37:14.026506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:14.026506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 10:37:14.026506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:14.030269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 515/1037] 10.222.0.43 () {56 vars in 1105 bytes} [Wed Jul 27 10:37:13 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:14.032411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e19fa9-f3e3-40dc-9549-438951bf4e3c None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:14.134954 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e19fa9-f3e3-40dc-9549-438951bf4e3c None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:14.169290 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731de06-13c5-4b2f-a274-a6bd45787a83 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:14.169989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731de06-13c5-4b2f-a274-a6bd45787a83 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:14.170307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731de06-13c5-4b2f-a274-a6bd45787a83 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:14.171031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102415c-7269-4921-a190-ac3570b5155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:14.171823 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102415c-7269-4921-a190-ac3570b5155d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:14.171936 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 516/1038] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:37:14.172023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102415c-7269-4921-a190-ac3570b5155d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:14.172225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102415c-7269-4921-a190-ac3570b5155d None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:14.172888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102415c-7269-4921-a190-ac3570b5155d None admin] RBAC: Adding query filter params (name=image) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:14.173230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102415c-7269-4921-a190-ac3570b5155d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:14.174794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102415c-7269-4921-a190-ac3570b5155d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:14.176002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:14.177411 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9956e4-7c5f-4c8b-a1ce-6844e674bd53 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:14.177710 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9956e4-7c5f-4c8b-a1ce-6844e674bd53 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:14.177958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9956e4-7c5f-4c8b-a1ce-6844e674bd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:14.180600 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 523/1039] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:14.186545 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102415c-7269-4921-a190-ac3570b5155d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:14.201062 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-bf9956e4-7c5f-4c8b-a1ce-6844e674bd53 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:14.202269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-bf9956e4-7c5f-4c8b-a1ce-6844e674bd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:14.285171 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 517/1040] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:14.298132 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102415c-7269-4921-a190-ac3570b5155d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:14.299949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9956e4-7c5f-4c8b-a1ce-6844e674bd53 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:14.336467 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743ca59-5ca8-40fb-b2b6-1b5891e8b10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:14.337087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ca59-5ca8-40fb-b2b6-1b5891e8b10d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:14.337362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ca59-5ca8-40fb-b2b6-1b5891e8b10d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:14.337631 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ca59-5ca8-40fb-b2b6-1b5891e8b10d None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:14.338333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743ca59-5ca8-40fb-b2b6-1b5891e8b10d None admin] RBAC: Adding query filter params (type=image) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:14.338636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743ca59-5ca8-40fb-b2b6-1b5891e8b10d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:14.340561 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743ca59-5ca8-40fb-b2b6-1b5891e8b10d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:14.346101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 524/1041] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:14.351684 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743ca59-5ca8-40fb-b2b6-1b5891e8b10d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:14.393522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:14.411979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9956e4-7c5f-4c8b-a1ce-6844e674bd53 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:14.418072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:14.452518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc0236-1931-4bcb-8220-53753746577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:14.453174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc0236-1931-4bcb-8220-53753746577f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:14.453460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc0236-1931-4bcb-8220-53753746577f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:14.453736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc0236-1931-4bcb-8220-53753746577f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:14.460029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743ca59-5ca8-40fb-b2b6-1b5891e8b10d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:14.465005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc0236-1931-4bcb-8220-53753746577f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-d2fc0236-1931-4bcb-8220-53753746577f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:37:14.470633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:14.471621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:14.472506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:14.472506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:14.472506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:14.472506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:14.472506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:37:14.472506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:37:14.472506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:37:14.472506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:37:14.472506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:37:14.472506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:37:14.472506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 10:37:14.472506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:14.472506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 518/1042] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Jul 27 10:37:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:37:14.477814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc0236-1931-4bcb-8220-53753746577f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:14.502036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e9ac-6453-4d9a-9408-184cecc17777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:14.502839 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e9ac-6453-4d9a-9408-184cecc17777 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:14.503124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e9ac-6453-4d9a-9408-184cecc17777 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:14.503399 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e9ac-6453-4d9a-9408-184cecc17777 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:14.504159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610e9ac-6453-4d9a-9408-184cecc17777 None admin] RBAC: Adding query filter params (interface=public, service_id=c74e44f0dd1344f19248dd91403aea9e, region_id=RegionOne) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:14.504472 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610e9ac-6453-4d9a-9408-184cecc17777 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:14.505833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610e9ac-6453-4d9a-9408-184cecc17777 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:14.511322 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 525/1043] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jul 27 10:37:14 2022] GET /identity/v3/endpoints?service_id=c74e44f0dd1344f19248dd91403aea9e&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:14.517387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e9ac-6453-4d9a-9408-184cecc17777 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:14.602094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc0236-1931-4bcb-8220-53753746577f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:14.622267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e9ac-6453-4d9a-9408-184cecc17777 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:14.639102 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f83f06-6f91-40e5-be5a-61caefddcad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:14.639751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83f06-6f91-40e5-be5a-61caefddcad9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:14.640034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83f06-6f91-40e5-be5a-61caefddcad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:14.640307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83f06-6f91-40e5-be5a-61caefddcad9 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:14.641044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f83f06-6f91-40e5-be5a-61caefddcad9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:14.641354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f83f06-6f91-40e5-be5a-61caefddcad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:14.642775 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f83f06-6f91-40e5-be5a-61caefddcad9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:14.651382 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:14.652307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 519/1044] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Jul 27 10:37:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:14.659189 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f83f06-6f91-40e5-be5a-61caefddcad9 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:14.666044 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803ea07-ba49-4fc2-96ee-a79728cd51b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:14.666714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803ea07-ba49-4fc2-96ee-a79728cd51b0 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:14.666997 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803ea07-ba49-4fc2-96ee-a79728cd51b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:14.667272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803ea07-ba49-4fc2-96ee-a79728cd51b0 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:14.667936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803ea07-ba49-4fc2-96ee-a79728cd51b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:14.669332 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803ea07-ba49-4fc2-96ee-a79728cd51b0 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:14.670629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:14.676653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 526/1045] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jul 27 10:37:14 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:37:14.736026 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcd34a-9f24-42ba-a143-75c335b5236b None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:14.736524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcd34a-9f24-42ba-a143-75c335b5236b None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:14.736816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fcd34a-9f24-42ba-a143-75c335b5236b None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:14.739013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 527/1046] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:37:14.744722 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535955f5-c501-48ad-9769-3b08ef9b2e73 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:14.745012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535955f5-c501-48ad-9769-3b08ef9b2e73 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:14.745549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535955f5-c501-48ad-9769-3b08ef9b2e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:14.765472 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-535955f5-c501-48ad-9769-3b08ef9b2e73 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:14.766742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-535955f5-c501-48ad-9769-3b08ef9b2e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:14.782080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f83f06-6f91-40e5-be5a-61caefddcad9 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:14.822851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b164c-c07a-4778-8ec2-05deeaaad244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:14.823511 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b164c-c07a-4778-8ec2-05deeaaad244 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:14.823789 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b164c-c07a-4778-8ec2-05deeaaad244 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:14.824061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b164c-c07a-4778-8ec2-05deeaaad244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:14.837127 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b164c-c07a-4778-8ec2-05deeaaad244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:14.838541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b164c-c07a-4778-8ec2-05deeaaad244 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:14.850868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 528/1047] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-e73b164c-c07a-4778-8ec2-05deeaaad244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:37:14.862132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:14.863179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:14.869256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:37:14.869256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:37:14.869256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:14.869256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:14.869256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 520/1048] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:14.872223 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535955f5-c501-48ad-9769-3b08ef9b2e73 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:14.879451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b164c-c07a-4778-8ec2-05deeaaad244 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:14.953929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:15.004524 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b164c-c07a-4778-8ec2-05deeaaad244 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:15.010167 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535955f5-c501-48ad-9769-3b08ef9b2e73 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:15.032889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:15.050816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922b226-3a5f-4f8f-bae2-9d343241f09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:15.052079 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922b226-3a5f-4f8f-bae2-9d343241f09c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:15.052354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922b226-3a5f-4f8f-bae2-9d343241f09c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:15.052623 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922b226-3a5f-4f8f-bae2-9d343241f09c None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:15.052869 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0152f-f928-4a40-94b3-c0c0c2d794c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:15.053321 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922b226-3a5f-4f8f-bae2-9d343241f09c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:15.053509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0152f-f928-4a40-94b3-c0c0c2d794c6 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:15.053675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922b226-3a5f-4f8f-bae2-9d343241f09c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:15.053834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0152f-f928-4a40-94b3-c0c0c2d794c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:15.054071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0152f-f928-4a40-94b3-c0c0c2d794c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:15.055294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0152f-f928-4a40-94b3-c0c0c2d794c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:15.055413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922b226-3a5f-4f8f-bae2-9d343241f09c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:15.057141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0152f-f928-4a40-94b3-c0c0c2d794c6 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:15.060405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 521/1049] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:15.065887 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0152f-f928-4a40-94b3-c0c0c2d794c6 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:15.073222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 529/1050] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:15.074393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922b226-3a5f-4f8f-bae2-9d343241f09c None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:15.192964 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0152f-f928-4a40-94b3-c0c0c2d794c6 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:15.209325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922b226-3a5f-4f8f-bae2-9d343241f09c None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:15.227544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:15.239355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7495e-e073-4531-8875-fd6fcc4dce59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:15.239988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7495e-e073-4531-8875-fd6fcc4dce59 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:15.240276 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7495e-e073-4531-8875-fd6fcc4dce59 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:15.240724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7495e-e073-4531-8875-fd6fcc4dce59 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:15.241763 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7495e-e073-4531-8875-fd6fcc4dce59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:15.243541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7495e-e073-4531-8875-fd6fcc4dce59 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:15.255225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76c472-a9d1-4e18-bcb2-dea2ddf34de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:15.255890 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76c472-a9d1-4e18-bcb2-dea2ddf34de2 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:15.256181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76c472-a9d1-4e18-bcb2-dea2ddf34de2 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:15.256459 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76c472-a9d1-4e18-bcb2-dea2ddf34de2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:15.270899 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76c472-a9d1-4e18-bcb2-dea2ddf34de2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:15.272514 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76c472-a9d1-4e18-bcb2-dea2ddf34de2 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:15.282560 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 522/1051] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:37:15 2022] POST /identity/v3/users => generated 285 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-6e76c472-a9d1-4e18-bcb2-dea2ddf34de2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:37:15.286128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:15.288106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:15.289980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:15.289980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:15.289980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:37:15.289980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:37:15.289980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:37:15.289980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:37:15.289980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:37:15.289980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:37:15.289980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:37:15.289980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:15.293353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 530/1052] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jul 27 10:37:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:15.294574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7495e-e073-4531-8875-fd6fcc4dce59 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:15.414843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7495e-e073-4531-8875-fd6fcc4dce59 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:15.455753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4b331-8c45-4738-8e90-b4327c4bd4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:15.456302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4b331-8c45-4738-8e90-b4327c4bd4be None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:15.456586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4b331-8c45-4738-8e90-b4327c4bd4be None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:15.456865 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4b331-8c45-4738-8e90-b4327c4bd4be None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:15.457679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4b331-8c45-4738-8e90-b4327c4bd4be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:15.457991 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4b331-8c45-4738-8e90-b4327c4bd4be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:15.459460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4b331-8c45-4738-8e90-b4327c4bd4be None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:15.478226 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 523/1053] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jul 27 10:37:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:15.484391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76c472-a9d1-4e18-bcb2-dea2ddf34de2 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:15.532551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:15.594498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76c472-a9d1-4e18-bcb2-dea2ddf34de2 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:15.630199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81743e9-6e8b-445b-bf64-530273873c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:15.630946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81743e9-6e8b-445b-bf64-530273873c72 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:15.631298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81743e9-6e8b-445b-bf64-530273873c72 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:15.631644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81743e9-6e8b-445b-bf64-530273873c72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:15.643749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81743e9-6e8b-445b-bf64-530273873c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:15.645295 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81743e9-6e8b-445b-bf64-530273873c72 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-a81743e9-6e8b-445b-bf64-530273873c72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:37:15.660179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:15.661289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:15.662584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:37:15.662584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:37:15.662584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:15.662584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:15.663076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 531/1054] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:15.668814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4b331-8c45-4738-8e90-b4327c4bd4be None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:15.716589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:15.780133 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4b331-8c45-4738-8e90-b4327c4bd4be None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:15.816887 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63b508-e4a2-4f08-b936-c129ad808143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:15.817672 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63b508-e4a2-4f08-b936-c129ad808143 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:15.818023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63b508-e4a2-4f08-b936-c129ad808143 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:15.818403 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63b508-e4a2-4f08-b936-c129ad808143 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:15.819203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63b508-e4a2-4f08-b936-c129ad808143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:15.819582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63b508-e4a2-4f08-b936-c129ad808143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:15.821030 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63b508-e4a2-4f08-b936-c129ad808143 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:15.837057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 524/1055] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:15.840815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81743e9-6e8b-445b-bf64-530273873c72 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:15.947481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:15.957794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81743e9-6e8b-445b-bf64-530273873c72 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:15.992629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a17c9-7ee7-4594-8193-aa3713b3b540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:15.993337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a17c9-7ee7-4594-8193-aa3713b3b540 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:15.993717 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a17c9-7ee7-4594-8193-aa3713b3b540 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:15.994085 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a17c9-7ee7-4594-8193-aa3713b3b540 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:16.002172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a17c9-7ee7-4594-8193-aa3713b3b540 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:16.003752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a17c9-7ee7-4594-8193-aa3713b3b540 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-1f4a17c9-7ee7-4594-8193-aa3713b3b540 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:37:16.015741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:16.016714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:16.017642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:37:16.017642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:37:16.017642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:37:16.017642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:37:16.017642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:37:16.017642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:37:16.017642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:37:16.017642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:16.021702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 532/1056] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:37:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:16.023111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63b508-e4a2-4f08-b936-c129ad808143 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:16.133740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63b508-e4a2-4f08-b936-c129ad808143 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:16.135363 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:16.170641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217a47e-9667-4e8c-9727-f0b6b3f678e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:16.171268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217a47e-9667-4e8c-9727-f0b6b3f678e2 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:16.171553 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217a47e-9667-4e8c-9727-f0b6b3f678e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:16.171833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217a47e-9667-4e8c-9727-f0b6b3f678e2 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:16.172632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217a47e-9667-4e8c-9727-f0b6b3f678e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:16.172949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217a47e-9667-4e8c-9727-f0b6b3f678e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:16.174403 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217a47e-9667-4e8c-9727-f0b6b3f678e2 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:16.192503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 525/1057] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:37:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:16.194236 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a17c9-7ee7-4594-8193-aa3713b3b540 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:16.303467 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a17c9-7ee7-4594-8193-aa3713b3b540 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:16.339536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ce3d8-3ba1-4447-ab7a-45daff4e5015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:16.340397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce3d8-3ba1-4447-ab7a-45daff4e5015 None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:16.340883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce3d8-3ba1-4447-ab7a-45daff4e5015 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:16.341255 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce3d8-3ba1-4447-ab7a-45daff4e5015 None admin] PATH_INFO: `/v3/projects/52e68e1a140146e28b504864955367c1/users/3bb16c9232464cc2aeee12b7fa918b8e/roles/569a224091254f49a695cfe9bad598c8` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:16.343491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ce3d8-3ba1-4447-ab7a-45daff4e5015 None admin] RBAC: Authorizing `identity:create_grant(project_id=52e68e1a140146e28b504864955367c1, user_id=3bb16c9232464cc2aeee12b7fa918b8e, role_id=569a224091254f49a695cfe9bad598c8)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:16.344928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ce3d8-3ba1-4447-ab7a-45daff4e5015 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:16.359784 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 533/1058] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:37:16 2022] PUT /identity/v3/projects/52e68e1a140146e28b504864955367c1/users/3bb16c9232464cc2aeee12b7fa918b8e/roles/569a224091254f49a695cfe9bad598c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:37:16.778786 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e8efe-7916-4c67-a04a-94f0be6893e4 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:16.779068 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e8efe-7916-4c67-a04a-94f0be6893e4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:16.779508 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e8efe-7916-4c67-a04a-94f0be6893e4 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:16.780805 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 526/1059] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:37:16.791638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49fd1d-baa2-4af0-890e-474cac6d5332 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:16.791940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49fd1d-baa2-4af0-890e-474cac6d5332 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:16.792230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49fd1d-baa2-4af0-890e-474cac6d5332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:16.814781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-7a49fd1d-baa2-4af0-890e-474cac6d5332 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:16.817070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7a49fd1d-baa2-4af0-890e-474cac6d5332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:16.827817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:16.919151 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 534/1060] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:37:16.950778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e8efe-7916-4c67-a04a-94f0be6893e4 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:17.094801 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e8efe-7916-4c67-a04a-94f0be6893e4 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:17.136836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb9e5-b043-4d46-a2df-39a3f060cca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:17.137864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb9e5-b043-4d46-a2df-39a3f060cca6 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:17.138421 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb9e5-b043-4d46-a2df-39a3f060cca6 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:17.138839 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb9e5-b043-4d46-a2df-39a3f060cca6 None admin] PATH_INFO: `/v3/services/image` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:17.139490 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fb9e5-b043-4d46-a2df-39a3f060cca6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:17.141439 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9fb9e5-b043-4d46-a2df-39a3f060cca6 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-3f9fb9e5-b043-4d46-a2df-39a3f060cca6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:17.157472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:17.159095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:17.160782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:17.160782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:17.160782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:17.160782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:17.160782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:17.160782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:17.160782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:17.160782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:17.160782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:17.160782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:17.160782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:37:17.160782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:37:17.160782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 10:37:17.160782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:17.162554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 527/1061] 10.222.0.43 () {56 vars in 1105 bytes} [Wed Jul 27 10:37:16 2022] GET /identity/v3/services/image => generated 86 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:17.166932 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49fd1d-baa2-4af0-890e-474cac6d5332 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:17.280885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49fd1d-baa2-4af0-890e-474cac6d5332 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:17.320419 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8beeb3a-7d83-4845-b994-46f5ebaeb97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:17.321048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8beeb3a-7d83-4845-b994-46f5ebaeb97e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:17.321325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8beeb3a-7d83-4845-b994-46f5ebaeb97e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:17.321598 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8beeb3a-7d83-4845-b994-46f5ebaeb97e None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:17.322333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8beeb3a-7d83-4845-b994-46f5ebaeb97e None admin] RBAC: Adding query filter params (name=image) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:17.322649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8beeb3a-7d83-4845-b994-46f5ebaeb97e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:17.325586 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8beeb3a-7d83-4845-b994-46f5ebaeb97e None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:17.332112 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 535/1062] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:17.337826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb9e5-b043-4d46-a2df-39a3f060cca6 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:17.369628 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:17.454228 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb9e5-b043-4d46-a2df-39a3f060cca6 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:17.490729 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20be85-7182-4a30-9f00-44515fdf5687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:17.491358 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20be85-7182-4a30-9f00-44515fdf5687 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:17.491638 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20be85-7182-4a30-9f00-44515fdf5687 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:17.491908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20be85-7182-4a30-9f00-44515fdf5687 None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:17.492592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20be85-7182-4a30-9f00-44515fdf5687 None admin] RBAC: Adding query filter params (type=image) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:17.492898 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20be85-7182-4a30-9f00-44515fdf5687 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:17.494284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20be85-7182-4a30-9f00-44515fdf5687 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:17.504771 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 528/1063] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:17.504960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c64672-031a-4d5b-bff5-dccb69f85fa3 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:17.504960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c64672-031a-4d5b-bff5-dccb69f85fa3 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:17.504960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c64672-031a-4d5b-bff5-dccb69f85fa3 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:17.504960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 536/1064] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:17.506588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20be85-7182-4a30-9f00-44515fdf5687 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:17.509177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ff712-c0fe-414f-818f-be238e65ace7 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:17.509493 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ff712-c0fe-414f-818f-be238e65ace7 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:17.509765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ff712-c0fe-414f-818f-be238e65ace7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:17.533312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:17.540803 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-164ff712-c0fe-414f-818f-be238e65ace7 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:17.543223 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-164ff712-c0fe-414f-818f-be238e65ace7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:17.622017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:17.623889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 537/1065] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:37:17.638554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20be85-7182-4a30-9f00-44515fdf5687 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:17.647348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ff712-c0fe-414f-818f-be238e65ace7 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:17.676414 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b6e8f-0263-433e-b37b-87cf25f4daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:17.677185 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b6e8f-0263-433e-b37b-87cf25f4daf6 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:17.677474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b6e8f-0263-433e-b37b-87cf25f4daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:17.677749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b6e8f-0263-433e-b37b-87cf25f4daf6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:17.678498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b6e8f-0263-433e-b37b-87cf25f4daf6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:17.679871 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b6e8f-0263-433e-b37b-87cf25f4daf6 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:17.714224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 529/1066] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:37:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:37:17.769523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ff712-c0fe-414f-818f-be238e65ace7 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:17.809619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:17.816553 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d151d-9eed-4d10-859c-853177aae747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:17.817215 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d151d-9eed-4d10-859c-853177aae747 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:17.817496 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d151d-9eed-4d10-859c-853177aae747 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:17.817767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d151d-9eed-4d10-859c-853177aae747 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:17.830114 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d151d-9eed-4d10-859c-853177aae747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-7a3d151d-9eed-4d10-859c-853177aae747 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:37:17.835211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:17.836218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:17.837096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:17.837096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:17.837096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:17.837096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:17.837096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:37:17.837096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:37:17.837096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:37:17.837096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:37:17.837096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:37:17.837096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:37:17.837096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:37:17.837096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:17.837096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 538/1067] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:37:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:37:17.844485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b6e8f-0263-433e-b37b-87cf25f4daf6 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:17.960586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b6e8f-0263-433e-b37b-87cf25f4daf6 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:17.997296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ccfde-29b0-4b99-98cb-6fd813b5a51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:17.997980 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ccfde-29b0-4b99-98cb-6fd813b5a51a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:17.998291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ccfde-29b0-4b99-98cb-6fd813b5a51a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:17.998573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ccfde-29b0-4b99-98cb-6fd813b5a51a None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:17.999319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ccfde-29b0-4b99-98cb-6fd813b5a51a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:17.999626 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ccfde-29b0-4b99-98cb-6fd813b5a51a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:18.001000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ccfde-29b0-4b99-98cb-6fd813b5a51a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:18.010549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 530/1068] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:37:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:18.017037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d151d-9eed-4d10-859c-853177aae747 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:18.124626 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d151d-9eed-4d10-859c-853177aae747 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:18.159713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1d910-145f-466c-876a-f5f7d1b070ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:18.160360 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1d910-145f-466c-876a-f5f7d1b070ec None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:18.160634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1d910-145f-466c-876a-f5f7d1b070ec None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:18.160907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1d910-145f-466c-876a-f5f7d1b070ec None admin] PATH_INFO: `/v3/users/75afc104580648b88064c9df68325e19` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:18.176009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1d910-145f-466c-876a-f5f7d1b070ec None admin] RBAC: Authorizing `identity:get_user(user_id=75afc104580648b88064c9df68325e19)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:18.177557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1d910-145f-466c-876a-f5f7d1b070ec None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:18.184701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 539/1069] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:37:18 2022] GET /identity/v3/users/75afc104580648b88064c9df68325e19 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:18.185929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ccfde-29b0-4b99-98cb-6fd813b5a51a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:18.197516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:18.294737 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ccfde-29b0-4b99-98cb-6fd813b5a51a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:18.332760 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cdb4b-8950-475b-8331-748b3c567eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:18.333302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cdb4b-8950-475b-8331-748b3c567eb3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:18.333586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cdb4b-8950-475b-8331-748b3c567eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:18.333864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cdb4b-8950-475b-8331-748b3c567eb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:18.405247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cdb4b-8950-475b-8331-748b3c567eb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:18.406831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cdb4b-8950-475b-8331-748b3c567eb3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:18.417431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:18.528394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 531/1070] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:37:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:37:18.529754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1d910-145f-466c-876a-f5f7d1b070ec None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:18.568100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b641a0-f5f5-4dfc-99dc-2df4769f5f7f None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:18.568402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b641a0-f5f5-4dfc-99dc-2df4769f5f7f None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:18.568639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b641a0-f5f5-4dfc-99dc-2df4769f5f7f None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:18.570284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 532/1071] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:37:18.576194 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c0fc6-fdd6-489b-8515-0921ed2b92f2 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:18.576496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c0fc6-fdd6-489b-8515-0921ed2b92f2 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:18.576800 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c0fc6-fdd6-489b-8515-0921ed2b92f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:18.587581 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:18.596453 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-0a4c0fc6-fdd6-489b-8515-0921ed2b92f2 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:18.597821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0a4c0fc6-fdd6-489b-8515-0921ed2b92f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:18.645004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1d910-145f-466c-876a-f5f7d1b070ec None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:18.677460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 533/1072] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:37:18.681356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05418b6-21c8-41c8-af63-c88e3ecfd24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:18.682371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05418b6-21c8-41c8-af63-c88e3ecfd24d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:18.682684 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05418b6-21c8-41c8-af63-c88e3ecfd24d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:18.682984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05418b6-21c8-41c8-af63-c88e3ecfd24d None admin] PATH_INFO: `/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:18.685134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05418b6-21c8-41c8-af63-c88e3ecfd24d None admin] RBAC: Authorizing `identity:get_project(project_id=59f6ec987f1442d7a3e90cb8c14f6ded)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:18.686784 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05418b6-21c8-41c8-af63-c88e3ecfd24d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:18.693517 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 540/1073] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:37:18 2022] GET /identity/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:18.694722 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c0fc6-fdd6-489b-8515-0921ed2b92f2 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:18.702534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05418b6-21c8-41c8-af63-c88e3ecfd24d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:18.740126 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:18.817361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c0fc6-fdd6-489b-8515-0921ed2b92f2 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:18.817604 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05418b6-21c8-41c8-af63-c88e3ecfd24d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:18.841029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:18.859830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfc212-6d5c-46d2-a1b2-0e8e9fd26313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:18.860459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfc212-6d5c-46d2-a1b2-0e8e9fd26313 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:18.860748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfc212-6d5c-46d2-a1b2-0e8e9fd26313 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:18.861115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfc212-6d5c-46d2-a1b2-0e8e9fd26313 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:18.861810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfc212-6d5c-46d2-a1b2-0e8e9fd26313 None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=59f6ec987f1442d7a3e90cb8c14f6ded, user.id=75afc104580648b88064c9df68325e19) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:18.862121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfc212-6d5c-46d2-a1b2-0e8e9fd26313 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:18.862386 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0c3bb-4056-411d-8286-181eee21815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:18.863038 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0c3bb-4056-411d-8286-181eee21815b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:18.863320 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0c3bb-4056-411d-8286-181eee21815b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:18.863568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfc212-6d5c-46d2-a1b2-0e8e9fd26313 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:18.863678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0c3bb-4056-411d-8286-181eee21815b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:18.883534 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 534/1074] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:37:18 2022] GET /identity/v3/role_assignments?user.id=75afc104580648b88064c9df68325e19&scope.project.id=59f6ec987f1442d7a3e90cb8c14f6ded&role.id=36208a24005e4ff98d827138292bea37 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:18.883777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0c3bb-4056-411d-8286-181eee21815b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:37:18.883777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-58d0c3bb-4056-411d-8286-181eee21815b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 10:37:18.883777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:18.883777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:18.883777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:18.883777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:18.883777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:18.883777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:18.883777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:18.883777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:18.883777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:18.883777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:18.883777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:18.884937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:18.886147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 541/1075] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Jul 27 10:37:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:37:18.889675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfc212-6d5c-46d2-a1b2-0e8e9fd26313 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:19.011050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfc212-6d5c-46d2-a1b2-0e8e9fd26313 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:19.013086 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:19.053779 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606be1f-3f54-4139-b721-76983065f85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:19.054435 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606be1f-3f54-4139-b721-76983065f85f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:19.054723 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606be1f-3f54-4139-b721-76983065f85f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:19.055004 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606be1f-3f54-4139-b721-76983065f85f None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:19.055737 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606be1f-3f54-4139-b721-76983065f85f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:19.056055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606be1f-3f54-4139-b721-76983065f85f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:19.057693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606be1f-3f54-4139-b721-76983065f85f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:19.067387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 535/1076] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Jul 27 10:37:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:19.073048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0c3bb-4056-411d-8286-181eee21815b None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:19.176909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0c3bb-4056-411d-8286-181eee21815b None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:19.211592 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab0e5b-a96c-4ca6-85c8-ee3e1933ec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:19.212233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab0e5b-a96c-4ca6-85c8-ee3e1933ec2d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:19.212518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab0e5b-a96c-4ca6-85c8-ee3e1933ec2d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:19.212796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab0e5b-a96c-4ca6-85c8-ee3e1933ec2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:19.224786 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab0e5b-a96c-4ca6-85c8-ee3e1933ec2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:19.226277 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab0e5b-a96c-4ca6-85c8-ee3e1933ec2d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-76ab0e5b-a96c-4ca6-85c8-ee3e1933ec2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:37:19.241975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:19.243062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:19.244014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:37:19.244014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:37:19.244014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:19.244014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:19.246552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 542/1077] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:19.249955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606be1f-3f54-4139-b721-76983065f85f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:19.358075 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606be1f-3f54-4139-b721-76983065f85f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:19.393436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929536c-c7bc-450a-a5e4-66cae3ad2cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:19.394065 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929536c-c7bc-450a-a5e4-66cae3ad2cfe None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:19.394381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929536c-c7bc-450a-a5e4-66cae3ad2cfe None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:19.394659 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929536c-c7bc-450a-a5e4-66cae3ad2cfe None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:19.395362 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929536c-c7bc-450a-a5e4-66cae3ad2cfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:19.395667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929536c-c7bc-450a-a5e4-66cae3ad2cfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:19.397037 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929536c-c7bc-450a-a5e4-66cae3ad2cfe None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:19.410179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 536/1078] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:19.415760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab0e5b-a96c-4ca6-85c8-ee3e1933ec2d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:19.450588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:19.523201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab0e5b-a96c-4ca6-85c8-ee3e1933ec2d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:19.559078 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026de34f-c332-4c53-bc32-358d5d6a9fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:19.559742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026de34f-c332-4c53-bc32-358d5d6a9fa6 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:19.560023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026de34f-c332-4c53-bc32-358d5d6a9fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:19.560297 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026de34f-c332-4c53-bc32-358d5d6a9fa6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:19.568573 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026de34f-c332-4c53-bc32-358d5d6a9fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:19.570018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026de34f-c332-4c53-bc32-358d5d6a9fa6 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-026de34f-c332-4c53-bc32-358d5d6a9fa6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:37:19.582142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:19.583124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:19.584072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:19.584072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:19.584072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:37:19.584072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:37:19.584072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:37:19.584072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:37:19.584072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:37:19.584072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:37:19.584072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 10:37:19.584072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:19.586527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 543/1079] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jul 27 10:37:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:19.589302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929536c-c7bc-450a-a5e4-66cae3ad2cfe None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:19.622849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:19.702624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929536c-c7bc-450a-a5e4-66cae3ad2cfe None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:19.737109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95359d2f-139f-41e4-981c-d13aa740d4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:19.737730 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95359d2f-139f-41e4-981c-d13aa740d4c6 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:19.738015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95359d2f-139f-41e4-981c-d13aa740d4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:19.738596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95359d2f-139f-41e4-981c-d13aa740d4c6 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:19.739155 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95359d2f-139f-41e4-981c-d13aa740d4c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:19.739465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95359d2f-139f-41e4-981c-d13aa740d4c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:19.740892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95359d2f-139f-41e4-981c-d13aa740d4c6 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:19.764673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 537/1080] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jul 27 10:37:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:19.766120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026de34f-c332-4c53-bc32-358d5d6a9fa6 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:19.795384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05697eaa-dae0-4911-a33e-c0b449efc948 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:19.795672 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05697eaa-dae0-4911-a33e-c0b449efc948 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:19.795950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05697eaa-dae0-4911-a33e-c0b449efc948 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:19.797439 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 538/1081] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:37:19.802052 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68183458-deb4-4751-b150-4b4b751dd414 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:19.802385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68183458-deb4-4751-b150-4b4b751dd414 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:19.802671 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68183458-deb4-4751-b150-4b4b751dd414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:19.821185 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-68183458-deb4-4751-b150-4b4b751dd414 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:19.822420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-68183458-deb4-4751-b150-4b4b751dd414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:19.865036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:19.881441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026de34f-c332-4c53-bc32-358d5d6a9fa6 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:19.905201 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 539/1082] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:37:19.920584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5b8bb-596b-4b3d-a335-65f1811b5bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:19.921431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b8bb-596b-4b3d-a335-65f1811b5bff None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:19.921865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b8bb-596b-4b3d-a335-65f1811b5bff None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:19.922351 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b8bb-596b-4b3d-a335-65f1811b5bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:19.927504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68183458-deb4-4751-b150-4b4b751dd414 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:19.942761 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:20.001154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5b8bb-596b-4b3d-a335-65f1811b5bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:20.002548 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5b8bb-596b-4b3d-a335-65f1811b5bff None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:20.036771 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68183458-deb4-4751-b150-4b4b751dd414 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:20.072918 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87da46-184b-48b6-bda4-5d631d94ff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:20.073545 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87da46-184b-48b6-bda4-5d631d94ff5a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:20.073942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87da46-184b-48b6-bda4-5d631d94ff5a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:20.074912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87da46-184b-48b6-bda4-5d631d94ff5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:20.104182 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:20.117430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 544/1083] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:37:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:37:20.123667 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5b8bb-596b-4b3d-a335-65f1811b5bff None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:20.149595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87da46-184b-48b6-bda4-5d631d94ff5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:20.151190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87da46-184b-48b6-bda4-5d631d94ff5a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:20.165791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:20.233378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5b8bb-596b-4b3d-a335-65f1811b5bff None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:20.264982 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 540/1084] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:37:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 10:37:20.270508 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87da46-184b-48b6-bda4-5d631d94ff5a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:20.271040 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f5843-affd-4d7a-8230-588668e73409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:20.271687 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f5843-affd-4d7a-8230-588668e73409 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:20.271971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f5843-affd-4d7a-8230-588668e73409 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:20.272267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f5843-affd-4d7a-8230-588668e73409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:20.287052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f5843-affd-4d7a-8230-588668e73409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:20.288542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f5843-affd-4d7a-8230-588668e73409 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-398f5843-affd-4d7a-8230-588668e73409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:37:20.304685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:20.305833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:20.307707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:37:20.307707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:37:20.307707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:20.307707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:20.307707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 545/1085] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:37:20.312779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f5843-affd-4d7a-8230-588668e73409 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:20.359110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:20.393398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87da46-184b-48b6-bda4-5d631d94ff5a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:20.411139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:20.423136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f5843-affd-4d7a-8230-588668e73409 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:20.437277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db427d6-4b17-4aea-b90a-8b113fd84359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:20.437930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db427d6-4b17-4aea-b90a-8b113fd84359 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:20.438265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db427d6-4b17-4aea-b90a-8b113fd84359 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:20.438676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db427d6-4b17-4aea-b90a-8b113fd84359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:20.449965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db427d6-4b17-4aea-b90a-8b113fd84359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:20.451451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db427d6-4b17-4aea-b90a-8b113fd84359 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:20.460768 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a3f54-73fb-45ed-b77a-5cc19ad9791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:20.461492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a3f54-73fb-45ed-b77a-5cc19ad9791e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:20.461694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a3f54-73fb-45ed-b77a-5cc19ad9791e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:20.461968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a3f54-73fb-45ed-b77a-5cc19ad9791e None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:20.462636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a3f54-73fb-45ed-b77a-5cc19ad9791e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:20.462940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a3f54-73fb-45ed-b77a-5cc19ad9791e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:20.464287 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a3f54-73fb-45ed-b77a-5cc19ad9791e None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-7db427d6-4b17-4aea-b90a-8b113fd84359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:37:20.467499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:20.469119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:20.470625 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:37:20.470625 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:37:20.470625 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:37:20.470625 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:20.473907 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 541/1086] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:37:20.474877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db427d6-4b17-4aea-b90a-8b113fd84359 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:20.477388 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 546/1087] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:20.483387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a3f54-73fb-45ed-b77a-5cc19ad9791e None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:20.586845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db427d6-4b17-4aea-b90a-8b113fd84359 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:20.591459 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a3f54-73fb-45ed-b77a-5cc19ad9791e None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:20.593093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:20.628063 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da492558-1e73-4e9b-a10e-d138cfb0743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:20.628693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da492558-1e73-4e9b-a10e-d138cfb0743f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:20.628978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da492558-1e73-4e9b-a10e-d138cfb0743f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:20.629465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da492558-1e73-4e9b-a10e-d138cfb0743f None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:20.629955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da492558-1e73-4e9b-a10e-d138cfb0743f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:20.631864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da492558-1e73-4e9b-a10e-d138cfb0743f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:20.631864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da492558-1e73-4e9b-a10e-d138cfb0743f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:20.638032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e3afd-1c51-4ca7-862c-4d3826b414c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:20.638724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e3afd-1c51-4ca7-862c-4d3826b414c9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:20.639005 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e3afd-1c51-4ca7-862c-4d3826b414c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:20.639324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e3afd-1c51-4ca7-862c-4d3826b414c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:20.646385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 542/1088] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:20.651851 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e3afd-1c51-4ca7-862c-4d3826b414c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:20.653436 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e3afd-1c51-4ca7-862c-4d3826b414c9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-b01e3afd-1c51-4ca7-862c-4d3826b414c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:37:20.666865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:20.667973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:20.668984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:37:20.668984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:37:20.668984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:37:20.668984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:37:20.668984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:37:20.668984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:37:20.668984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:37:20.668984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:20.670248 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 547/1089] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:37:20.674386 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da492558-1e73-4e9b-a10e-d138cfb0743f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:20.705469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:20.792140 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da492558-1e73-4e9b-a10e-d138cfb0743f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:20.831976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd88069-c196-4615-923e-b503bae9a96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:20.832606 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd88069-c196-4615-923e-b503bae9a96e None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:20.832886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd88069-c196-4615-923e-b503bae9a96e None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:20.833161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd88069-c196-4615-923e-b503bae9a96e None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:20.833926 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd88069-c196-4615-923e-b503bae9a96e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:20.834264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd88069-c196-4615-923e-b503bae9a96e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:20.835696 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd88069-c196-4615-923e-b503bae9a96e None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:20.848968 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 543/1090] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:20.855522 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e3afd-1c51-4ca7-862c-4d3826b414c9 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:20.910297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f3789-2867-4d9e-a2aa-dcf40857c28f None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:20.910593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f3789-2867-4d9e-a2aa-dcf40857c28f None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:20.910827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f3789-2867-4d9e-a2aa-dcf40857c28f None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:20.912350 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 544/1091] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:37:20.917348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdaff6-aa28-46e8-894a-eca847a69312 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:20.917825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdaff6-aa28-46e8-894a-eca847a69312 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:20.918239 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdaff6-aa28-46e8-894a-eca847a69312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:20.937985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-0abdaff6-aa28-46e8-894a-eca847a69312 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:20.939515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0abdaff6-aa28-46e8-894a-eca847a69312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:20.973560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e3afd-1c51-4ca7-862c-4d3826b414c9 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:21.007257 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049776f5-9bbc-4b62-a4f6-2352fabe275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:21.007883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049776f5-9bbc-4b62-a4f6-2352fabe275a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:21.008162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049776f5-9bbc-4b62-a4f6-2352fabe275a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:21.008433 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049776f5-9bbc-4b62-a4f6-2352fabe275a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:21.009218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049776f5-9bbc-4b62-a4f6-2352fabe275a None admin] RBAC: Adding query filter params (role.id=569a224091254f49a695cfe9bad598c8, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=3bb16c9232464cc2aeee12b7fa918b8e) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:21.009527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049776f5-9bbc-4b62-a4f6-2352fabe275a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:21.010984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049776f5-9bbc-4b62-a4f6-2352fabe275a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:21.011104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 545/1092] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:21.023234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 548/1093] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:37:20 2022] GET /identity/v3/role_assignments?user.id=3bb16c9232464cc2aeee12b7fa918b8e&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=569a224091254f49a695cfe9bad598c8 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:21.035122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdaff6-aa28-46e8-894a-eca847a69312 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:21.051270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:21.144895 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdaff6-aa28-46e8-894a-eca847a69312 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:21.182426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e9098-29a8-4d05-8be2-78c87f5d2fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:21.183066 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e9098-29a8-4d05-8be2-78c87f5d2fdd None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:21.184072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e9098-29a8-4d05-8be2-78c87f5d2fdd None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:21.184356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e9098-29a8-4d05-8be2-78c87f5d2fdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:21.195288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e9098-29a8-4d05-8be2-78c87f5d2fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-6f5e9098-29a8-4d05-8be2-78c87f5d2fdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:37:21.200806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:21.201849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:21.202818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:21.202818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:21.202818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:21.202818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:21.202818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:37:21.202818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:37:21.202818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:37:21.202818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:37:21.202818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:37:21.202818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:37:21.202818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:37:21.202818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:21.202818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 546/1094] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:37:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:21.209249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049776f5-9bbc-4b62-a4f6-2352fabe275a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:21.239256 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:21.316591 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049776f5-9bbc-4b62-a4f6-2352fabe275a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:21.352704 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a89671-62fd-433a-a6fb-5661707a6188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:21.353328 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89671-62fd-433a-a6fb-5661707a6188 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:21.353610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89671-62fd-433a-a6fb-5661707a6188 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:21.353888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89671-62fd-433a-a6fb-5661707a6188 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:21.354643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a89671-62fd-433a-a6fb-5661707a6188 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:21.354950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a89671-62fd-433a-a6fb-5661707a6188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:21.356486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a89671-62fd-433a-a6fb-5661707a6188 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:21.365663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 549/1095] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:37:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:21.373006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e9098-29a8-4d05-8be2-78c87f5d2fdd None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:21.451126 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:21.477518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e9098-29a8-4d05-8be2-78c87f5d2fdd None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:21.514237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d98ed-0314-47fe-80e7-6c6be2723698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:21.514890 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d98ed-0314-47fe-80e7-6c6be2723698 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:21.515173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d98ed-0314-47fe-80e7-6c6be2723698 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:21.515449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d98ed-0314-47fe-80e7-6c6be2723698 None admin] PATH_INFO: `/v3/users/75afc104580648b88064c9df68325e19` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:21.516660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d98ed-0314-47fe-80e7-6c6be2723698 None admin] RBAC: Authorizing `identity:get_user(user_id=75afc104580648b88064c9df68325e19)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:21.518112 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d98ed-0314-47fe-80e7-6c6be2723698 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:21.519792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 547/1096] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:37:21 2022] GET /identity/v3/users/75afc104580648b88064c9df68325e19 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:37:21.525686 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a89671-62fd-433a-a6fb-5661707a6188 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:21.619612 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:21.633822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a89671-62fd-433a-a6fb-5661707a6188 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:21.668928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17fb35-5238-4f4f-a663-cd0a8161ba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:21.669607 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17fb35-5238-4f4f-a663-cd0a8161ba9a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:21.669892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17fb35-5238-4f4f-a663-cd0a8161ba9a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:21.670171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17fb35-5238-4f4f-a663-cd0a8161ba9a None admin] PATH_INFO: `/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:21.671380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17fb35-5238-4f4f-a663-cd0a8161ba9a None admin] RBAC: Authorizing `identity:get_project(project_id=59f6ec987f1442d7a3e90cb8c14f6ded)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:21.672808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17fb35-5238-4f4f-a663-cd0a8161ba9a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:21.674519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 550/1097] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:37:21 2022] GET /identity/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:21.680768 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d98ed-0314-47fe-80e7-6c6be2723698 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:21.790467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d98ed-0314-47fe-80e7-6c6be2723698 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:21.827756 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659b792-067f-42e0-8dbb-8903e7c85378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:21.828464 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b792-067f-42e0-8dbb-8903e7c85378 None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:21.828750 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b792-067f-42e0-8dbb-8903e7c85378 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:21.829032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b792-067f-42e0-8dbb-8903e7c85378 None admin] PATH_INFO: `/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded/users/75afc104580648b88064c9df68325e19/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:21.831029 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659b792-067f-42e0-8dbb-8903e7c85378 None admin] RBAC: Authorizing `identity:create_grant(project_id=59f6ec987f1442d7a3e90cb8c14f6ded, user_id=75afc104580648b88064c9df68325e19, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:21.832464 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659b792-067f-42e0-8dbb-8903e7c85378 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:21.846752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 548/1098] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:37:21 2022] PUT /identity/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded/users/75afc104580648b88064c9df68325e19/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:37:23.845093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a2bb2-2fe1-4f04-b9e5-46c801ae1983 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:23.845666 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a2bb2-2fe1-4f04-b9e5-46c801ae1983 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:23.845666 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a2bb2-2fe1-4f04-b9e5-46c801ae1983 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:23.847047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 551/1099] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:37:23.852263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2e184-7723-4a11-af39-e812164ee1c2 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:23.852710 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2e184-7723-4a11-af39-e812164ee1c2 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:23.852812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2e184-7723-4a11-af39-e812164ee1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:23.859874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:23.873880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-a2d2e184-7723-4a11-af39-e812164ee1c2 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:23.875132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a2d2e184-7723-4a11-af39-e812164ee1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:23.952332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 549/1100] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:23.975197 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a2bb2-2fe1-4f04-b9e5-46c801ae1983 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:24.077351 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a2bb2-2fe1-4f04-b9e5-46c801ae1983 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:24.111989 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff6c96-a6f2-43f4-8dd6-9017b10fa02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:24.112562 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff6c96-a6f2-43f4-8dd6-9017b10fa02e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:24.112844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff6c96-a6f2-43f4-8dd6-9017b10fa02e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:24.113120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff6c96-a6f2-43f4-8dd6-9017b10fa02e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:24.123339 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff6c96-a6f2-43f4-8dd6-9017b10fa02e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-76ff6c96-a6f2-43f4-8dd6-9017b10fa02e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:37:24.128201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:24.129294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:24.130407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:24.130407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:24.130407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:24.130407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:24.130407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:37:24.130407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:37:24.130407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:37:24.130407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:37:24.130407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:37:24.130407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:37:24.130407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:37:24.130407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:24.130407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 552/1101] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:37:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:24.135468 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2e184-7723-4a11-af39-e812164ee1c2 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:24.235705 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2e184-7723-4a11-af39-e812164ee1c2 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:24.264200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:24.269525 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5616c-a1e5-4252-8871-5d772ecb93bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:24.270151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5616c-a1e5-4252-8871-5d772ecb93bb None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:24.270470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5616c-a1e5-4252-8871-5d772ecb93bb None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:24.270745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5616c-a1e5-4252-8871-5d772ecb93bb None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:24.271470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5616c-a1e5-4252-8871-5d772ecb93bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:24.271779 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5616c-a1e5-4252-8871-5d772ecb93bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:24.273144 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5616c-a1e5-4252-8871-5d772ecb93bb None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:24.282069 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 550/1102] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:24.287872 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff6c96-a6f2-43f4-8dd6-9017b10fa02e None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:24.307463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:24.388684 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff6c96-a6f2-43f4-8dd6-9017b10fa02e None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:24.425038 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276ce30-06ed-4fe7-aa2d-f7ca57e79177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:24.425684 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276ce30-06ed-4fe7-aa2d-f7ca57e79177 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:24.426010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276ce30-06ed-4fe7-aa2d-f7ca57e79177 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:24.426317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276ce30-06ed-4fe7-aa2d-f7ca57e79177 None admin] PATH_INFO: `/v3/users/75afc104580648b88064c9df68325e19` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:24.427496 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276ce30-06ed-4fe7-aa2d-f7ca57e79177 None admin] RBAC: Authorizing `identity:get_user(user_id=75afc104580648b88064c9df68325e19)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:24.428931 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276ce30-06ed-4fe7-aa2d-f7ca57e79177 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:24.430570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 553/1103] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:37:24 2022] GET /identity/v3/users/75afc104580648b88064c9df68325e19 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:24.436686 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5616c-a1e5-4252-8871-5d772ecb93bb None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:24.542678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5616c-a1e5-4252-8871-5d772ecb93bb None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:24.599170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966f962-3179-4a72-9f91-f3ddaf902c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:24.599967 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966f962-3179-4a72-9f91-f3ddaf902c08 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:24.600272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966f962-3179-4a72-9f91-f3ddaf902c08 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:24.600619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966f962-3179-4a72-9f91-f3ddaf902c08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:24.691384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:24.700666 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966f962-3179-4a72-9f91-f3ddaf902c08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:24.702128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966f962-3179-4a72-9f91-f3ddaf902c08 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:24.801162 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 551/1104] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:37:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:37:24.807320 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276ce30-06ed-4fe7-aa2d-f7ca57e79177 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:24.894418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:24.911129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276ce30-06ed-4fe7-aa2d-f7ca57e79177 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:24.946268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55f441-92fa-4c65-b232-e686ef3cd8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:24.946843 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f441-92fa-4c65-b232-e686ef3cd8cc None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:24.947171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f441-92fa-4c65-b232-e686ef3cd8cc None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:24.947452 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f441-92fa-4c65-b232-e686ef3cd8cc None admin] PATH_INFO: `/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:24.949461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55f441-92fa-4c65-b232-e686ef3cd8cc None admin] RBAC: Authorizing `identity:get_project(project_id=59f6ec987f1442d7a3e90cb8c14f6ded)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:24.950937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55f441-92fa-4c65-b232-e686ef3cd8cc None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:24.952616 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 554/1105] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:37:24 2022] GET /identity/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:24.958965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966f962-3179-4a72-9f91-f3ddaf902c08 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:25.050951 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:25.059020 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966f962-3179-4a72-9f91-f3ddaf902c08 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:25.096335 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad718728-4207-447d-8c62-061691b3a5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:25.096971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad718728-4207-447d-8c62-061691b3a5fc None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:25.097214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad718728-4207-447d-8c62-061691b3a5fc None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:25.097489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad718728-4207-447d-8c62-061691b3a5fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:25.098391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad718728-4207-447d-8c62-061691b3a5fc None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=59f6ec987f1442d7a3e90cb8c14f6ded, user.id=75afc104580648b88064c9df68325e19) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:25.098707 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad718728-4207-447d-8c62-061691b3a5fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:25.100141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad718728-4207-447d-8c62-061691b3a5fc None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:25.106304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 552/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:37:24 2022] GET /identity/v3/role_assignments?user.id=75afc104580648b88064c9df68325e19&scope.project.id=59f6ec987f1442d7a3e90cb8c14f6ded&role.id=36208a24005e4ff98d827138292bea37 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:27.123126 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e4bd4-9e0f-4367-ac9b-680b8cce7939 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:27.123647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e4bd4-9e0f-4367-ac9b-680b8cce7939 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:27.123647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e4bd4-9e0f-4367-ac9b-680b8cce7939 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:27.124906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 555/1107] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:27.130118 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bcd8a-cd5d-4b63-99e0-190c83181bfd None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:27.130590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bcd8a-cd5d-4b63-99e0-190c83181bfd None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:27.130696 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bcd8a-cd5d-4b63-99e0-190c83181bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:27.149985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-a51bcd8a-cd5d-4b63-99e0-190c83181bfd None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:27.151224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a51bcd8a-cd5d-4b63-99e0-190c83181bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:27.218298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 553/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:27.241990 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e4bd4-9e0f-4367-ac9b-680b8cce7939 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:27.343779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e4bd4-9e0f-4367-ac9b-680b8cce7939 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:27.377811 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123c82f-82f1-459c-8127-287b7be3f603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:27.378413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123c82f-82f1-459c-8127-287b7be3f603 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:27.378693 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123c82f-82f1-459c-8127-287b7be3f603 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:27.378968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123c82f-82f1-459c-8127-287b7be3f603 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:27.380120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123c82f-82f1-459c-8127-287b7be3f603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:27.381542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123c82f-82f1-459c-8127-287b7be3f603 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:27.383149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 556/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:27.389528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bcd8a-cd5d-4b63-99e0-190c83181bfd None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:27.484743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:27.497220 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bcd8a-cd5d-4b63-99e0-190c83181bfd None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:27.529921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63036bf-b137-4c68-89ce-588806b4008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:27.530546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63036bf-b137-4c68-89ce-588806b4008c None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:27.530825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63036bf-b137-4c68-89ce-588806b4008c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:27.531095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63036bf-b137-4c68-89ce-588806b4008c None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:27.531781 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63036bf-b137-4c68-89ce-588806b4008c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:27.533193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63036bf-b137-4c68-89ce-588806b4008c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:27.554443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 554/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:37:27 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:37:29.600477 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9f2c-06c5-4cc9-a45c-1204f77eb69a None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:29.601017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9f2c-06c5-4cc9-a45c-1204f77eb69a None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:29.601017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc9f2c-06c5-4cc9-a45c-1204f77eb69a None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:29.602411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 557/1111] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:29.608259 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96edc78-0e0c-4e99-84b9-0aaa0b49868a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:29.608693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96edc78-0e0c-4e99-84b9-0aaa0b49868a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:29.608813 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96edc78-0e0c-4e99-84b9-0aaa0b49868a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:29.627164 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e96edc78-0e0c-4e99-84b9-0aaa0b49868a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:29.628367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e96edc78-0e0c-4e99-84b9-0aaa0b49868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:29.695586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 555/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:29.719057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc9f2c-06c5-4cc9-a45c-1204f77eb69a None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:29.740873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:29.820647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc9f2c-06c5-4cc9-a45c-1204f77eb69a None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:29.854760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fa2ac-a059-423c-ae8a-81121f8177e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:29.855326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fa2ac-a059-423c-ae8a-81121f8177e9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:29.855608 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fa2ac-a059-423c-ae8a-81121f8177e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:29.855926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fa2ac-a059-423c-ae8a-81121f8177e9 None admin] PATH_INFO: `/v3/roles/fcaec44122534716b69d5e7f05160915` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:29.857326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fa2ac-a059-423c-ae8a-81121f8177e9 None admin] RBAC: Authorizing `identity:get_role(role_id=fcaec44122534716b69d5e7f05160915)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:29.858731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fa2ac-a059-423c-ae8a-81121f8177e9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:29.860076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 558/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:37:29 2022] GET /identity/v3/roles/fcaec44122534716b69d5e7f05160915 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:29.866087 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96edc78-0e0c-4e99-84b9-0aaa0b49868a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:29.940639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:29.967163 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96edc78-0e0c-4e99-84b9-0aaa0b49868a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:30.000130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5bb60-d807-424f-be11-916e6c222d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:30.000762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5bb60-d807-424f-be11-916e6c222d5c None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:30.001044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5bb60-d807-424f-be11-916e6c222d5c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:30.001318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5bb60-d807-424f-be11-916e6c222d5c None admin] PATH_INFO: `/v3/users/3460452ef7964489851455c0912ee83f` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:30.014756 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5bb60-d807-424f-be11-916e6c222d5c None admin] RBAC: Authorizing `identity:get_user(user_id=3460452ef7964489851455c0912ee83f)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:30.016194 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5bb60-d807-424f-be11-916e6c222d5c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:30.017832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 556/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:37:29 2022] GET /identity/v3/users/3460452ef7964489851455c0912ee83f => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:30.023810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fa2ac-a059-423c-ae8a-81121f8177e9 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:30.112381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:30.125243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fa2ac-a059-423c-ae8a-81121f8177e9 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:30.158909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bd3d3-2212-47e3-8e81-5f2d8b630a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:30.159520 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bd3d3-2212-47e3-8e81-5f2d8b630a59 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:30.159805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bd3d3-2212-47e3-8e81-5f2d8b630a59 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:30.160081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bd3d3-2212-47e3-8e81-5f2d8b630a59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:30.226424 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bd3d3-2212-47e3-8e81-5f2d8b630a59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:30.227873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bd3d3-2212-47e3-8e81-5f2d8b630a59 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:30.316723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:30.330566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 559/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:37:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:37:30.336521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5bb60-d807-424f-be11-916e6c222d5c None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:30.437812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5bb60-d807-424f-be11-916e6c222d5c None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:30.467071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:30.472554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dc9aa-18e1-451c-995c-d8ca6caaf3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:30.473201 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dc9aa-18e1-451c-995c-d8ca6caaf3e9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:30.473485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dc9aa-18e1-451c-995c-d8ca6caaf3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:30.473763 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dc9aa-18e1-451c-995c-d8ca6caaf3e9 None admin] PATH_INFO: `/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:30.474947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dc9aa-18e1-451c-995c-d8ca6caaf3e9 None admin] RBAC: Authorizing `identity:get_project(project_id=59f6ec987f1442d7a3e90cb8c14f6ded)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:30.476394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dc9aa-18e1-451c-995c-d8ca6caaf3e9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:30.478079 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 557/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:37:30 2022] GET /identity/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:30.484929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bd3d3-2212-47e3-8e81-5f2d8b630a59 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:30.581996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bd3d3-2212-47e3-8e81-5f2d8b630a59 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:30.615092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cb9cc-08ec-4e5b-9d6f-53eb552915e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:30.615730 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cb9cc-08ec-4e5b-9d6f-53eb552915e8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:30.615972 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cb9cc-08ec-4e5b-9d6f-53eb552915e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:30.616250 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cb9cc-08ec-4e5b-9d6f-53eb552915e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:30.617032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cb9cc-08ec-4e5b-9d6f-53eb552915e8 None admin] RBAC: Adding query filter params (role.id=fcaec44122534716b69d5e7f05160915, scope.project.id=59f6ec987f1442d7a3e90cb8c14f6ded, user.id=3460452ef7964489851455c0912ee83f) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:30.617343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cb9cc-08ec-4e5b-9d6f-53eb552915e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:30.618806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cb9cc-08ec-4e5b-9d6f-53eb552915e8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:30.624949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 560/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:37:30 2022] GET /identity/v3/role_assignments?user.id=3460452ef7964489851455c0912ee83f&scope.project.id=59f6ec987f1442d7a3e90cb8c14f6ded&role.id=fcaec44122534716b69d5e7f05160915 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:32.597750 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd191-06ce-4ecd-a7b9-d2d9f8ab38fb None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:32.598337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd191-06ce-4ecd-a7b9-d2d9f8ab38fb None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:32.598429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd191-06ce-4ecd-a7b9-d2d9f8ab38fb None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:32.599764 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 558/1118] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:32.604968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051d2d-b9d2-4063-945a-f564ebde9fcd None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:32.605401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051d2d-b9d2-4063-945a-f564ebde9fcd None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:32.605577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051d2d-b9d2-4063-945a-f564ebde9fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:32.624005 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-02051d2d-b9d2-4063-945a-f564ebde9fcd None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:32.625189 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-02051d2d-b9d2-4063-945a-f564ebde9fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:32.672470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:32.693178 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 561/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:32.716062 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bd191-06ce-4ecd-a7b9-d2d9f8ab38fb None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:32.818720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bd191-06ce-4ecd-a7b9-d2d9f8ab38fb None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:32.852589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae2532-972d-4113-af81-ab2a743621cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:32.853185 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae2532-972d-4113-af81-ab2a743621cf None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:32.853465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae2532-972d-4113-af81-ab2a743621cf None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:32.853738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae2532-972d-4113-af81-ab2a743621cf None admin] PATH_INFO: `/v3/roles/fcaec44122534716b69d5e7f05160915` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:32.855190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae2532-972d-4113-af81-ab2a743621cf None admin] RBAC: Authorizing `identity:get_role(role_id=fcaec44122534716b69d5e7f05160915)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:32.857295 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae2532-972d-4113-af81-ab2a743621cf None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:32.858708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 559/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:37:32 2022] GET /identity/v3/roles/fcaec44122534716b69d5e7f05160915 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:32.864550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02051d2d-b9d2-4063-945a-f564ebde9fcd None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:32.965387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02051d2d-b9d2-4063-945a-f564ebde9fcd None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:32.999627 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e0a7e-c556-4953-b2e9-bb7231f12175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:33.000267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e0a7e-c556-4953-b2e9-bb7231f12175 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:33.000550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e0a7e-c556-4953-b2e9-bb7231f12175 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:33.000827 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e0a7e-c556-4953-b2e9-bb7231f12175 None admin] PATH_INFO: `/v3/users/3460452ef7964489851455c0912ee83f` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:33.001988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e0a7e-c556-4953-b2e9-bb7231f12175 None admin] RBAC: Authorizing `identity:get_user(user_id=3460452ef7964489851455c0912ee83f)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:33.003459 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e0a7e-c556-4953-b2e9-bb7231f12175 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:33.005059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 562/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:37:32 2022] GET /identity/v3/users/3460452ef7964489851455c0912ee83f => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:33.010930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae2532-972d-4113-af81-ab2a743621cf None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:33.077832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:33.112725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae2532-972d-4113-af81-ab2a743621cf None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:33.145814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae7946-4453-445b-a06d-f7441ff50f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:33.146483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae7946-4453-445b-a06d-f7441ff50f71 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:33.146765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae7946-4453-445b-a06d-f7441ff50f71 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:33.147036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae7946-4453-445b-a06d-f7441ff50f71 None admin] PATH_INFO: `/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:33.148217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae7946-4453-445b-a06d-f7441ff50f71 None admin] RBAC: Authorizing `identity:get_project(project_id=59f6ec987f1442d7a3e90cb8c14f6ded)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:33.149636 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae7946-4453-445b-a06d-f7441ff50f71 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:33.151338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 560/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:37:33 2022] GET /identity/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:33.157773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e0a7e-c556-4953-b2e9-bb7231f12175 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:33.206898 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:33.256154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e0a7e-c556-4953-b2e9-bb7231f12175 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:33.288946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02329cf2-143b-4e0f-aa13-f70bf2b03ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:33.289603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329cf2-143b-4e0f-aa13-f70bf2b03ed0 None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:33.289881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329cf2-143b-4e0f-aa13-f70bf2b03ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:33.290152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02329cf2-143b-4e0f-aa13-f70bf2b03ed0 None admin] PATH_INFO: `/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded/users/3460452ef7964489851455c0912ee83f/roles/fcaec44122534716b69d5e7f05160915` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:33.292311 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02329cf2-143b-4e0f-aa13-f70bf2b03ed0 None admin] RBAC: Authorizing `identity:create_grant(project_id=59f6ec987f1442d7a3e90cb8c14f6ded, user_id=3460452ef7964489851455c0912ee83f, role_id=fcaec44122534716b69d5e7f05160915)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:33.294330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02329cf2-143b-4e0f-aa13-f70bf2b03ed0 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:33.307266 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 563/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:37:33 2022] PUT /identity/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded/users/3460452ef7964489851455c0912ee83f/roles/fcaec44122534716b69d5e7f05160915 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:37:35.297442 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869b483-928a-49ba-a78f-127a46eda40b None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:35.297955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869b483-928a-49ba-a78f-127a46eda40b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:35.297955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869b483-928a-49ba-a78f-127a46eda40b None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:35.299285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 561/1124] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:35.304419 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2607d2-20ee-48c6-9214-06a5b910ad33 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:35.304847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2607d2-20ee-48c6-9214-06a5b910ad33 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:35.304965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2607d2-20ee-48c6-9214-06a5b910ad33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:35.323815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-ad2607d2-20ee-48c6-9214-06a5b910ad33 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:35.325793 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ad2607d2-20ee-48c6-9214-06a5b910ad33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:35.393644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 564/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:35.416904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869b483-928a-49ba-a78f-127a46eda40b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:35.518360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869b483-928a-49ba-a78f-127a46eda40b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:35.551376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be952f-21bb-4160-a737-06531dec859d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:35.551942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be952f-21bb-4160-a737-06531dec859d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:35.552224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be952f-21bb-4160-a737-06531dec859d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:35.552501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be952f-21bb-4160-a737-06531dec859d None admin] PATH_INFO: `/v3/roles/fcaec44122534716b69d5e7f05160915` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:35.553953 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be952f-21bb-4160-a737-06531dec859d None admin] RBAC: Authorizing `identity:get_role(role_id=fcaec44122534716b69d5e7f05160915)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:35.555361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be952f-21bb-4160-a737-06531dec859d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:35.556978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 562/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:37:35 2022] GET /identity/v3/roles/fcaec44122534716b69d5e7f05160915 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:35.563592 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2607d2-20ee-48c6-9214-06a5b910ad33 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:35.605017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:35.664050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2607d2-20ee-48c6-9214-06a5b910ad33 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:35.697147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f38eb-83fd-4ba8-aa4c-be8284f3e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:35.697778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f38eb-83fd-4ba8-aa4c-be8284f3e441 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:35.698058 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f38eb-83fd-4ba8-aa4c-be8284f3e441 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:35.698366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f38eb-83fd-4ba8-aa4c-be8284f3e441 None admin] PATH_INFO: `/v3/users/3460452ef7964489851455c0912ee83f` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:35.700055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f38eb-83fd-4ba8-aa4c-be8284f3e441 None admin] RBAC: Authorizing `identity:get_user(user_id=3460452ef7964489851455c0912ee83f)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:35.701464 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f38eb-83fd-4ba8-aa4c-be8284f3e441 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:35.703080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 565/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:37:35 2022] GET /identity/v3/users/3460452ef7964489851455c0912ee83f => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:35.708878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be952f-21bb-4160-a737-06531dec859d None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:35.712693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:35.812316 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be952f-21bb-4160-a737-06531dec859d None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:35.847045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c138ce3-dcfe-4fff-8563-12e9d755afdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:35.847664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c138ce3-dcfe-4fff-8563-12e9d755afdc None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:35.847949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c138ce3-dcfe-4fff-8563-12e9d755afdc None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:35.848227 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c138ce3-dcfe-4fff-8563-12e9d755afdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:35.917026 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c138ce3-dcfe-4fff-8563-12e9d755afdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:35.919059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c138ce3-dcfe-4fff-8563-12e9d755afdc None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:35.922293 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:36.019911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 563/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:37:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:37:36.025840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f38eb-83fd-4ba8-aa4c-be8284f3e441 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:36.127720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f38eb-83fd-4ba8-aa4c-be8284f3e441 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:36.137324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:36.162736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b93ef3-6708-4a7f-b96f-a31299b5ef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:36.163374 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93ef3-6708-4a7f-b96f-a31299b5ef8c None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:36.163660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93ef3-6708-4a7f-b96f-a31299b5ef8c None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:36.163940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b93ef3-6708-4a7f-b96f-a31299b5ef8c None admin] PATH_INFO: `/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:36.165105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b93ef3-6708-4a7f-b96f-a31299b5ef8c None admin] RBAC: Authorizing `identity:get_project(project_id=59f6ec987f1442d7a3e90cb8c14f6ded)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:36.166565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b93ef3-6708-4a7f-b96f-a31299b5ef8c None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:36.168782 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 566/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:37:36 2022] GET /identity/v3/projects/59f6ec987f1442d7a3e90cb8c14f6ded => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:36.175084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c138ce3-dcfe-4fff-8563-12e9d755afdc None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:36.273914 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c138ce3-dcfe-4fff-8563-12e9d755afdc None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:36.276280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:36.310011 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427efea4-ee09-47d8-9ecc-405b226a759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:36.310764 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427efea4-ee09-47d8-9ecc-405b226a759d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:36.310933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427efea4-ee09-47d8-9ecc-405b226a759d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:36.311205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427efea4-ee09-47d8-9ecc-405b226a759d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:36.311996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427efea4-ee09-47d8-9ecc-405b226a759d None admin] RBAC: Adding query filter params (role.id=fcaec44122534716b69d5e7f05160915, scope.project.id=59f6ec987f1442d7a3e90cb8c14f6ded, user.id=3460452ef7964489851455c0912ee83f) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:36.312307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427efea4-ee09-47d8-9ecc-405b226a759d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:36.313719 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427efea4-ee09-47d8-9ecc-405b226a759d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:36.319509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 564/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:37:36 2022] GET /identity/v3/role_assignments?user.id=3460452ef7964489851455c0912ee83f&scope.project.id=59f6ec987f1442d7a3e90cb8c14f6ded&role.id=fcaec44122534716b69d5e7f05160915 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:38.365751 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd8bb6-db5b-47f5-9a4e-6d1ead141240 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:38.366345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd8bb6-db5b-47f5-9a4e-6d1ead141240 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:38.366345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd8bb6-db5b-47f5-9a4e-6d1ead141240 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:38.367670 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 567/1131] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:38.372932 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0359c-2674-4d23-971c-1e72f7a36dea None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:38.373345 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0359c-2674-4d23-971c-1e72f7a36dea None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:38.373485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0359c-2674-4d23-971c-1e72f7a36dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:38.392033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-02c0359c-2674-4d23-971c-1e72f7a36dea None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:38.393233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-02c0359c-2674-4d23-971c-1e72f7a36dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:38.460931 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 565/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:38.484443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd8bb6-db5b-47f5-9a4e-6d1ead141240 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:38.583643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd8bb6-db5b-47f5-9a4e-6d1ead141240 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:38.617371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3890ad-8349-460e-911b-4c31294d6392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:38.617925 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3890ad-8349-460e-911b-4c31294d6392 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:38.618227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3890ad-8349-460e-911b-4c31294d6392 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:38.618492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3890ad-8349-460e-911b-4c31294d6392 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:38.619655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3890ad-8349-460e-911b-4c31294d6392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:38.621636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3890ad-8349-460e-911b-4c31294d6392 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:38.623428 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 568/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:38.629786 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0359c-2674-4d23-971c-1e72f7a36dea None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:38.724789 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:38.728436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0359c-2674-4d23-971c-1e72f7a36dea None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:38.763268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2250e9-7593-42b5-b8a1-96ebca0feaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:38.763876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2250e9-7593-42b5-b8a1-96ebca0feaac None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:38.764158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2250e9-7593-42b5-b8a1-96ebca0feaac None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:38.764433 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2250e9-7593-42b5-b8a1-96ebca0feaac None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:38.765134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2250e9-7593-42b5-b8a1-96ebca0feaac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:38.766591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2250e9-7593-42b5-b8a1-96ebca0feaac None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:38.794881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 566/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jul 27 10:37:38 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:37:40.844449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b510a-ca67-4951-804e-4f17a6e17e55 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:40.845067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b510a-ca67-4951-804e-4f17a6e17e55 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:40.845067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b510a-ca67-4951-804e-4f17a6e17e55 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:40.846385 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 569/1135] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:40.851630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27a5f1-4dc0-4cd9-beb4-7be1d406171f None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:40.852047 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27a5f1-4dc0-4cd9-beb4-7be1d406171f None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:40.852184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27a5f1-4dc0-4cd9-beb4-7be1d406171f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:40.870935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-9b27a5f1-4dc0-4cd9-beb4-7be1d406171f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:40.872140 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-9b27a5f1-4dc0-4cd9-beb4-7be1d406171f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:40.938875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 567/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:40.964210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b510a-ca67-4951-804e-4f17a6e17e55 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:41.013847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:41.072952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b510a-ca67-4951-804e-4f17a6e17e55 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:41.112392 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc6b5d-d934-4264-b372-6b5e5ff3f9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:41.112943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6b5d-d934-4264-b372-6b5e5ff3f9e6 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:41.113226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6b5d-d934-4264-b372-6b5e5ff3f9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:41.113503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6b5d-d934-4264-b372-6b5e5ff3f9e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:41.114774 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc6b5d-d934-4264-b372-6b5e5ff3f9e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:41.116217 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc6b5d-d934-4264-b372-6b5e5ff3f9e6 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:41.117824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 570/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:37:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:41.124214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27a5f1-4dc0-4cd9-beb4-7be1d406171f None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:41.203921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:41.224329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27a5f1-4dc0-4cd9-beb4-7be1d406171f None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:41.257892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76c633-530c-4777-8fd7-bfc31724f7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:41.258542 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76c633-530c-4777-8fd7-bfc31724f7de None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:41.258828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76c633-530c-4777-8fd7-bfc31724f7de None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:41.259104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76c633-530c-4777-8fd7-bfc31724f7de None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:41.259788 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76c633-530c-4777-8fd7-bfc31724f7de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:41.261228 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76c633-530c-4777-8fd7-bfc31724f7de None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:41.284242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 568/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:37:41 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:37:43.371213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfcbdf-1aaf-40bd-ad40-4c44525ec402 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:43.371792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfcbdf-1aaf-40bd-ad40-4c44525ec402 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:43.371891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfcbdf-1aaf-40bd-ad40-4c44525ec402 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:43.373717 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 571/1139] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:43.379010 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb98b0-7e35-42c8-8203-aa57034f6eca None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:43.379446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb98b0-7e35-42c8-8203-aa57034f6eca None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:43.379561 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb98b0-7e35-42c8-8203-aa57034f6eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:43.397548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-41cb98b0-7e35-42c8-8203-aa57034f6eca None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:43.398756 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-41cb98b0-7e35-42c8-8203-aa57034f6eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:43.463678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 569/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:43.487132 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfcbdf-1aaf-40bd-ad40-4c44525ec402 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:43.587586 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfcbdf-1aaf-40bd-ad40-4c44525ec402 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:43.600815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:43.622856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff3e0-d021-469f-8800-0985f4fa863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:43.623051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff3e0-d021-469f-8800-0985f4fa863e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:43.623252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff3e0-d021-469f-8800-0985f4fa863e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:43.623527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff3e0-d021-469f-8800-0985f4fa863e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:43.633656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff3e0-d021-469f-8800-0985f4fa863e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-fd3ff3e0-d021-469f-8800-0985f4fa863e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:37:43.638834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:43.639968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:43.640998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:43.640998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:43.640998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:43.640998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:43.640998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:37:43.640998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:37:43.640998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:37:43.640998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:37:43.640998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:37:43.640998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:37:43.640998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:37:43.640998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:43.640998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 572/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:37:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:43.646142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb98b0-7e35-42c8-8203-aa57034f6eca None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:43.719775 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:43.757133 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb98b0-7e35-42c8-8203-aa57034f6eca None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:43.790714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3e894-fbda-4756-87d5-a6c2a84785dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:43.791328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3e894-fbda-4756-87d5-a6c2a84785dc None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:43.791610 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3e894-fbda-4756-87d5-a6c2a84785dc None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:43.791884 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3e894-fbda-4756-87d5-a6c2a84785dc None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:43.792604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad3e894-fbda-4756-87d5-a6c2a84785dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:43.792906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad3e894-fbda-4756-87d5-a6c2a84785dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:43.794931 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad3e894-fbda-4756-87d5-a6c2a84785dc None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:43.802939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 570/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:37:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:43.809022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff3e0-d021-469f-8800-0985f4fa863e None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:43.910855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff3e0-d021-469f-8800-0985f4fa863e None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:43.945477 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64db19-2e05-41b1-9f66-27bb0b10f0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:43.946110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64db19-2e05-41b1-9f66-27bb0b10f0ef None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:43.946424 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64db19-2e05-41b1-9f66-27bb0b10f0ef None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:43.946701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb64db19-2e05-41b1-9f66-27bb0b10f0ef None admin] PATH_INFO: `/v3/users/bd82654c919747449cf9d31e2aef1609` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:43.960159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64db19-2e05-41b1-9f66-27bb0b10f0ef None admin] RBAC: Authorizing `identity:get_user(user_id=bd82654c919747449cf9d31e2aef1609)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:43.961590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb64db19-2e05-41b1-9f66-27bb0b10f0ef None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:43.963324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 573/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:37:43 2022] GET /identity/v3/users/bd82654c919747449cf9d31e2aef1609 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:43.969714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3e894-fbda-4756-87d5-a6c2a84785dc None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:44.069605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3e894-fbda-4756-87d5-a6c2a84785dc None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:44.096668 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:44.105043 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56326c89-b88e-445b-a198-dd11a2ab8495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:44.105665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56326c89-b88e-445b-a198-dd11a2ab8495 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:44.105949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56326c89-b88e-445b-a198-dd11a2ab8495 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:44.106364 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56326c89-b88e-445b-a198-dd11a2ab8495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:44.173566 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56326c89-b88e-445b-a198-dd11a2ab8495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:44.175066 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56326c89-b88e-445b-a198-dd11a2ab8495 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:44.276120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 571/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:37:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:37:44.282700 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64db19-2e05-41b1-9f66-27bb0b10f0ef None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:44.313573 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:44.382165 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb64db19-2e05-41b1-9f66-27bb0b10f0ef None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:44.415358 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45109f40-ef33-4039-a3bc-478f5bc71d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:44.415995 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45109f40-ef33-4039-a3bc-478f5bc71d9b None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:44.416273 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45109f40-ef33-4039-a3bc-478f5bc71d9b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:44.416543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45109f40-ef33-4039-a3bc-478f5bc71d9b None admin] PATH_INFO: `/v3/projects/9d5506cb2e9647b890d51ea9fb4d4664` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:44.417697 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45109f40-ef33-4039-a3bc-478f5bc71d9b None admin] RBAC: Authorizing `identity:get_project(project_id=9d5506cb2e9647b890d51ea9fb4d4664)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:44.419171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45109f40-ef33-4039-a3bc-478f5bc71d9b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:44.420804 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 574/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:37:44 2022] GET /identity/v3/projects/9d5506cb2e9647b890d51ea9fb4d4664 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:44.427217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56326c89-b88e-445b-a198-dd11a2ab8495 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:44.455436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:44.526474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56326c89-b88e-445b-a198-dd11a2ab8495 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:44.560300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0f432-bb98-4adc-8db8-173d0b2df6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:44.560904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f432-bb98-4adc-8db8-173d0b2df6cb None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:44.561182 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f432-bb98-4adc-8db8-173d0b2df6cb None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:44.561456 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f432-bb98-4adc-8db8-173d0b2df6cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:44.562290 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0f432-bb98-4adc-8db8-173d0b2df6cb None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=9d5506cb2e9647b890d51ea9fb4d4664, user.id=bd82654c919747449cf9d31e2aef1609) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:44.562602 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0f432-bb98-4adc-8db8-173d0b2df6cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:44.564028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0f432-bb98-4adc-8db8-173d0b2df6cb None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:44.569764 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 572/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:37:44 2022] GET /identity/v3/role_assignments?user.id=bd82654c919747449cf9d31e2aef1609&scope.project.id=9d5506cb2e9647b890d51ea9fb4d4664&role.id=36208a24005e4ff98d827138292bea37 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:46.551270 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee8781-1c5f-4171-8081-2a2245b3b201 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:46.551807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee8781-1c5f-4171-8081-2a2245b3b201 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:46.551807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee8781-1c5f-4171-8081-2a2245b3b201 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:46.553154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 575/1147] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:46.558533 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8871-dee2-42d2-a1a5-c4bb8569b88a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:46.558959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8871-dee2-42d2-a1a5-c4bb8569b88a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:46.559137 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b8871-dee2-42d2-a1a5-c4bb8569b88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:46.576936 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-ab1b8871-dee2-42d2-a1a5-c4bb8569b88a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:46.578114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ab1b8871-dee2-42d2-a1a5-c4bb8569b88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:46.646096 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 573/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:46.668084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee8781-1c5f-4171-8081-2a2245b3b201 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:46.764957 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:46.770371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee8781-1c5f-4171-8081-2a2245b3b201 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:46.804660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8acb04-92ad-4e2e-84c8-557927ee93e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:46.805227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8acb04-92ad-4e2e-84c8-557927ee93e5 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:46.805511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8acb04-92ad-4e2e-84c8-557927ee93e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:46.805789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8acb04-92ad-4e2e-84c8-557927ee93e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:46.816159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8acb04-92ad-4e2e-84c8-557927ee93e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-9e8acb04-92ad-4e2e-84c8-557927ee93e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:37:46.821052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:46.822149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:46.823251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:46.823251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:46.823251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:46.823251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:46.823251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:37:46.823251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:37:46.823251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:37:46.823251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:37:46.823251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:37:46.823251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:37:46.823251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:37:46.823251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:46.823251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 576/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:37:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:46.828506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b8871-dee2-42d2-a1a5-c4bb8569b88a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:46.852624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:46.932012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b8871-dee2-42d2-a1a5-c4bb8569b88a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:46.966535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195653d-c78e-459c-83ce-4da581ffcc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:46.967143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195653d-c78e-459c-83ce-4da581ffcc0a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:46.967425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195653d-c78e-459c-83ce-4da581ffcc0a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:46.967699 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195653d-c78e-459c-83ce-4da581ffcc0a None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:46.968412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195653d-c78e-459c-83ce-4da581ffcc0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:46.968713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195653d-c78e-459c-83ce-4da581ffcc0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:46.970071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195653d-c78e-459c-83ce-4da581ffcc0a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:46.978063 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 574/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:37:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:46.983976 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8acb04-92ad-4e2e-84c8-557927ee93e5 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:47.084851 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8acb04-92ad-4e2e-84c8-557927ee93e5 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:47.118937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760adc6-e99f-4e90-a0fe-69cbf2f7e2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:47.119574 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760adc6-e99f-4e90-a0fe-69cbf2f7e2f6 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:47.119856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760adc6-e99f-4e90-a0fe-69cbf2f7e2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:47.120132 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760adc6-e99f-4e90-a0fe-69cbf2f7e2f6 None admin] PATH_INFO: `/v3/users/bd82654c919747449cf9d31e2aef1609` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:47.121294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760adc6-e99f-4e90-a0fe-69cbf2f7e2f6 None admin] RBAC: Authorizing `identity:get_user(user_id=bd82654c919747449cf9d31e2aef1609)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:47.123443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760adc6-e99f-4e90-a0fe-69cbf2f7e2f6 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:47.125051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 577/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:37:46 2022] GET /identity/v3/users/bd82654c919747449cf9d31e2aef1609 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:47.131045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195653d-c78e-459c-83ce-4da581ffcc0a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:47.222581 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:47.239113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195653d-c78e-459c-83ce-4da581ffcc0a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:47.272539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c57d82-0822-47ae-b9aa-7a37033b3cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:47.273176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57d82-0822-47ae-b9aa-7a37033b3cf7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:47.273458 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57d82-0822-47ae-b9aa-7a37033b3cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:47.273734 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57d82-0822-47ae-b9aa-7a37033b3cf7 None admin] PATH_INFO: `/v3/projects/9d5506cb2e9647b890d51ea9fb4d4664` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:47.274916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c57d82-0822-47ae-b9aa-7a37033b3cf7 None admin] RBAC: Authorizing `identity:get_project(project_id=9d5506cb2e9647b890d51ea9fb4d4664)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:47.276353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c57d82-0822-47ae-b9aa-7a37033b3cf7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:47.278722 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 575/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:37:47 2022] GET /identity/v3/projects/9d5506cb2e9647b890d51ea9fb4d4664 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:47.284783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760adc6-e99f-4e90-a0fe-69cbf2f7e2f6 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:47.312874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:47.384750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760adc6-e99f-4e90-a0fe-69cbf2f7e2f6 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:47.418267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cd371-76ae-4ced-9f8e-36c8a2d4a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:47.419129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cd371-76ae-4ced-9f8e-36c8a2d4a85d None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:47.419411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cd371-76ae-4ced-9f8e-36c8a2d4a85d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:47.419689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cd371-76ae-4ced-9f8e-36c8a2d4a85d None admin] PATH_INFO: `/v3/projects/9d5506cb2e9647b890d51ea9fb4d4664/users/bd82654c919747449cf9d31e2aef1609/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:47.421630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cd371-76ae-4ced-9f8e-36c8a2d4a85d None admin] RBAC: Authorizing `identity:create_grant(project_id=9d5506cb2e9647b890d51ea9fb4d4664, user_id=bd82654c919747449cf9d31e2aef1609, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:47.423093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cd371-76ae-4ced-9f8e-36c8a2d4a85d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:47.437205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 578/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:37:47 2022] PUT /identity/v3/projects/9d5506cb2e9647b890d51ea9fb4d4664/users/bd82654c919747449cf9d31e2aef1609/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:37:49.435865 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35826df5-7e08-47ec-b6e0-e40ef16bb857 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:49.436411 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35826df5-7e08-47ec-b6e0-e40ef16bb857 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:49.436676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35826df5-7e08-47ec-b6e0-e40ef16bb857 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:49.439052 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 576/1154] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:49.444452 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90812d-2dd6-4697-8287-bf4758b908b9 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:49.444906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90812d-2dd6-4697-8287-bf4758b908b9 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:49.445022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90812d-2dd6-4697-8287-bf4758b908b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:49.466696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-ba90812d-2dd6-4697-8287-bf4758b908b9 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:49.467892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ba90812d-2dd6-4697-8287-bf4758b908b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:49.534844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 579/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:49.557857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35826df5-7e08-47ec-b6e0-e40ef16bb857 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:49.660449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35826df5-7e08-47ec-b6e0-e40ef16bb857 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:49.693621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e57c47-ba19-40b8-9cfb-cf10b4f09521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:49.694202 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e57c47-ba19-40b8-9cfb-cf10b4f09521 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:49.694488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e57c47-ba19-40b8-9cfb-cf10b4f09521 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:49.694766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e57c47-ba19-40b8-9cfb-cf10b4f09521 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:49.705711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e57c47-ba19-40b8-9cfb-cf10b4f09521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-15e57c47-ba19-40b8-9cfb-cf10b4f09521 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:37:49.710633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:49.711745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:49.712782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:49.712782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:49.712782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:49.712782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:49.712782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:37:49.712782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:37:49.712782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:37:49.712782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:37:49.712782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:37:49.712782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:37:49.712782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:37:49.712782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:37:49.712782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 577/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:37:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:49.717911 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90812d-2dd6-4697-8287-bf4758b908b9 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:49.735045 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:49.817701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90812d-2dd6-4697-8287-bf4758b908b9 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:49.850982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2cb4d-4a1e-4f5b-8594-058b3bfdd7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:49.851602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2cb4d-4a1e-4f5b-8594-058b3bfdd7d7 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:49.851886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2cb4d-4a1e-4f5b-8594-058b3bfdd7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:49.852163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2cb4d-4a1e-4f5b-8594-058b3bfdd7d7 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:49.852881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2cb4d-4a1e-4f5b-8594-058b3bfdd7d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:49.853189 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2cb4d-4a1e-4f5b-8594-058b3bfdd7d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:49.854582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2cb4d-4a1e-4f5b-8594-058b3bfdd7d7 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:49.862639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 580/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:37:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:49.868559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e57c47-ba19-40b8-9cfb-cf10b4f09521 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:49.884253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:49.971451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e57c47-ba19-40b8-9cfb-cf10b4f09521 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:50.004665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae607fd-5691-4036-ae93-9042f3d6ec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:50.005301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae607fd-5691-4036-ae93-9042f3d6ec65 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:50.005581 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae607fd-5691-4036-ae93-9042f3d6ec65 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:50.005857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae607fd-5691-4036-ae93-9042f3d6ec65 None admin] PATH_INFO: `/v3/users/bd82654c919747449cf9d31e2aef1609` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:50.007052 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae607fd-5691-4036-ae93-9042f3d6ec65 None admin] RBAC: Authorizing `identity:get_user(user_id=bd82654c919747449cf9d31e2aef1609)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:50.008478 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae607fd-5691-4036-ae93-9042f3d6ec65 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:50.010083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 578/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:37:49 2022] GET /identity/v3/users/bd82654c919747449cf9d31e2aef1609 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:50.016157 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2cb4d-4a1e-4f5b-8594-058b3bfdd7d7 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:50.094121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:50.116239 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2cb4d-4a1e-4f5b-8594-058b3bfdd7d7 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:50.149718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60fc3c-b8fb-46a4-913d-84581c5f15fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:50.150371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60fc3c-b8fb-46a4-913d-84581c5f15fe None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:50.150660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60fc3c-b8fb-46a4-913d-84581c5f15fe None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:50.150944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60fc3c-b8fb-46a4-913d-84581c5f15fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:50.217139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60fc3c-b8fb-46a4-913d-84581c5f15fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:50.218615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60fc3c-b8fb-46a4-913d-84581c5f15fe None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:50.296260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:50.321093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 581/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:37:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:37:50.328221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae607fd-5691-4036-ae93-9042f3d6ec65 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:50.408765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:50.428420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae607fd-5691-4036-ae93-9042f3d6ec65 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:50.462619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c65031-5c59-48ab-8eb5-6765369d49f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:50.463266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c65031-5c59-48ab-8eb5-6765369d49f2 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:50.463523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c65031-5c59-48ab-8eb5-6765369d49f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:50.463799 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c65031-5c59-48ab-8eb5-6765369d49f2 None admin] PATH_INFO: `/v3/projects/9d5506cb2e9647b890d51ea9fb4d4664` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:50.464964 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c65031-5c59-48ab-8eb5-6765369d49f2 None admin] RBAC: Authorizing `identity:get_project(project_id=9d5506cb2e9647b890d51ea9fb4d4664)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:50.466633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c65031-5c59-48ab-8eb5-6765369d49f2 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:50.468309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 579/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:37:50 2022] GET /identity/v3/projects/9d5506cb2e9647b890d51ea9fb4d4664 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:50.474532 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60fc3c-b8fb-46a4-913d-84581c5f15fe None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:50.572375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60fc3c-b8fb-46a4-913d-84581c5f15fe None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:50.605754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6ea23-3faa-4749-9d1d-6138ffde05cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:50.606476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6ea23-3faa-4749-9d1d-6138ffde05cb None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:50.606759 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6ea23-3faa-4749-9d1d-6138ffde05cb None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:50.607032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6ea23-3faa-4749-9d1d-6138ffde05cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:50.607822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6ea23-3faa-4749-9d1d-6138ffde05cb None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=9d5506cb2e9647b890d51ea9fb4d4664, user.id=bd82654c919747449cf9d31e2aef1609) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:50.608134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6ea23-3faa-4749-9d1d-6138ffde05cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:50.609580 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6ea23-3faa-4749-9d1d-6138ffde05cb None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:50.615518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 582/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:37:50 2022] GET /identity/v3/role_assignments?user.id=bd82654c919747449cf9d31e2aef1609&scope.project.id=9d5506cb2e9647b890d51ea9fb4d4664&role.id=36208a24005e4ff98d827138292bea37 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:52.643920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef292aa7-6dcf-4f64-be57-fb1f6b0f6936 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:52.644517 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef292aa7-6dcf-4f64-be57-fb1f6b0f6936 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:52.644517 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef292aa7-6dcf-4f64-be57-fb1f6b0f6936 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:52.645896 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 580/1162] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:52.651327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc2055-1d82-4a07-a16b-b357a9e9f885 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:52.651756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc2055-1d82-4a07-a16b-b357a9e9f885 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:52.651885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc2055-1d82-4a07-a16b-b357a9e9f885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:52.669699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-d5cc2055-1d82-4a07-a16b-b357a9e9f885 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:52.670915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-d5cc2055-1d82-4a07-a16b-b357a9e9f885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:52.706618 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:52.737544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 583/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:52.759732 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef292aa7-6dcf-4f64-be57-fb1f6b0f6936 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:52.860296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef292aa7-6dcf-4f64-be57-fb1f6b0f6936 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:52.895128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25046f-dd7f-40ef-8874-58aa738bcd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:52.895690 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25046f-dd7f-40ef-8874-58aa738bcd99 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:52.895975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25046f-dd7f-40ef-8874-58aa738bcd99 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:52.896252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25046f-dd7f-40ef-8874-58aa738bcd99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:52.914327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:52.965405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25046f-dd7f-40ef-8874-58aa738bcd99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:52.966879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25046f-dd7f-40ef-8874-58aa738bcd99 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:53.064862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 581/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:37:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:37:53.071176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc2055-1d82-4a07-a16b-b357a9e9f885 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:53.168856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc2055-1d82-4a07-a16b-b357a9e9f885 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:53.202060 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e7073-6a9d-4c92-8c36-865c7824321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:53.202719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e7073-6a9d-4c92-8c36-865c7824321a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:53.203001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e7073-6a9d-4c92-8c36-865c7824321a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:53.203273 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e7073-6a9d-4c92-8c36-865c7824321a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:53.209870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e7073-6a9d-4c92-8c36-865c7824321a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:53.211349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e7073-6a9d-4c92-8c36-865c7824321a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-210e7073-6a9d-4c92-8c36-865c7824321a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:37:53.223448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:37:53.224795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:37:53.225999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 584/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jul 27 10:37:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:37:53.230743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25046f-dd7f-40ef-8874-58aa738bcd99 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:53.279654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:53.330676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25046f-dd7f-40ef-8874-58aa738bcd99 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:53.363681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ba0ed-154b-42d9-b455-e36ca1e88095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:53.364298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ba0ed-154b-42d9-b455-e36ca1e88095 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:53.364581 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ba0ed-154b-42d9-b455-e36ca1e88095 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:53.364858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ba0ed-154b-42d9-b455-e36ca1e88095 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:53.365556 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ba0ed-154b-42d9-b455-e36ca1e88095 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:37:53.365858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ba0ed-154b-42d9-b455-e36ca1e88095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:53.367265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ba0ed-154b-42d9-b455-e36ca1e88095 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:53.374926 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 582/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Jul 27 10:37:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:55.371251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a102a3b-92c0-4814-998c-67a02a58767e None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:55.371892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a102a3b-92c0-4814-998c-67a02a58767e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:55.371892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a102a3b-92c0-4814-998c-67a02a58767e None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:55.373143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 585/1167] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:55.378519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510d6ee-2d6c-4cdb-a793-320702df5c70 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:55.378907 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510d6ee-2d6c-4cdb-a793-320702df5c70 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:55.379078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510d6ee-2d6c-4cdb-a793-320702df5c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:55.397664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b510d6ee-2d6c-4cdb-a793-320702df5c70 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:55.398895 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b510d6ee-2d6c-4cdb-a793-320702df5c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:55.468009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 583/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:37:55.490175 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a102a3b-92c0-4814-998c-67a02a58767e None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:55.522350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:55.594428 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a102a3b-92c0-4814-998c-67a02a58767e None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:55.628186 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdc5e0-746c-4dbd-bacc-3e8d72eecc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:55.628722 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc5e0-746c-4dbd-bacc-3e8d72eecc4b None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:55.629005 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc5e0-746c-4dbd-bacc-3e8d72eecc4b None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:55.629281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc5e0-746c-4dbd-bacc-3e8d72eecc4b None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:55.630009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdc5e0-746c-4dbd-bacc-3e8d72eecc4b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:55.631407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdc5e0-746c-4dbd-bacc-3e8d72eecc4b None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:55.650377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 586/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Wed Jul 27 10:37:55 2022] POST /identity/v3/domains => generated 267 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:37:57.692956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71597e-bb39-4c1a-a0ec-7b617ca864c4 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:57.693520 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71597e-bb39-4c1a-a0ec-7b617ca864c4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:57.693520 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71597e-bb39-4c1a-a0ec-7b617ca864c4 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:57.694921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 584/1170] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:37:57.700398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ab28e-7c23-40dd-a69b-c5141636d897 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:57.700829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ab28e-7c23-40dd-a69b-c5141636d897 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:57.700959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ab28e-7c23-40dd-a69b-c5141636d897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:57.718770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-3f8ab28e-7c23-40dd-a69b-c5141636d897 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:37:57.719931 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3f8ab28e-7c23-40dd-a69b-c5141636d897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:37:57.786415 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 587/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:37:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:37:57.810358 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71597e-bb39-4c1a-a0ec-7b617ca864c4 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:57.856605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:57.923392 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71597e-bb39-4c1a-a0ec-7b617ca864c4 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:57.956621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d504d3-8152-4a22-82f1-4847da18383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:57.957180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d504d3-8152-4a22-82f1-4847da18383c None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:57.957458 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d504d3-8152-4a22-82f1-4847da18383c None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:57.957729 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d504d3-8152-4a22-82f1-4847da18383c None admin] PATH_INFO: `/v3/domains/24f5170636964ca0928104668d85f525` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:57.968932 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d504d3-8152-4a22-82f1-4847da18383c None admin] RBAC: Authorizing `identity:get_domain(domain_id=24f5170636964ca0928104668d85f525)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:57.970390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d504d3-8152-4a22-82f1-4847da18383c None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:57.972010 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 585/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Wed Jul 27 10:37:57 2022] GET /identity/v3/domains/24f5170636964ca0928104668d85f525 => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:37:57.977860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ab28e-7c23-40dd-a69b-c5141636d897 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:37:58.001415 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:37:58.075970 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ab28e-7c23-40dd-a69b-c5141636d897 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:37:58.109917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c48018-17bb-4407-921a-636ee090de22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:37:58.110560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c48018-17bb-4407-921a-636ee090de22 None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:37:58.110838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c48018-17bb-4407-921a-636ee090de22 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:37:58.111109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c48018-17bb-4407-921a-636ee090de22 None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:37:58.111799 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c48018-17bb-4407-921a-636ee090de22 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:37:58.113243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c48018-17bb-4407-921a-636ee090de22 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:37:58.139579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 588/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jul 27 10:37:57 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:38:00.173115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb2402-489d-438a-9e4c-bb2f717dd637 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:00.173672 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb2402-489d-438a-9e4c-bb2f717dd637 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:00.173672 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb2402-489d-438a-9e4c-bb2f717dd637 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:00.175146 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 586/1174] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:38:00.181042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884a251-025b-4e6e-9709-2bc279c0f493 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:00.181501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884a251-025b-4e6e-9709-2bc279c0f493 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:00.181599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884a251-025b-4e6e-9709-2bc279c0f493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:00.199571 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-2884a251-025b-4e6e-9709-2bc279c0f493 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:38:00.200763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2884a251-025b-4e6e-9709-2bc279c0f493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:38:00.267845 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 589/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:38:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:38:00.294010 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb2402-489d-438a-9e4c-bb2f717dd637 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:00.398391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb2402-489d-438a-9e4c-bb2f717dd637 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:00.400212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:00.434532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d10ae7-570f-4a7f-85bd-4cb93ec058a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:00.435094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d10ae7-570f-4a7f-85bd-4cb93ec058a1 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:00.435379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d10ae7-570f-4a7f-85bd-4cb93ec058a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:00.435657 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d10ae7-570f-4a7f-85bd-4cb93ec058a1 None admin] PATH_INFO: `/v3/domains/24f5170636964ca0928104668d85f525` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:00.436823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d10ae7-570f-4a7f-85bd-4cb93ec058a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=24f5170636964ca0928104668d85f525)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:00.438284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d10ae7-570f-4a7f-85bd-4cb93ec058a1 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:00.439889 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 587/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Wed Jul 27 10:38:00 2022] GET /identity/v3/domains/24f5170636964ca0928104668d85f525 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:38:00.445856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884a251-025b-4e6e-9709-2bc279c0f493 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:00.449501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:00.544458 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884a251-025b-4e6e-9709-2bc279c0f493 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:00.577612 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856516f0-f645-4830-bbab-aec10cdcb500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:00.578356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856516f0-f645-4830-bbab-aec10cdcb500 None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:00.578532 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856516f0-f645-4830-bbab-aec10cdcb500 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:00.578802 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856516f0-f645-4830-bbab-aec10cdcb500 None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:00.579490 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856516f0-f645-4830-bbab-aec10cdcb500 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:00.580913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856516f0-f645-4830-bbab-aec10cdcb500 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:00.601821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 590/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:38:00 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:38:02.654914 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2f73-df3d-4df2-b71e-960e0e23d167 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:02.655489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2f73-df3d-4df2-b71e-960e0e23d167 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:02.655489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e2f73-df3d-4df2-b71e-960e0e23d167 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:02.656791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 588/1178] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:38:02.661928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696f44-a7da-4a51-8ec3-fd0d5e29781e None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:02.662359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696f44-a7da-4a51-8ec3-fd0d5e29781e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:02.662517 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696f44-a7da-4a51-8ec3-fd0d5e29781e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:02.681114 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-cd696f44-a7da-4a51-8ec3-fd0d5e29781e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:38:02.682339 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-cd696f44-a7da-4a51-8ec3-fd0d5e29781e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:38:02.737907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:02.750655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 591/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:38:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:38:02.773302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e2f73-df3d-4df2-b71e-960e0e23d167 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:02.873825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e2f73-df3d-4df2-b71e-960e0e23d167 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:02.907687 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f56ac3-bacd-4670-8f2a-f693214483e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:02.908258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f56ac3-bacd-4670-8f2a-f693214483e7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:02.908548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f56ac3-bacd-4670-8f2a-f693214483e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:02.908827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f56ac3-bacd-4670-8f2a-f693214483e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:02.919922 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f56ac3-bacd-4670-8f2a-f693214483e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-b0f56ac3-bacd-4670-8f2a-f693214483e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:38:02.924833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:38:02.925943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:38:02.927034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:38:02.927034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:38:02.927034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:38:02.927034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:38:02.927034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:38:02.927034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:38:02.927034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:38:02.927034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:38:02.927034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:38:02.927034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:38:02.927034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:38:02.927034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:38:02.927034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 589/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:38:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:38:02.932408 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696f44-a7da-4a51-8ec3-fd0d5e29781e None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:03.030526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696f44-a7da-4a51-8ec3-fd0d5e29781e None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:03.065137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d5192-cbcc-401e-95c6-4e9937f21883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:03.065759 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d5192-cbcc-401e-95c6-4e9937f21883 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:03.066042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d5192-cbcc-401e-95c6-4e9937f21883 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:03.066344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d5192-cbcc-401e-95c6-4e9937f21883 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:03.067190 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d5192-cbcc-401e-95c6-4e9937f21883 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:38:03.067373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d5192-cbcc-401e-95c6-4e9937f21883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:03.068749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d5192-cbcc-401e-95c6-4e9937f21883 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:03.077432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 592/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:38:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:38:03.083277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f56ac3-bacd-4670-8f2a-f693214483e7 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:03.116811 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:03.187749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f56ac3-bacd-4670-8f2a-f693214483e7 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:03.220959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfac11c-b47b-4ac6-8c1e-8953491a625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:03.221593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfac11c-b47b-4ac6-8c1e-8953491a625d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:03.221875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfac11c-b47b-4ac6-8c1e-8953491a625d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:03.222151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfac11c-b47b-4ac6-8c1e-8953491a625d None admin] PATH_INFO: `/v3/users/51ed9fa6485840d388651de1a7016717` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:03.235820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfac11c-b47b-4ac6-8c1e-8953491a625d None admin] RBAC: Authorizing `identity:get_user(user_id=51ed9fa6485840d388651de1a7016717)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:03.237272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfac11c-b47b-4ac6-8c1e-8953491a625d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:03.238970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 590/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:38:03 2022] GET /identity/v3/users/51ed9fa6485840d388651de1a7016717 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:38:03.244814 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d5192-cbcc-401e-95c6-4e9937f21883 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:03.297724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:03.345664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d5192-cbcc-401e-95c6-4e9937f21883 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:03.379728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0f492-5d85-4c7f-9e19-165016ca5cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:03.380345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0f492-5d85-4c7f-9e19-165016ca5cc8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:03.380624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0f492-5d85-4c7f-9e19-165016ca5cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:03.380897 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0f492-5d85-4c7f-9e19-165016ca5cc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:03.449811 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0f492-5d85-4c7f-9e19-165016ca5cc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:03.451197 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0f492-5d85-4c7f-9e19-165016ca5cc8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:03.501177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:03.548418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 593/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:38:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:38:03.554354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfac11c-b47b-4ac6-8c1e-8953491a625d None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:03.641642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:03.654159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfac11c-b47b-4ac6-8c1e-8953491a625d None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:03.688858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225b565-ab58-418a-bdf7-f6a4d05191ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:03.689598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b565-ab58-418a-bdf7-f6a4d05191ca None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:03.689755 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b565-ab58-418a-bdf7-f6a4d05191ca None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:03.690032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b565-ab58-418a-bdf7-f6a4d05191ca None admin] PATH_INFO: `/v3/projects/68b86b5b46c74ed59c7881148a007d09` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:03.691231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225b565-ab58-418a-bdf7-f6a4d05191ca None admin] RBAC: Authorizing `identity:get_project(project_id=68b86b5b46c74ed59c7881148a007d09)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:03.692680 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225b565-ab58-418a-bdf7-f6a4d05191ca None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:03.694381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 591/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:38:03 2022] GET /identity/v3/projects/68b86b5b46c74ed59c7881148a007d09 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:38:03.700853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0f492-5d85-4c7f-9e19-165016ca5cc8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:03.804173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0f492-5d85-4c7f-9e19-165016ca5cc8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:03.837708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00a088-f9cf-43ff-b0eb-d0ca33cd50c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:03.838348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00a088-f9cf-43ff-b0eb-d0ca33cd50c2 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:03.838636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00a088-f9cf-43ff-b0eb-d0ca33cd50c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:03.838913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00a088-f9cf-43ff-b0eb-d0ca33cd50c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:03.840328 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00a088-f9cf-43ff-b0eb-d0ca33cd50c2 None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=68b86b5b46c74ed59c7881148a007d09, user.id=51ed9fa6485840d388651de1a7016717) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:38:03.840644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00a088-f9cf-43ff-b0eb-d0ca33cd50c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:03.842073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00a088-f9cf-43ff-b0eb-d0ca33cd50c2 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:03.847447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 594/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:38:03 2022] GET /identity/v3/role_assignments?user.id=51ed9fa6485840d388651de1a7016717&scope.project.id=68b86b5b46c74ed59c7881148a007d09&role.id=36208a24005e4ff98d827138292bea37 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:38:05.827148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dc9ae-24e4-4b9b-aae5-ee86fc67318b None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:05.827729 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dc9ae-24e4-4b9b-aae5-ee86fc67318b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:05.827729 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dc9ae-24e4-4b9b-aae5-ee86fc67318b None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:05.829041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 592/1186] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:38:05.834331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc4529-83b7-4514-b637-b630ca178dbc None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:05.834776 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc4529-83b7-4514-b637-b630ca178dbc None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:05.834882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc4529-83b7-4514-b637-b630ca178dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:05.853237 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-52cc4529-83b7-4514-b637-b630ca178dbc None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:38:05.854447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-52cc4529-83b7-4514-b637-b630ca178dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:38:05.865343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:05.937813 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 595/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:38:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:38:05.960176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dc9ae-24e4-4b9b-aae5-ee86fc67318b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:06.068900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dc9ae-24e4-4b9b-aae5-ee86fc67318b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:06.102638 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e8cf2-8c59-440d-8103-6d2a73f1fe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:06.103188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e8cf2-8c59-440d-8103-6d2a73f1fe0b None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:06.103467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e8cf2-8c59-440d-8103-6d2a73f1fe0b None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:06.103739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e8cf2-8c59-440d-8103-6d2a73f1fe0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:06.113794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e8cf2-8c59-440d-8103-6d2a73f1fe0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-bf3e8cf2-8c59-440d-8103-6d2a73f1fe0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:38:06.118649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:38:06.119766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:38:06.121539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:38:06.121539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:38:06.121539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:38:06.121539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:38:06.121539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:38:06.121539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:38:06.121539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:38:06.121539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:38:06.121539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:38:06.121539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:38:06.121539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:38:06.121539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:38:06.121539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 593/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:38:06.126504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc4529-83b7-4514-b637-b630ca178dbc None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:06.224443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc4529-83b7-4514-b637-b630ca178dbc None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:06.259026 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5254251-aac4-4f2e-9f71-c072af553f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:06.259647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5254251-aac4-4f2e-9f71-c072af553f26 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:06.259932 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5254251-aac4-4f2e-9f71-c072af553f26 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:06.260208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5254251-aac4-4f2e-9f71-c072af553f26 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:06.261575 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5254251-aac4-4f2e-9f71-c072af553f26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:38:06.261960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5254251-aac4-4f2e-9f71-c072af553f26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:06.263378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5254251-aac4-4f2e-9f71-c072af553f26 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:06.271389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 596/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:38:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:38:06.277585 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e8cf2-8c59-440d-8103-6d2a73f1fe0b None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:06.296113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:06.378148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e8cf2-8c59-440d-8103-6d2a73f1fe0b None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:06.412989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d54a2f-f360-4157-949c-b5bae700c195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:06.413629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d54a2f-f360-4157-949c-b5bae700c195 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:06.413916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d54a2f-f360-4157-949c-b5bae700c195 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:06.414216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d54a2f-f360-4157-949c-b5bae700c195 None admin] PATH_INFO: `/v3/users/51ed9fa6485840d388651de1a7016717` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:06.415396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d54a2f-f360-4157-949c-b5bae700c195 None admin] RBAC: Authorizing `identity:get_user(user_id=51ed9fa6485840d388651de1a7016717)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:06.416825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d54a2f-f360-4157-949c-b5bae700c195 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:06.419134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 594/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:38:06 2022] GET /identity/v3/users/51ed9fa6485840d388651de1a7016717 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:38:06.424887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5254251-aac4-4f2e-9f71-c072af553f26 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:06.437097 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:06.525627 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5254251-aac4-4f2e-9f71-c072af553f26 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:06.559717 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761ec02-98de-402f-b513-f4f86345ac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:06.560356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ec02-98de-402f-b513-f4f86345ac55 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:06.560642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ec02-98de-402f-b513-f4f86345ac55 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:06.560919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ec02-98de-402f-b513-f4f86345ac55 None admin] PATH_INFO: `/v3/projects/68b86b5b46c74ed59c7881148a007d09` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:06.562071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761ec02-98de-402f-b513-f4f86345ac55 None admin] RBAC: Authorizing `identity:get_project(project_id=68b86b5b46c74ed59c7881148a007d09)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:06.563532 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761ec02-98de-402f-b513-f4f86345ac55 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:06.565188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 597/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:38:06 2022] GET /identity/v3/projects/68b86b5b46c74ed59c7881148a007d09 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:38:06.571623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d54a2f-f360-4157-949c-b5bae700c195 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:06.656776 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:06.673241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d54a2f-f360-4157-949c-b5bae700c195 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:06.707256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdf0e3-d74b-4778-b535-facdc44238fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:06.707921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdf0e3-d74b-4778-b535-facdc44238fd None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:06.708207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdf0e3-d74b-4778-b535-facdc44238fd None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:06.708486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdf0e3-d74b-4778-b535-facdc44238fd None admin] PATH_INFO: `/v3/projects/68b86b5b46c74ed59c7881148a007d09/users/51ed9fa6485840d388651de1a7016717/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:06.710469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdf0e3-d74b-4778-b535-facdc44238fd None admin] RBAC: Authorizing `identity:create_grant(project_id=68b86b5b46c74ed59c7881148a007d09, user_id=51ed9fa6485840d388651de1a7016717, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:06.711904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdf0e3-d74b-4778-b535-facdc44238fd None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:06.724566 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 595/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:38:06 2022] PUT /identity/v3/projects/68b86b5b46c74ed59c7881148a007d09/users/51ed9fa6485840d388651de1a7016717/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:38:08.721119 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c815f77-6122-42b0-9617-26b7f397e8d4 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:08.721670 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c815f77-6122-42b0-9617-26b7f397e8d4 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:08.721670 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c815f77-6122-42b0-9617-26b7f397e8d4 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:08.723056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 598/1193] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:38:08.728347 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2460d3-22c4-4fcd-b10d-632c74b7b7b6 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:08.728769 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2460d3-22c4-4fcd-b10d-632c74b7b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:08.728897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2460d3-22c4-4fcd-b10d-632c74b7b7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:08.748810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-dd2460d3-22c4-4fcd-b10d-632c74b7b7b6 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:38:08.749994 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-dd2460d3-22c4-4fcd-b10d-632c74b7b7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:38:08.818111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 596/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:38:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:38:08.841170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c815f77-6122-42b0-9617-26b7f397e8d4 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:08.921446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:08.946352 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c815f77-6122-42b0-9617-26b7f397e8d4 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:08.979894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1d06c-c944-4ba3-9380-c895d26d5a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:08.980430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1d06c-c944-4ba3-9380-c895d26d5a54 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:08.980708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1d06c-c944-4ba3-9380-c895d26d5a54 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:08.980979 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1d06c-c944-4ba3-9380-c895d26d5a54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:08.991027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1d06c-c944-4ba3-9380-c895d26d5a54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-60a1d06c-c944-4ba3-9380-c895d26d5a54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:38:08.997172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:38:08.998354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:38:08.999422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:38:08.999422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:38:08.999422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:38:08.999422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:38:08.999422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:38:08.999422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:38:08.999422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:38:08.999422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:38:08.999422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:38:08.999422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:38:08.999422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:38:08.999422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:38:08.999422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 599/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:38:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:38:09.004393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2460d3-22c4-4fcd-b10d-632c74b7b7b6 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:09.077241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:09.103466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2460d3-22c4-4fcd-b10d-632c74b7b7b6 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:09.137393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa8b63-d22b-4039-b1a2-dd81dfa67b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:09.138009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa8b63-d22b-4039-b1a2-dd81dfa67b22 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:09.138325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa8b63-d22b-4039-b1a2-dd81dfa67b22 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:09.138603 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa8b63-d22b-4039-b1a2-dd81dfa67b22 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:09.139325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa8b63-d22b-4039-b1a2-dd81dfa67b22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:38:09.139634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa8b63-d22b-4039-b1a2-dd81dfa67b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:09.140998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa8b63-d22b-4039-b1a2-dd81dfa67b22 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:09.149018 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 597/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:38:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:38:09.155375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1d06c-c944-4ba3-9380-c895d26d5a54 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:09.255303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1d06c-c944-4ba3-9380-c895d26d5a54 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:09.288854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5726e1-54ce-4776-8369-f239e1bb97ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:09.289494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5726e1-54ce-4776-8369-f239e1bb97ca None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:09.289776 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5726e1-54ce-4776-8369-f239e1bb97ca None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:09.290051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5726e1-54ce-4776-8369-f239e1bb97ca None admin] PATH_INFO: `/v3/users/51ed9fa6485840d388651de1a7016717` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:09.291330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5726e1-54ce-4776-8369-f239e1bb97ca None admin] RBAC: Authorizing `identity:get_user(user_id=51ed9fa6485840d388651de1a7016717)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:09.293551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5726e1-54ce-4776-8369-f239e1bb97ca None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:09.295239 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 600/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jul 27 10:38:09 2022] GET /identity/v3/users/51ed9fa6485840d388651de1a7016717 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:38:09.301178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa8b63-d22b-4039-b1a2-dd81dfa67b22 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:09.400672 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa8b63-d22b-4039-b1a2-dd81dfa67b22 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:09.435959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e70ba-b7e3-40fb-ad7c-a6af1554c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:09.436579 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e70ba-b7e3-40fb-ad7c-a6af1554c6ba None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:09.436858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e70ba-b7e3-40fb-ad7c-a6af1554c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:09.437131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e70ba-b7e3-40fb-ad7c-a6af1554c6ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:09.440592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:09.503834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e70ba-b7e3-40fb-ad7c-a6af1554c6ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:09.505268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e70ba-b7e3-40fb-ad7c-a6af1554c6ba None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:09.602075 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 598/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:38:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:38:09.608051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5726e1-54ce-4776-8369-f239e1bb97ca None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:09.611866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:09.706680 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5726e1-54ce-4776-8369-f239e1bb97ca None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:09.740364 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99433f9-dfa4-4184-afe6-824623ce6108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:09.740997 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99433f9-dfa4-4184-afe6-824623ce6108 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:09.741277 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99433f9-dfa4-4184-afe6-824623ce6108 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:09.741549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99433f9-dfa4-4184-afe6-824623ce6108 None admin] PATH_INFO: `/v3/projects/68b86b5b46c74ed59c7881148a007d09` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:09.742715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99433f9-dfa4-4184-afe6-824623ce6108 None admin] RBAC: Authorizing `identity:get_project(project_id=68b86b5b46c74ed59c7881148a007d09)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:09.744131 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99433f9-dfa4-4184-afe6-824623ce6108 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:09.746356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 601/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jul 27 10:38:09 2022] GET /identity/v3/projects/68b86b5b46c74ed59c7881148a007d09 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:38:09.753640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e70ba-b7e3-40fb-ad7c-a6af1554c6ba None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:38:09.787770 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:09.852243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e70ba-b7e3-40fb-ad7c-a6af1554c6ba None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:38:09.886952 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863bd47-a895-414d-b20e-a1ead972f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:38:09.887574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863bd47-a895-414d-b20e-a1ead972f525 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:38:09.887854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863bd47-a895-414d-b20e-a1ead972f525 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:38:09.888130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863bd47-a895-414d-b20e-a1ead972f525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:38:09.888952 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863bd47-a895-414d-b20e-a1ead972f525 None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=68b86b5b46c74ed59c7881148a007d09, user.id=51ed9fa6485840d388651de1a7016717) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:38:09.889263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863bd47-a895-414d-b20e-a1ead972f525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:38:09.890741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863bd47-a895-414d-b20e-a1ead972f525 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:38:09.896703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 599/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:38:09 2022] GET /identity/v3/role_assignments?user.id=51ed9fa6485840d388651de1a7016717&scope.project.id=68b86b5b46c74ed59c7881148a007d09&role.id=36208a24005e4ff98d827138292bea37 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:38:19.736263 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=64 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:38:19.894434 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=50 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:06.685075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e1a1f-42d6-4315-a30b-15293190fde0 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:06.685682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e1a1f-42d6-4315-a30b-15293190fde0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:06.685682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e1a1f-42d6-4315-a30b-15293190fde0 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:06.687495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 602/1201] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:39:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:39:06.696305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0ff27-7e7b-4e03-8289-84f0c98bea19 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:06.696305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0ff27-7e7b-4e03-8289-84f0c98bea19 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:06.696305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0ff27-7e7b-4e03-8289-84f0c98bea19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:06.714933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-03a0ff27-7e7b-4e03-8289-84f0c98bea19 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:39:06.716359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-03a0ff27-7e7b-4e03-8289-84f0c98bea19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:39:06.818179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 600/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:39:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:39:06.843391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e1a1f-42d6-4315-a30b-15293190fde0 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:06.995387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e1a1f-42d6-4315-a30b-15293190fde0 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:07.038942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a06ef-b294-42ed-b487-dccfc5db7e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:07.039603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a06ef-b294-42ed-b487-dccfc5db7e35 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:07.039889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a06ef-b294-42ed-b487-dccfc5db7e35 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:07.040227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a06ef-b294-42ed-b487-dccfc5db7e35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:07.057300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a06ef-b294-42ed-b487-dccfc5db7e35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:07.059222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a06ef-b294-42ed-b487-dccfc5db7e35 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-775a06ef-b294-42ed-b487-dccfc5db7e35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:39:07.076534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:07.077619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:07.078647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:39:07.078647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:39:07.078647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:07.078647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:07.082676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 603/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:07.085162 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0ff27-7e7b-4e03-8289-84f0c98bea19 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:07.223261 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0ff27-7e7b-4e03-8289-84f0c98bea19 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:07.261255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:07.268475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145821d-20f8-423b-bd4f-5e303a82d350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:07.269333 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145821d-20f8-423b-bd4f-5e303a82d350 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:07.269776 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145821d-20f8-423b-bd4f-5e303a82d350 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:07.270244 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145821d-20f8-423b-bd4f-5e303a82d350 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:07.271138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145821d-20f8-423b-bd4f-5e303a82d350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:07.271671 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145821d-20f8-423b-bd4f-5e303a82d350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:07.273092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145821d-20f8-423b-bd4f-5e303a82d350 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:07.287088 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 601/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:07.293955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a06ef-b294-42ed-b487-dccfc5db7e35 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:07.395406 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:07.464453 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a06ef-b294-42ed-b487-dccfc5db7e35 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:07.517953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c2a9e-4ecd-4b7f-82a8-4228f94f9c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:07.518547 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c2a9e-4ecd-4b7f-82a8-4228f94f9c09 None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:07.518835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c2a9e-4ecd-4b7f-82a8-4228f94f9c09 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:07.519115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c2a9e-4ecd-4b7f-82a8-4228f94f9c09 None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:07.519829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c2a9e-4ecd-4b7f-82a8-4228f94f9c09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:07.521281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c2a9e-4ecd-4b7f-82a8-4228f94f9c09 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:07.552371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 604/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jul 27 10:39:07 2022] POST /identity/v3/users => generated 251 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:39:09.860919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505398-b514-435e-a3cb-1a784faf5e91 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:09.860919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505398-b514-435e-a3cb-1a784faf5e91 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:09.860919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505398-b514-435e-a3cb-1a784faf5e91 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:09.861973 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 602/1206] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:39:09.868300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed795116-c5c6-4a24-8692-08f9269133b4 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:09.868300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed795116-c5c6-4a24-8692-08f9269133b4 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:09.868300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed795116-c5c6-4a24-8692-08f9269133b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:09.894827 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-ed795116-c5c6-4a24-8692-08f9269133b4 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:39:09.894827 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ed795116-c5c6-4a24-8692-08f9269133b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:39:09.980262 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 605/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:39:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:39:10.004270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69505398-b514-435e-a3cb-1a784faf5e91 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:10.130979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69505398-b514-435e-a3cb-1a784faf5e91 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:10.180651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6e4fc-1d96-469f-93aa-608e3eb648f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:10.181309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6e4fc-1d96-469f-93aa-608e3eb648f9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:10.181587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6e4fc-1d96-469f-93aa-608e3eb648f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:10.181861 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6e4fc-1d96-469f-93aa-608e3eb648f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:10.194332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6e4fc-1d96-469f-93aa-608e3eb648f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-12a6e4fc-1d96-469f-93aa-608e3eb648f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:39:10.199280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:10.200303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:10.201177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:10.201177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:10.201177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:10.201177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:10.201177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:39:10.201177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:39:10.201177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:39:10.201177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:39:10.201177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:39:10.201177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:39:10.201177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:39:10.201177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:10.201177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 603/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:39:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:10.206916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed795116-c5c6-4a24-8692-08f9269133b4 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:10.252702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:10.333576 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed795116-c5c6-4a24-8692-08f9269133b4 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:10.376549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5b29d-1c47-4a4c-a52a-83941bc78969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:10.377186 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5b29d-1c47-4a4c-a52a-83941bc78969 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:10.377466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5b29d-1c47-4a4c-a52a-83941bc78969 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:10.377747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5b29d-1c47-4a4c-a52a-83941bc78969 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:10.378516 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5b29d-1c47-4a4c-a52a-83941bc78969 None admin] RBAC: Adding query filter params (name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:10.378841 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5b29d-1c47-4a4c-a52a-83941bc78969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:10.380202 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5b29d-1c47-4a4c-a52a-83941bc78969 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:10.396008 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 606/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:10.397289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6e4fc-1d96-469f-93aa-608e3eb648f9 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:10.465359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:10.534421 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6e4fc-1d96-469f-93aa-608e3eb648f9 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:10.577324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef03355-eae1-4243-b828-50eb24454b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:10.577988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef03355-eae1-4243-b828-50eb24454b5a None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:10.578283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef03355-eae1-4243-b828-50eb24454b5a None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:10.578561 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef03355-eae1-4243-b828-50eb24454b5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:10.596688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef03355-eae1-4243-b828-50eb24454b5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:10.598595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef03355-eae1-4243-b828-50eb24454b5a None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-cef03355-eae1-4243-b828-50eb24454b5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:39:10.616941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:10.618100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:10.619263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:39:10.619263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:39:10.619263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:10.619263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:10.619263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 604/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:39:10.625622 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5b29d-1c47-4a4c-a52a-83941bc78969 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:10.751444 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:10.755353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5b29d-1c47-4a4c-a52a-83941bc78969 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:10.800796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae337ec-85fd-448c-97f9-027a7af080ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:10.801490 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae337ec-85fd-448c-97f9-027a7af080ba None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:10.801802 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae337ec-85fd-448c-97f9-027a7af080ba None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:10.802125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae337ec-85fd-448c-97f9-027a7af080ba None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:10.802932 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae337ec-85fd-448c-97f9-027a7af080ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:10.803245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae337ec-85fd-448c-97f9-027a7af080ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:10.804960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae337ec-85fd-448c-97f9-027a7af080ba None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:10.819398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 607/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:10.828276 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef03355-eae1-4243-b828-50eb24454b5a None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:10.950647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef03355-eae1-4243-b828-50eb24454b5a None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:10.952293 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:10.989830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a2fe9-0aad-421d-bda3-b2084dbf9014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:10.990522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2fe9-0aad-421d-bda3-b2084dbf9014 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:10.990806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2fe9-0aad-421d-bda3-b2084dbf9014 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:10.991086 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a2fe9-0aad-421d-bda3-b2084dbf9014 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:10.999683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a2fe9-0aad-421d-bda3-b2084dbf9014 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:11.001783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a2fe9-0aad-421d-bda3-b2084dbf9014 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-e64a2fe9-0aad-421d-bda3-b2084dbf9014 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:39:11.016387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:11.017479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:11.018499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:11.018499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:11.018499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:39:11.018499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:39:11.018499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:39:11.018499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:39:11.018499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:39:11.018499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:39:11.018499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 10:39:11.018499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:11.018499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 605/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:11.023869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae337ec-85fd-448c-97f9-027a7af080ba None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:11.143199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae337ec-85fd-448c-97f9-027a7af080ba None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:11.181852 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f4ef4-4540-4a44-8b50-76776e304b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:11.183235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f4ef4-4540-4a44-8b50-76776e304b87 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:11.183612 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f4ef4-4540-4a44-8b50-76776e304b87 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:11.183977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f4ef4-4540-4a44-8b50-76776e304b87 None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:11.184756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f4ef4-4540-4a44-8b50-76776e304b87 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:11.185137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f4ef4-4540-4a44-8b50-76776e304b87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:11.186535 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f4ef4-4540-4a44-8b50-76776e304b87 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:11.206229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 608/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Jul 27 10:39:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:39:11.212707 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a2fe9-0aad-421d-bda3-b2084dbf9014 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:11.341675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a2fe9-0aad-421d-bda3-b2084dbf9014 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:11.389259 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c902a5-c9f1-481c-8555-ae34a3268ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:11.390340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c902a5-c9f1-481c-8555-ae34a3268ad6 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:11.390792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c902a5-c9f1-481c-8555-ae34a3268ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:11.391237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c902a5-c9f1-481c-8555-ae34a3268ad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:11.439983 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:11.491108 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c902a5-c9f1-481c-8555-ae34a3268ad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:11.492734 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c902a5-c9f1-481c-8555-ae34a3268ad6 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:11.623862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 606/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:39:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 10:39:11.626131 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f4ef4-4540-4a44-8b50-76776e304b87 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:11.657103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:11.763685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f4ef4-4540-4a44-8b50-76776e304b87 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:11.809860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605be34-1cd2-42b7-9973-edd24d8d1d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:11.810641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605be34-1cd2-42b7-9973-edd24d8d1d78 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:11.810926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605be34-1cd2-42b7-9973-edd24d8d1d78 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:11.811200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605be34-1cd2-42b7-9973-edd24d8d1d78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:11.822412 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605be34-1cd2-42b7-9973-edd24d8d1d78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:11.824396 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605be34-1cd2-42b7-9973-edd24d8d1d78 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-1605be34-1cd2-42b7-9973-edd24d8d1d78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:39:11.841154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:11.842172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:11.843137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:39:11.843137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:39:11.843137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:11.843137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:11.847441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 609/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:11.848291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c902a5-c9f1-481c-8555-ae34a3268ad6 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:11.927950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:11.973900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c902a5-c9f1-481c-8555-ae34a3268ad6 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:12.013946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852aaebf-412a-4506-9be3-584cf4df4435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:12.014637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aaebf-412a-4506-9be3-584cf4df4435 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:12.014931 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aaebf-412a-4506-9be3-584cf4df4435 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:12.015210 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852aaebf-412a-4506-9be3-584cf4df4435 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:12.015937 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852aaebf-412a-4506-9be3-584cf4df4435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:12.016238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852aaebf-412a-4506-9be3-584cf4df4435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:12.018969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852aaebf-412a-4506-9be3-584cf4df4435 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:12.032503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 607/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:12.041469 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605be34-1cd2-42b7-9973-edd24d8d1d78 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:12.122903 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:12.161342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605be34-1cd2-42b7-9973-edd24d8d1d78 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:12.208717 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544e931-783e-4dc7-b0a3-350a4c42cb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:12.209708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544e931-783e-4dc7-b0a3-350a4c42cb4d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:12.210273 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544e931-783e-4dc7-b0a3-350a4c42cb4d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:12.210765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544e931-783e-4dc7-b0a3-350a4c42cb4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:12.218923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544e931-783e-4dc7-b0a3-350a4c42cb4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:12.220728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544e931-783e-4dc7-b0a3-350a4c42cb4d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-0544e931-783e-4dc7-b0a3-350a4c42cb4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:39:12.234832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:12.236036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:12.237161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:39:12.237161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:39:12.237161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:39:12.237161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:39:12.237161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:39:12.237161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:39:12.237161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:39:12.237161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:12.243288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 610/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:12.244945 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852aaebf-412a-4506-9be3-584cf4df4435 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:12.369328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852aaebf-412a-4506-9be3-584cf4df4435 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:12.399174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:12.413218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb367f1b-7d30-45fb-8f68-3cc194c33142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:12.414120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb367f1b-7d30-45fb-8f68-3cc194c33142 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:12.414564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb367f1b-7d30-45fb-8f68-3cc194c33142 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:12.414913 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb367f1b-7d30-45fb-8f68-3cc194c33142 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:12.415911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb367f1b-7d30-45fb-8f68-3cc194c33142 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:12.416227 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb367f1b-7d30-45fb-8f68-3cc194c33142 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:12.418480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb367f1b-7d30-45fb-8f68-3cc194c33142 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:12.435854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 608/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:39:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:12.442161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544e931-783e-4dc7-b0a3-350a4c42cb4d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:12.560958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544e931-783e-4dc7-b0a3-350a4c42cb4d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:12.597161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:12.605041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12674b2-c420-482a-9429-062ea20423aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:12.605779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12674b2-c420-482a-9429-062ea20423aa None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:12.606065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12674b2-c420-482a-9429-062ea20423aa None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:12.606377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12674b2-c420-482a-9429-062ea20423aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:12.607308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12674b2-c420-482a-9429-062ea20423aa None admin] RBAC: Adding query filter params (role.id=02a6ae14988149d38f9e819dc66b2f48, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=39830a354dee41b5b210d80807886299) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:12.607798 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12674b2-c420-482a-9429-062ea20423aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:12.609272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12674b2-c420-482a-9429-062ea20423aa None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:12.618225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 611/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:39:12 2022] GET /identity/v3/role_assignments?user.id=39830a354dee41b5b210d80807886299&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=02a6ae14988149d38f9e819dc66b2f48 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:14.817053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0ae6-0929-43a0-af79-ae70e30e33b5 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:14.817613 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0ae6-0929-43a0-af79-ae70e30e33b5 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:14.817613 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0ae6-0929-43a0-af79-ae70e30e33b5 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:14.819126 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 609/1220] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:39:14.825061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e3cee-b178-46e0-9a58-eaece9a5fa7c None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:14.825510 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e3cee-b178-46e0-9a58-eaece9a5fa7c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:14.825620 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e3cee-b178-46e0-9a58-eaece9a5fa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:14.844635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-0e4e3cee-b178-46e0-9a58-eaece9a5fa7c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:39:14.845937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0e4e3cee-b178-46e0-9a58-eaece9a5fa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:39:14.922752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 612/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:39:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:39:14.952377 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd0ae6-0929-43a0-af79-ae70e30e33b5 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:15.064741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd0ae6-0929-43a0-af79-ae70e30e33b5 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:15.103313 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5f806-b219-4b28-8938-5ed3665c4177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:15.104196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5f806-b219-4b28-8938-5ed3665c4177 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:15.104196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5f806-b219-4b28-8938-5ed3665c4177 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:15.104506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5f806-b219-4b28-8938-5ed3665c4177 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:15.115422 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5f806-b219-4b28-8938-5ed3665c4177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-21a5f806-b219-4b28-8938-5ed3665c4177 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:39:15.121054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:15.122318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:15.123200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:15.123200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:15.123200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:15.123200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:15.123200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:39:15.123200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:39:15.123200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:39:15.123200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:39:15.123200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:39:15.123200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:39:15.123200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:39:15.123200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:15.123200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 610/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:39:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:15.128918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e3cee-b178-46e0-9a58-eaece9a5fa7c None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:15.234363 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e3cee-b178-46e0-9a58-eaece9a5fa7c None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:15.260715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:15.272123 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da092e1-8918-411c-aed6-263e4e128ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:15.272742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da092e1-8918-411c-aed6-263e4e128ba8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:15.273021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da092e1-8918-411c-aed6-263e4e128ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:15.273292 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da092e1-8918-411c-aed6-263e4e128ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:15.274005 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da092e1-8918-411c-aed6-263e4e128ba8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:15.274337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da092e1-8918-411c-aed6-263e4e128ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:15.275699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da092e1-8918-411c-aed6-263e4e128ba8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:15.284699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 613/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:39:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:15.291008 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5f806-b219-4b28-8938-5ed3665c4177 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:15.341301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:15.411911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5f806-b219-4b28-8938-5ed3665c4177 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:15.454978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b942f0-4497-435b-8a30-f5535e093b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:15.455966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b942f0-4497-435b-8a30-f5535e093b2d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:15.455966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b942f0-4497-435b-8a30-f5535e093b2d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:15.456308 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b942f0-4497-435b-8a30-f5535e093b2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:15.470819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b942f0-4497-435b-8a30-f5535e093b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:15.473394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b942f0-4497-435b-8a30-f5535e093b2d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-32b942f0-4497-435b-8a30-f5535e093b2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:39:15.497387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:15.498521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:15.499640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:39:15.499640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:39:15.499640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:15.499640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:15.499640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 611/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:15.505387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da092e1-8918-411c-aed6-263e4e128ba8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:15.631673 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da092e1-8918-411c-aed6-263e4e128ba8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:15.681290 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14c39c-be51-4152-8f89-c31a70be7804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:15.681830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14c39c-be51-4152-8f89-c31a70be7804 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:15.682679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14c39c-be51-4152-8f89-c31a70be7804 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:15.683040 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14c39c-be51-4152-8f89-c31a70be7804 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:15.683759 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14c39c-be51-4152-8f89-c31a70be7804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:15.684079 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14c39c-be51-4152-8f89-c31a70be7804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:15.685433 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14c39c-be51-4152-8f89-c31a70be7804 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:15.698770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 614/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:15.704615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b942f0-4497-435b-8a30-f5535e093b2d None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:15.823862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:15.832715 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b942f0-4497-435b-8a30-f5535e093b2d None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:15.873661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664c47d-360f-4dda-bd18-6e49ae9866e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:15.874304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c47d-360f-4dda-bd18-6e49ae9866e2 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:15.874631 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c47d-360f-4dda-bd18-6e49ae9866e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:15.874944 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c47d-360f-4dda-bd18-6e49ae9866e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:15.884337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664c47d-360f-4dda-bd18-6e49ae9866e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:15.886200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664c47d-360f-4dda-bd18-6e49ae9866e2 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-e664c47d-360f-4dda-bd18-6e49ae9866e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:39:15.898934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:15.900100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:15.901902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:15.901902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:15.901902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:39:15.901902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:39:15.901902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:39:15.901902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:39:15.901902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:39:15.901902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:39:15.901902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 10:39:15.901902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:15.905992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 612/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:39:15.906942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14c39c-be51-4152-8f89-c31a70be7804 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:15.967188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:16.027564 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14c39c-be51-4152-8f89-c31a70be7804 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:16.068849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a9b7b-d02d-4b19-a323-a9cb8dd4c08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:16.069737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a9b7b-d02d-4b19-a323-a9cb8dd4c08a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:16.070106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a9b7b-d02d-4b19-a323-a9cb8dd4c08a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:16.070453 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a9b7b-d02d-4b19-a323-a9cb8dd4c08a None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:16.071507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a9b7b-d02d-4b19-a323-a9cb8dd4c08a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:16.071918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a9b7b-d02d-4b19-a323-a9cb8dd4c08a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:16.074310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a9b7b-d02d-4b19-a323-a9cb8dd4c08a None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:16.093899 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 615/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Jul 27 10:39:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:39:16.100689 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664c47d-360f-4dda-bd18-6e49ae9866e2 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:16.226593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664c47d-360f-4dda-bd18-6e49ae9866e2 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:16.266575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f43491-0c50-4f41-9e42-f91444d7092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:16.267391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f43491-0c50-4f41-9e42-f91444d7092d None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:16.267677 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f43491-0c50-4f41-9e42-f91444d7092d None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:16.267992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f43491-0c50-4f41-9e42-f91444d7092d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:16.281798 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f43491-0c50-4f41-9e42-f91444d7092d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:16.283305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f43491-0c50-4f41-9e42-f91444d7092d None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-67f43491-0c50-4f41-9e42-f91444d7092d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:39:16.300498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:16.301502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:16.302447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:39:16.302447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:39:16.302447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:16.302447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:16.302447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 613/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:16.309057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a9b7b-d02d-4b19-a323-a9cb8dd4c08a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:16.428611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a9b7b-d02d-4b19-a323-a9cb8dd4c08a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:16.431201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:16.474756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd11c06-74d8-4276-8634-be6e3561dca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:16.475517 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11c06-74d8-4276-8634-be6e3561dca1 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:16.475802 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11c06-74d8-4276-8634-be6e3561dca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:16.476149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11c06-74d8-4276-8634-be6e3561dca1 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:16.476963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd11c06-74d8-4276-8634-be6e3561dca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:16.477224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd11c06-74d8-4276-8634-be6e3561dca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:16.479202 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd11c06-74d8-4276-8634-be6e3561dca1 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:16.493324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 616/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:16.500546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f43491-0c50-4f41-9e42-f91444d7092d None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:16.514376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:16.619174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f43491-0c50-4f41-9e42-f91444d7092d None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:16.658196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff8480-3358-4625-b921-ac2661bce429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:16.658902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff8480-3358-4625-b921-ac2661bce429 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:16.659184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff8480-3358-4625-b921-ac2661bce429 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:16.659455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff8480-3358-4625-b921-ac2661bce429 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:16.666702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff8480-3358-4625-b921-ac2661bce429 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:16.668429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff8480-3358-4625-b921-ac2661bce429 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-03ff8480-3358-4625-b921-ac2661bce429 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:39:16.681605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:16.683618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:16.684717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:39:16.684717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:39:16.684717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:39:16.684717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:39:16.684717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:39:16.684717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:39:16.684717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:39:16.684717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:16.684717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 614/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:39:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:16.689535 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd11c06-74d8-4276-8634-be6e3561dca1 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:16.804558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd11c06-74d8-4276-8634-be6e3561dca1 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:16.841565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44f66a-98a1-4c04-95a2-c50a15ff89e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:16.842205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44f66a-98a1-4c04-95a2-c50a15ff89e2 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:16.842491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44f66a-98a1-4c04-95a2-c50a15ff89e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:16.842761 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44f66a-98a1-4c04-95a2-c50a15ff89e2 None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:16.843563 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44f66a-98a1-4c04-95a2-c50a15ff89e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:16.843838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44f66a-98a1-4c04-95a2-c50a15ff89e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:16.845220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44f66a-98a1-4c04-95a2-c50a15ff89e2 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:16.857782 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 617/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:16.865151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff8480-3358-4625-b921-ac2661bce429 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:16.951234 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:16.998090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff8480-3358-4625-b921-ac2661bce429 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:17.036110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf554e3f-d84a-4a7f-833a-a1cd87f425ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:17.036798 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf554e3f-d84a-4a7f-833a-a1cd87f425ca None admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:17.037076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf554e3f-d84a-4a7f-833a-a1cd87f425ca None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:17.037348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf554e3f-d84a-4a7f-833a-a1cd87f425ca None admin] PATH_INFO: `/v3/projects/52e68e1a140146e28b504864955367c1/users/39830a354dee41b5b210d80807886299/roles/02a6ae14988149d38f9e819dc66b2f48` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:17.052650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf554e3f-d84a-4a7f-833a-a1cd87f425ca None admin] RBAC: Authorizing `identity:create_grant(project_id=52e68e1a140146e28b504864955367c1, user_id=39830a354dee41b5b210d80807886299, role_id=02a6ae14988149d38f9e819dc66b2f48)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:17.054409 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf554e3f-d84a-4a7f-833a-a1cd87f425ca None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:17.069124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 615/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:39:16 2022] PUT /identity/v3/projects/52e68e1a140146e28b504864955367c1/users/39830a354dee41b5b210d80807886299/roles/02a6ae14988149d38f9e819dc66b2f48 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:39:19.229625 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6acb7a-91f3-4c26-996e-a6dc242a7363 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:19.230231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6acb7a-91f3-4c26-996e-a6dc242a7363 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:19.230231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6acb7a-91f3-4c26-996e-a6dc242a7363 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:19.231453 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 618/1233] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:39:19.236748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2be1f5-014b-40a4-9142-729faea2ebc9 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:19.237214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2be1f5-014b-40a4-9142-729faea2ebc9 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:19.237320 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2be1f5-014b-40a4-9142-729faea2ebc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:19.255750 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-7c2be1f5-014b-40a4-9142-729faea2ebc9 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:39:19.256943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-7c2be1f5-014b-40a4-9142-729faea2ebc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:39:19.331554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 616/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:39:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:39:19.355243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6acb7a-91f3-4c26-996e-a6dc242a7363 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:19.383134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:19.478460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6acb7a-91f3-4c26-996e-a6dc242a7363 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:19.515685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26610eec-012c-46a0-844a-f759aa1f6531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:19.516248 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26610eec-012c-46a0-844a-f759aa1f6531 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:19.516524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26610eec-012c-46a0-844a-f759aa1f6531 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:19.516796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26610eec-012c-46a0-844a-f759aa1f6531 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:19.528061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26610eec-012c-46a0-844a-f759aa1f6531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-26610eec-012c-46a0-844a-f759aa1f6531 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:39:19.533674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:19.534748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:19.535613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:19.535613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:19.535613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:19.535613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:19.535613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:39:19.535613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:39:19.535613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:39:19.535613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:39:19.535613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:39:19.535613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:39:19.535613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 10:39:19.535613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:19.535613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 619/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jul 27 10:39:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:39:19.541940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2be1f5-014b-40a4-9142-729faea2ebc9 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:19.594376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:19.658848 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2be1f5-014b-40a4-9142-729faea2ebc9 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:19.696831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46670d-b0bd-4cf0-be25-190a0b0b42d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:19.698094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46670d-b0bd-4cf0-be25-190a0b0b42d0 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:19.698418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46670d-b0bd-4cf0-be25-190a0b0b42d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:19.698753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46670d-b0bd-4cf0-be25-190a0b0b42d0 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:19.699516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46670d-b0bd-4cf0-be25-190a0b0b42d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:19.699833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46670d-b0bd-4cf0-be25-190a0b0b42d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:19.701289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46670d-b0bd-4cf0-be25-190a0b0b42d0 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:19.709902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 617/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jul 27 10:39:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:19.716368 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26610eec-012c-46a0-844a-f759aa1f6531 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:19.808702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:19.825304 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26610eec-012c-46a0-844a-f759aa1f6531 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:19.863051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c822-f6fa-466c-b5e7-b427ab64c360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:19.863912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c822-f6fa-466c-b5e7-b427ab64c360 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:19.864224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c822-f6fa-466c-b5e7-b427ab64c360 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:19.864602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c822-f6fa-466c-b5e7-b427ab64c360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:19.878270 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72c822-f6fa-466c-b5e7-b427ab64c360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:19.879959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72c822-f6fa-466c-b5e7-b427ab64c360 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-0d72c822-f6fa-466c-b5e7-b427ab64c360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:39:19.898526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:19.899595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:19.900572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:39:19.900572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:39:19.900572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:19.900572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:19.900572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 620/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:19.905964 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46670d-b0bd-4cf0-be25-190a0b0b42d0 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:20.017652 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46670d-b0bd-4cf0-be25-190a0b0b42d0 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:20.027612 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:20.060478 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1603ba2-6f80-4d3b-8b03-ed594392f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:20.061909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1603ba2-6f80-4d3b-8b03-ed594392f66f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:20.062215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1603ba2-6f80-4d3b-8b03-ed594392f66f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:20.062489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1603ba2-6f80-4d3b-8b03-ed594392f66f None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:20.063193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1603ba2-6f80-4d3b-8b03-ed594392f66f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:20.063504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1603ba2-6f80-4d3b-8b03-ed594392f66f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:20.064871 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1603ba2-6f80-4d3b-8b03-ed594392f66f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:20.078294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 618/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:20.084577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c822-f6fa-466c-b5e7-b427ab64c360 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:20.204466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c822-f6fa-466c-b5e7-b427ab64c360 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:20.242506 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ae394-7952-4deb-b688-755f5454edb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:20.243172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ae394-7952-4deb-b688-755f5454edb8 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:20.243413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ae394-7952-4deb-b688-755f5454edb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:20.243683 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ae394-7952-4deb-b688-755f5454edb8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:20.247178 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:20.252856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ae394-7952-4deb-b688-755f5454edb8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:20.254476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ae394-7952-4deb-b688-755f5454edb8 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-7c3ae394-7952-4deb-b688-755f5454edb8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:39:20.267825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:20.268935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:20.270048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:20.270048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:20.270048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:39:20.270048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:39:20.270048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:39:20.270048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:39:20.270048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:39:20.270048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:39:20.270048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 10:39:20.270048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:20.270048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 621/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:20.275332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1603ba2-6f80-4d3b-8b03-ed594392f66f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:20.394560 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1603ba2-6f80-4d3b-8b03-ed594392f66f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:20.433395 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e79e0-4aaa-45dd-bbac-58e7ba644b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:20.434057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e79e0-4aaa-45dd-bbac-58e7ba644b30 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:20.434331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e79e0-4aaa-45dd-bbac-58e7ba644b30 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:20.434606 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e79e0-4aaa-45dd-bbac-58e7ba644b30 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:20.435415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e79e0-4aaa-45dd-bbac-58e7ba644b30 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:20.435721 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e79e0-4aaa-45dd-bbac-58e7ba644b30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:20.437202 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e79e0-4aaa-45dd-bbac-58e7ba644b30 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:20.458160 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 619/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Jul 27 10:39:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:20.464386 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ae394-7952-4deb-b688-755f5454edb8 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:20.584484 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ae394-7952-4deb-b688-755f5454edb8 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:20.624721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a873c-3d9c-4ccc-9c09-62856ed9b2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:20.625343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a873c-3d9c-4ccc-9c09-62856ed9b2c3 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:20.625674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a873c-3d9c-4ccc-9c09-62856ed9b2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:20.625949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a873c-3d9c-4ccc-9c09-62856ed9b2c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:20.698706 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:20.709975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a873c-3d9c-4ccc-9c09-62856ed9b2c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:20.713783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a873c-3d9c-4ccc-9c09-62856ed9b2c3 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:20.827776 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 622/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:39:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 10:39:20.833619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e79e0-4aaa-45dd-bbac-58e7ba644b30 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:20.863515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:20.954676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e79e0-4aaa-45dd-bbac-58e7ba644b30 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:20.996355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4545abf-7008-4957-8daa-93f9612b688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:20.997002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4545abf-7008-4957-8daa-93f9612b688f None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:20.997285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4545abf-7008-4957-8daa-93f9612b688f None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:20.998277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4545abf-7008-4957-8daa-93f9612b688f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:21.009922 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4545abf-7008-4957-8daa-93f9612b688f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:21.011882 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4545abf-7008-4957-8daa-93f9612b688f None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-b4545abf-7008-4957-8daa-93f9612b688f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:39:21.034135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:21.035349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:21.036492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:39:21.036492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:39:21.036492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:21.036492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:21.036492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 620/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:21.042370 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a873c-3d9c-4ccc-9c09-62856ed9b2c3 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:21.149342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:21.157810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a873c-3d9c-4ccc-9c09-62856ed9b2c3 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:21.197030 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848b7ee-f453-4d6e-93d0-6307c5dfebf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:21.197811 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848b7ee-f453-4d6e-93d0-6307c5dfebf9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:21.198100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848b7ee-f453-4d6e-93d0-6307c5dfebf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:21.198424 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848b7ee-f453-4d6e-93d0-6307c5dfebf9 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:21.199117 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848b7ee-f453-4d6e-93d0-6307c5dfebf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:21.199425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848b7ee-f453-4d6e-93d0-6307c5dfebf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:21.200794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848b7ee-f453-4d6e-93d0-6307c5dfebf9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:21.213946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 623/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:21.220123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4545abf-7008-4957-8daa-93f9612b688f None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:21.311907 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:21.334950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4545abf-7008-4957-8daa-93f9612b688f None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:21.370421 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e5399-c9ca-44f7-b743-375c8ae04dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:21.371075 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e5399-c9ca-44f7-b743-375c8ae04dc5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:21.371460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e5399-c9ca-44f7-b743-375c8ae04dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:21.371778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e5399-c9ca-44f7-b743-375c8ae04dc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:21.379396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e5399-c9ca-44f7-b743-375c8ae04dc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:21.381077 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e5399-c9ca-44f7-b743-375c8ae04dc5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-ca0e5399-c9ca-44f7-b743-375c8ae04dc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:39:21.394080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:21.395115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:21.396551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:39:21.396551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:39:21.396551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:39:21.396551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:39:21.396551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:39:21.396551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:39:21.396551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:39:21.396551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:21.396551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 621/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:21.402326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848b7ee-f453-4d6e-93d0-6307c5dfebf9 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:21.517953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848b7ee-f453-4d6e-93d0-6307c5dfebf9 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:21.553464 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb435a-d7ec-4e72-adc3-259d1ed7452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:21.554087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb435a-d7ec-4e72-adc3-259d1ed7452d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:21.554409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb435a-d7ec-4e72-adc3-259d1ed7452d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:21.554676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb435a-d7ec-4e72-adc3-259d1ed7452d None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:21.555418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb435a-d7ec-4e72-adc3-259d1ed7452d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:21.555724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb435a-d7ec-4e72-adc3-259d1ed7452d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:21.557431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb435a-d7ec-4e72-adc3-259d1ed7452d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:21.572741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 624/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:39:21.579097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e5399-c9ca-44f7-b743-375c8ae04dc5 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:21.712005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e5399-c9ca-44f7-b743-375c8ae04dc5 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:21.752990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfafff-aa97-4885-bd7b-1e4ee2723d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:21.753616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfafff-aa97-4885-bd7b-1e4ee2723d97 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:21.753899 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfafff-aa97-4885-bd7b-1e4ee2723d97 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:21.754173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfafff-aa97-4885-bd7b-1e4ee2723d97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:21.755005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfafff-aa97-4885-bd7b-1e4ee2723d97 None admin] RBAC: Adding query filter params (role.id=02a6ae14988149d38f9e819dc66b2f48, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=39830a354dee41b5b210d80807886299) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:21.755316 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfafff-aa97-4885-bd7b-1e4ee2723d97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:21.756742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfafff-aa97-4885-bd7b-1e4ee2723d97 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:21.763834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 622/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:39:21 2022] GET /identity/v3/role_assignments?user.id=39830a354dee41b5b210d80807886299&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=02a6ae14988149d38f9e819dc66b2f48 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:23.970304 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c322a-dec3-450f-98f1-9d9ccdc7afc5 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:23.970873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c322a-dec3-450f-98f1-9d9ccdc7afc5 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:23.970873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c322a-dec3-450f-98f1-9d9ccdc7afc5 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:23.972366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 625/1247] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:39:23.977793 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efb29a-b20f-45cb-a158-4b2c0565e2d7 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:23.978343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efb29a-b20f-45cb-a158-4b2c0565e2d7 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:23.978514 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efb29a-b20f-45cb-a158-4b2c0565e2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:23.985389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:24.000318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-d6efb29a-b20f-45cb-a158-4b2c0565e2d7 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:39:24.001577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d6efb29a-b20f-45cb-a158-4b2c0565e2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:39:24.083484 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 623/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:39:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:39:24.107680 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c322a-dec3-450f-98f1-9d9ccdc7afc5 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:24.129969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:24.233822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c322a-dec3-450f-98f1-9d9ccdc7afc5 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:24.275352 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeaeea9-54a5-4f2c-bb27-03da1f6c9f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:24.276018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaeea9-54a5-4f2c-bb27-03da1f6c9f53 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:24.276389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaeea9-54a5-4f2c-bb27-03da1f6c9f53 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:24.276689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaeea9-54a5-4f2c-bb27-03da1f6c9f53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:24.288213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeaeea9-54a5-4f2c-bb27-03da1f6c9f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-afeaeea9-54a5-4f2c-bb27-03da1f6c9f53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:39:24.293887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:24.295269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:24.296230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:24.296230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:24.296230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:24.296230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:24.296230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:39:24.296230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:39:24.296230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:39:24.296230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:39:24.296230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:39:24.296230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:39:24.296230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:39:24.296230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:24.296230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 626/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:39:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:24.301800 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efb29a-b20f-45cb-a158-4b2c0565e2d7 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:24.419132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efb29a-b20f-45cb-a158-4b2c0565e2d7 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:24.459061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:24.466415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbae730-0b52-48dd-b199-0746acc77668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:24.467389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbae730-0b52-48dd-b199-0746acc77668 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:24.468051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbae730-0b52-48dd-b199-0746acc77668 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:24.468522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbae730-0b52-48dd-b199-0746acc77668 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:24.469597 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbae730-0b52-48dd-b199-0746acc77668 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:24.470234 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbae730-0b52-48dd-b199-0746acc77668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:24.475148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbae730-0b52-48dd-b199-0746acc77668 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:24.485870 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 624/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:39:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:39:24.492468 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeaeea9-54a5-4f2c-bb27-03da1f6c9f53 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:24.583269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:24.614038 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeaeea9-54a5-4f2c-bb27-03da1f6c9f53 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:24.663917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1376cae-2524-4b97-8e07-7eb85c917624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:24.664618 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1376cae-2524-4b97-8e07-7eb85c917624 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:24.664941 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1376cae-2524-4b97-8e07-7eb85c917624 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:24.665115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1376cae-2524-4b97-8e07-7eb85c917624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:24.678877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1376cae-2524-4b97-8e07-7eb85c917624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:24.680249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1376cae-2524-4b97-8e07-7eb85c917624 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-a1376cae-2524-4b97-8e07-7eb85c917624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:39:24.698398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:24.699719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:24.700909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:39:24.700909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:39:24.700909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:24.700909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:24.700909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 627/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:24.705577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbae730-0b52-48dd-b199-0746acc77668 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:24.831591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbae730-0b52-48dd-b199-0746acc77668 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:24.870415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf81e0-7b78-40ea-8cfc-436ca7d43858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:24.871335 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf81e0-7b78-40ea-8cfc-436ca7d43858 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:24.871621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf81e0-7b78-40ea-8cfc-436ca7d43858 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:24.871896 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf81e0-7b78-40ea-8cfc-436ca7d43858 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:24.872784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf81e0-7b78-40ea-8cfc-436ca7d43858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:24.873092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf81e0-7b78-40ea-8cfc-436ca7d43858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:24.874694 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf81e0-7b78-40ea-8cfc-436ca7d43858 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:24.890572 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 625/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:24.896196 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1376cae-2524-4b97-8e07-7eb85c917624 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:25.020411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1376cae-2524-4b97-8e07-7eb85c917624 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:25.056107 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:25.069166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9595c0-fe44-4229-ae7d-383b63785a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:25.069909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9595c0-fe44-4229-ae7d-383b63785a06 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:25.070271 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9595c0-fe44-4229-ae7d-383b63785a06 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:25.070662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9595c0-fe44-4229-ae7d-383b63785a06 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:25.081798 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9595c0-fe44-4229-ae7d-383b63785a06 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:25.083455 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9595c0-fe44-4229-ae7d-383b63785a06 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-4d9595c0-fe44-4229-ae7d-383b63785a06 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:39:25.097288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:25.098566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:25.099567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:25.099567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:25.099567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:39:25.099567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:39:25.099567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:39:25.099567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:39:25.099567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:39:25.099567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:39:25.099567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 10:39:25.099567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:25.099567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 628/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:25.105008 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf81e0-7b78-40ea-8cfc-436ca7d43858 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:25.170309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:25.220619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf81e0-7b78-40ea-8cfc-436ca7d43858 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:25.257488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a766e9-79d5-4668-ba87-ed57426fdfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:25.258205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a766e9-79d5-4668-ba87-ed57426fdfe3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:25.258519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a766e9-79d5-4668-ba87-ed57426fdfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:25.258832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a766e9-79d5-4668-ba87-ed57426fdfe3 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:25.259930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a766e9-79d5-4668-ba87-ed57426fdfe3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:25.260257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a766e9-79d5-4668-ba87-ed57426fdfe3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:25.261712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a766e9-79d5-4668-ba87-ed57426fdfe3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:25.281216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 626/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Jul 27 10:39:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:25.287186 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9595c0-fe44-4229-ae7d-383b63785a06 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:25.411557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9595c0-fe44-4229-ae7d-383b63785a06 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:25.459238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d45f9-bd4d-4f27-81b9-271ae9f2468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:25.460061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d45f9-bd4d-4f27-81b9-271ae9f2468f None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:25.460451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d45f9-bd4d-4f27-81b9-271ae9f2468f None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:25.460833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d45f9-bd4d-4f27-81b9-271ae9f2468f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:25.530316 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:25.546261 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d45f9-bd4d-4f27-81b9-271ae9f2468f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:25.547829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d45f9-bd4d-4f27-81b9-271ae9f2468f None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:25.674676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 629/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:39:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:39:25.682425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a766e9-79d5-4668-ba87-ed57426fdfe3 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:25.794121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a766e9-79d5-4668-ba87-ed57426fdfe3 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:25.809618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:25.834045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd0a09-1aab-4f5f-9cfb-b4625f9c1e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:25.834791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd0a09-1aab-4f5f-9cfb-b4625f9c1e07 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:25.835073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd0a09-1aab-4f5f-9cfb-b4625f9c1e07 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:25.835349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd0a09-1aab-4f5f-9cfb-b4625f9c1e07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:25.847286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd0a09-1aab-4f5f-9cfb-b4625f9c1e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:25.848812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd0a09-1aab-4f5f-9cfb-b4625f9c1e07 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-d7cd0a09-1aab-4f5f-9cfb-b4625f9c1e07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:39:25.865046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:25.866172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:25.867253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:39:25.867253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:39:25.867253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:25.867253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:25.867253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 627/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:25.872661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d45f9-bd4d-4f27-81b9-271ae9f2468f None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:25.972890 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:25.986530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d45f9-bd4d-4f27-81b9-271ae9f2468f None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:26.026624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca2785-31a5-4795-b8c5-fd2a5c86b5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:26.027473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca2785-31a5-4795-b8c5-fd2a5c86b5b5 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:26.027864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca2785-31a5-4795-b8c5-fd2a5c86b5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:26.028239 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca2785-31a5-4795-b8c5-fd2a5c86b5b5 None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:26.029061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca2785-31a5-4795-b8c5-fd2a5c86b5b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:26.029521 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca2785-31a5-4795-b8c5-fd2a5c86b5b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:26.031060 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca2785-31a5-4795-b8c5-fd2a5c86b5b5 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:26.045703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 630/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:39:26.051545 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd0a09-1aab-4f5f-9cfb-b4625f9c1e07 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:26.164763 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd0a09-1aab-4f5f-9cfb-b4625f9c1e07 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:26.203232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1fd5f-6f55-4715-b8f4-d78325517781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:26.203878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1fd5f-6f55-4715-b8f4-d78325517781 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:26.204157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1fd5f-6f55-4715-b8f4-d78325517781 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:26.204429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1fd5f-6f55-4715-b8f4-d78325517781 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:26.211636 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1fd5f-6f55-4715-b8f4-d78325517781 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:26.213331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1fd5f-6f55-4715-b8f4-d78325517781 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-e4f1fd5f-6f55-4715-b8f4-d78325517781 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:39:26.228009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:26.229193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:26.230503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:39:26.230503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:39:26.230503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:39:26.230503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:39:26.230503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:39:26.230503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:39:26.230503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:39:26.230503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:26.230503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 628/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:39:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:26.235649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca2785-31a5-4795-b8c5-fd2a5c86b5b5 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:26.359150 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca2785-31a5-4795-b8c5-fd2a5c86b5b5 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:26.404357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfef23-23e6-4202-86d5-1230de3f417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:26.405173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfef23-23e6-4202-86d5-1230de3f417e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:26.405574 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfef23-23e6-4202-86d5-1230de3f417e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:26.405925 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfef23-23e6-4202-86d5-1230de3f417e None admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:26.406720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfef23-23e6-4202-86d5-1230de3f417e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:26.407034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfef23-23e6-4202-86d5-1230de3f417e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:26.408463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dfef23-23e6-4202-86d5-1230de3f417e None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:26.425103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 631/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:39:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:26.432151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1fd5f-6f55-4715-b8f4-d78325517781 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:26.461665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:26.558597 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1fd5f-6f55-4715-b8f4-d78325517781 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:26.597590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee0084-558e-4b8b-97d4-e97a47fed77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:26.598284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0084-558e-4b8b-97d4-e97a47fed77b None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:26.598524 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0084-558e-4b8b-97d4-e97a47fed77b None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:26.598797 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0084-558e-4b8b-97d4-e97a47fed77b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:26.599588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee0084-558e-4b8b-97d4-e97a47fed77b None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=39830a354dee41b5b210d80807886299) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:26.599897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee0084-558e-4b8b-97d4-e97a47fed77b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:26.601340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee0084-558e-4b8b-97d4-e97a47fed77b None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:26.610688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 629/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:39:26 2022] GET /identity/v3/role_assignments?user.id=39830a354dee41b5b210d80807886299&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=36208a24005e4ff98d827138292bea37 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:39:28.622708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3f24f-38fd-487a-856d-e3ba2d4680ca None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:28.623267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3f24f-38fd-487a-856d-e3ba2d4680ca None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:28.623267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3f24f-38fd-487a-856d-e3ba2d4680ca None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:28.624706 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 632/1261] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:39:28.629987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3823-07b5-4cbd-b29d-2efc3b8fccee None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:28.630541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3823-07b5-4cbd-b29d-2efc3b8fccee None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:28.630635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3823-07b5-4cbd-b29d-2efc3b8fccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:28.649469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-8c5a3823-07b5-4cbd-b29d-2efc3b8fccee None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:39:28.650853 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-8c5a3823-07b5-4cbd-b29d-2efc3b8fccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:39:28.716816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 630/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:39:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:39:28.738606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3f24f-38fd-487a-856d-e3ba2d4680ca None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:28.749847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:28.839750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3f24f-38fd-487a-856d-e3ba2d4680ca None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:28.875434 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f0fc4-911f-4485-ac68-c904ddc2e63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:28.876040 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0fc4-911f-4485-ac68-c904ddc2e63a None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:28.876327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0fc4-911f-4485-ac68-c904ddc2e63a None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:28.876606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0fc4-911f-4485-ac68-c904ddc2e63a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:28.888227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f0fc4-911f-4485-ac68-c904ddc2e63a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-909f0fc4-911f-4485-ac68-c904ddc2e63a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:39:28.893229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:28.894397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:28.895495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:28.895495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:28.895495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:28.895495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:28.895495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:39:28.895495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:39:28.895495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:39:28.895495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:39:28.895495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:39:28.895495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:39:28.895495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:39:28.895495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:28.895495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 633/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:39:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:28.900919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a3823-07b5-4cbd-b29d-2efc3b8fccee None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:28.919923 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:29.003858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a3823-07b5-4cbd-b29d-2efc3b8fccee None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:29.038075 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48ee0f-50ad-4307-9b8d-aff8d23c3b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:29.038721 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48ee0f-50ad-4307-9b8d-aff8d23c3b43 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:29.039008 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48ee0f-50ad-4307-9b8d-aff8d23c3b43 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:29.039284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48ee0f-50ad-4307-9b8d-aff8d23c3b43 None admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:29.040000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48ee0f-50ad-4307-9b8d-aff8d23c3b43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:29.040306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48ee0f-50ad-4307-9b8d-aff8d23c3b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:29.041713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48ee0f-50ad-4307-9b8d-aff8d23c3b43 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:29.049732 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 631/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:39:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:39:29.055859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f0fc4-911f-4485-ac68-c904ddc2e63a None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:29.129076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:29.164274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f0fc4-911f-4485-ac68-c904ddc2e63a None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:29.198516 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f3c6f-798f-4683-a147-d4f1614df013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:29.199199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f3c6f-798f-4683-a147-d4f1614df013 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:29.199495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f3c6f-798f-4683-a147-d4f1614df013 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:29.199785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f3c6f-798f-4683-a147-d4f1614df013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:29.210936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f3c6f-798f-4683-a147-d4f1614df013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:29.212536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f3c6f-798f-4683-a147-d4f1614df013 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-7f9f3c6f-798f-4683-a147-d4f1614df013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:39:29.227029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:29.228914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:29.230155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:39:29.230155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:39:29.230155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:29.230155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:29.230155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 634/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:29.234095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48ee0f-50ad-4307-9b8d-aff8d23c3b43 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:29.315653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:29.335165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48ee0f-50ad-4307-9b8d-aff8d23c3b43 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:29.367612 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc26143-c2b1-45bb-b4d1-e1194ce162a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:29.368215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc26143-c2b1-45bb-b4d1-e1194ce162a3 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:29.369020 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc26143-c2b1-45bb-b4d1-e1194ce162a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:29.369294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc26143-c2b1-45bb-b4d1-e1194ce162a3 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:29.369989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc26143-c2b1-45bb-b4d1-e1194ce162a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:29.370322 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc26143-c2b1-45bb-b4d1-e1194ce162a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:29.371681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc26143-c2b1-45bb-b4d1-e1194ce162a3 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:29.383751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 632/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:29.390401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f3c6f-798f-4683-a147-d4f1614df013 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:29.503726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f3c6f-798f-4683-a147-d4f1614df013 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:29.523599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:29.537720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab65f65-7215-4c4a-8862-079466c1095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:29.538398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab65f65-7215-4c4a-8862-079466c1095e None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:29.538680 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab65f65-7215-4c4a-8862-079466c1095e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:29.538953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab65f65-7215-4c4a-8862-079466c1095e None admin] PATH_INFO: `/v3/users/placement` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:29.546964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab65f65-7215-4c4a-8862-079466c1095e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:29.548393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab65f65-7215-4c4a-8862-079466c1095e None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-9ab65f65-7215-4c4a-8862-079466c1095e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:39:29.560515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:29.561610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:29.562863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:29.562863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:29.562863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:39:29.562863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:39:29.562863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:39:29.562863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:39:29.562863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:39:29.562863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:39:29.562863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 10:39:29.562863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:29.562863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 635/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:29.567600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc26143-c2b1-45bb-b4d1-e1194ce162a3 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:29.671341 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc26143-c2b1-45bb-b4d1-e1194ce162a3 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:29.704924 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc89023-ce5f-4745-8625-7c241654d9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:29.705537 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc89023-ce5f-4745-8625-7c241654d9a2 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:29.705822 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc89023-ce5f-4745-8625-7c241654d9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:29.706099 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc89023-ce5f-4745-8625-7c241654d9a2 None admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:29.706927 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc89023-ce5f-4745-8625-7c241654d9a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:29.707238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc89023-ce5f-4745-8625-7c241654d9a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:29.708666 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc89023-ce5f-4745-8625-7c241654d9a2 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:29.717255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:29.726735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 633/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Jul 27 10:39:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:29.733134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab65f65-7215-4c4a-8862-079466c1095e None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:29.831377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab65f65-7215-4c4a-8862-079466c1095e None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:29.864254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db53532-0d1c-4efa-aaa1-cd27a9e13715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:29.864884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db53532-0d1c-4efa-aaa1-cd27a9e13715 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:29.865164 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db53532-0d1c-4efa-aaa1-cd27a9e13715 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:29.865439 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db53532-0d1c-4efa-aaa1-cd27a9e13715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:29.876884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db53532-0d1c-4efa-aaa1-cd27a9e13715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:29.878396 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db53532-0d1c-4efa-aaa1-cd27a9e13715 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-2db53532-0d1c-4efa-aaa1-cd27a9e13715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:39:29.892441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:29.893377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:29.894333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:39:29.894333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:39:29.894333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:29.894333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:29.894333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 636/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:29.899479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc89023-ce5f-4745-8625-7c241654d9a2 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:29.998733 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc89023-ce5f-4745-8625-7c241654d9a2 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:30.032252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3961132-e046-48c1-a633-004dfb59704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:30.032866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3961132-e046-48c1-a633-004dfb59704b None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:30.033146 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3961132-e046-48c1-a633-004dfb59704b None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:30.033420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3961132-e046-48c1-a633-004dfb59704b None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:30.034122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3961132-e046-48c1-a633-004dfb59704b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:30.034460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3961132-e046-48c1-a633-004dfb59704b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:30.035837 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3961132-e046-48c1-a633-004dfb59704b None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:30.047496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 634/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:30.053420 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db53532-0d1c-4efa-aaa1-cd27a9e13715 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:30.084359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:30.154117 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db53532-0d1c-4efa-aaa1-cd27a9e13715 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:30.187896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218d312-8fb9-49f9-89a0-bed9a1690a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:30.188530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218d312-8fb9-49f9-89a0-bed9a1690a94 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:30.188893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218d312-8fb9-49f9-89a0-bed9a1690a94 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:30.189094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218d312-8fb9-49f9-89a0-bed9a1690a94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:30.195831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218d312-8fb9-49f9-89a0-bed9a1690a94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:30.197511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218d312-8fb9-49f9-89a0-bed9a1690a94 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-a218d312-8fb9-49f9-89a0-bed9a1690a94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:39:30.209355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:30.210443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:30.211569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:39:30.211569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:39:30.211569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:39:30.211569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:39:30.211569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:39:30.211569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:39:30.211569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:39:30.211569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:30.211569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 637/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:30.217078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3961132-e046-48c1-a633-004dfb59704b None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:30.278058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:30.321094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3961132-e046-48c1-a633-004dfb59704b None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:30.356518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7eac9-47e0-4266-a9fe-987951e653d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:30.357128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7eac9-47e0-4266-a9fe-987951e653d9 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:30.357408 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7eac9-47e0-4266-a9fe-987951e653d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:30.357682 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7eac9-47e0-4266-a9fe-987951e653d9 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:30.358460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7eac9-47e0-4266-a9fe-987951e653d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:30.358778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7eac9-47e0-4266-a9fe-987951e653d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:30.360209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7eac9-47e0-4266-a9fe-987951e653d9 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:30.372270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 635/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:30.378452 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218d312-8fb9-49f9-89a0-bed9a1690a94 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:30.478542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:30.487218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218d312-8fb9-49f9-89a0-bed9a1690a94 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:30.519903 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24e87d-91c1-4eef-a8a8-49f2515ef579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:30.520561 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24e87d-91c1-4eef-a8a8-49f2515ef579 None admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:30.520840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24e87d-91c1-4eef-a8a8-49f2515ef579 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:30.521112 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24e87d-91c1-4eef-a8a8-49f2515ef579 None admin] PATH_INFO: `/v3/projects/52e68e1a140146e28b504864955367c1/users/39830a354dee41b5b210d80807886299/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:30.523026 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24e87d-91c1-4eef-a8a8-49f2515ef579 None admin] RBAC: Authorizing `identity:create_grant(project_id=52e68e1a140146e28b504864955367c1, user_id=39830a354dee41b5b210d80807886299, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:30.524444 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24e87d-91c1-4eef-a8a8-49f2515ef579 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:30.536971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 638/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jul 27 10:39:30 2022] PUT /identity/v3/projects/52e68e1a140146e28b504864955367c1/users/39830a354dee41b5b210d80807886299/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:39:32.557115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee126f-25bd-41ef-9553-68793259a7c6 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:32.557689 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee126f-25bd-41ef-9553-68793259a7c6 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:32.557689 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee126f-25bd-41ef-9553-68793259a7c6 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:32.559037 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 636/1274] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:39:32.564308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6428d0c-d39f-45ad-9003-4d51f9fb90d1 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:32.564749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6428d0c-d39f-45ad-9003-4d51f9fb90d1 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:32.564853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6428d0c-d39f-45ad-9003-4d51f9fb90d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:32.583181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-b6428d0c-d39f-45ad-9003-4d51f9fb90d1 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:39:32.584368 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b6428d0c-d39f-45ad-9003-4d51f9fb90d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:39:32.655357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 639/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:39:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:39:32.679074 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee126f-25bd-41ef-9553-68793259a7c6 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:32.778159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee126f-25bd-41ef-9553-68793259a7c6 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:32.795577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:32.813665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aba22d-1752-4a91-a0d5-6a6b4bc2ce67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:32.814264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba22d-1752-4a91-a0d5-6a6b4bc2ce67 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:32.814554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba22d-1752-4a91-a0d5-6a6b4bc2ce67 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:32.814837 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba22d-1752-4a91-a0d5-6a6b4bc2ce67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:32.825341 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aba22d-1752-4a91-a0d5-6a6b4bc2ce67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-49aba22d-1752-4a91-a0d5-6a6b4bc2ce67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 10:39:32.830253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:32.831356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:32.832327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:32.832327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:32.832327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:32.832327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:32.832327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 10:39:32.832327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 10:39:32.832327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 10:39:32.832327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 10:39:32.832327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 10:39:32.832327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 10:39:32.832327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 10:39:32.832327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:32.834519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 637/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jul 27 10:39:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:32.837652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6428d0c-d39f-45ad-9003-4d51f9fb90d1 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:32.919036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:32.938698 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6428d0c-d39f-45ad-9003-4d51f9fb90d1 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:32.972194 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb361792-b675-47a2-ada2-bad764a44628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:32.972817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb361792-b675-47a2-ada2-bad764a44628 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:32.973101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb361792-b675-47a2-ada2-bad764a44628 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:32.973379 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb361792-b675-47a2-ada2-bad764a44628 None admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:32.974130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb361792-b675-47a2-ada2-bad764a44628 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:32.974468 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb361792-b675-47a2-ada2-bad764a44628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:32.975859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb361792-b675-47a2-ada2-bad764a44628 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:32.984787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 640/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jul 27 10:39:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:32.990542 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aba22d-1752-4a91-a0d5-6a6b4bc2ce67 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:33.090290 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aba22d-1752-4a91-a0d5-6a6b4bc2ce67 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:33.124773 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2686b4-b7d4-4e4a-a614-6e571de95763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:33.125406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2686b4-b7d4-4e4a-a614-6e571de95763 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:33.125692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2686b4-b7d4-4e4a-a614-6e571de95763 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:33.125970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2686b4-b7d4-4e4a-a614-6e571de95763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:33.136036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2686b4-b7d4-4e4a-a614-6e571de95763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:33.137483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2686b4-b7d4-4e4a-a614-6e571de95763 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-9a2686b4-b7d4-4e4a-a614-6e571de95763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:39:33.152570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:33.153665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:33.155142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:39:33.155142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:39:33.155142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:33.155142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:33.155142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 638/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 10:39:33.160705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb361792-b675-47a2-ada2-bad764a44628 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:33.265502 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb361792-b675-47a2-ada2-bad764a44628 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:33.300267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321617e7-55cd-4222-9179-a280a7c1c80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:33.300885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321617e7-55cd-4222-9179-a280a7c1c80d None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:33.301172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321617e7-55cd-4222-9179-a280a7c1c80d None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:33.301453 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321617e7-55cd-4222-9179-a280a7c1c80d None admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:33.302143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321617e7-55cd-4222-9179-a280a7c1c80d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:33.302488 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321617e7-55cd-4222-9179-a280a7c1c80d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:33.304134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321617e7-55cd-4222-9179-a280a7c1c80d None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:33.315945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 641/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:33.322476 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2686b4-b7d4-4e4a-a614-6e571de95763 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:33.354143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:33.422521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2686b4-b7d4-4e4a-a614-6e571de95763 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:33.459600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3968e-0d20-4f2a-b311-74bea39699c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:33.460248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3968e-0d20-4f2a-b311-74bea39699c6 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:33.460529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3968e-0d20-4f2a-b311-74bea39699c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:33.460803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3968e-0d20-4f2a-b311-74bea39699c6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:33.469645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3968e-0d20-4f2a-b311-74bea39699c6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:33.471128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3968e-0d20-4f2a-b311-74bea39699c6 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-39c3968e-0d20-4f2a-b311-74bea39699c6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 10:39:33.483053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:33.484209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:33.485269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:33.485269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:33.485269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 10:39:33.485269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 10:39:33.485269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 10:39:33.485269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 10:39:33.485269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 10:39:33.485269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 10:39:33.485269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 10:39:33.485269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:33.485269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 639/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:33.490785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321617e7-55cd-4222-9179-a280a7c1c80d None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:33.495410 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:33.593074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321617e7-55cd-4222-9179-a280a7c1c80d None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:33.625981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7895b-77ca-46e9-b2da-28805c0276ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:33.626632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7895b-77ca-46e9-b2da-28805c0276ba None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:33.626917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7895b-77ca-46e9-b2da-28805c0276ba None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:33.627194 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7895b-77ca-46e9-b2da-28805c0276ba None admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:33.627996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7895b-77ca-46e9-b2da-28805c0276ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:33.628311 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7895b-77ca-46e9-b2da-28805c0276ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:33.629737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7895b-77ca-46e9-b2da-28805c0276ba None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:33.648368 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 642/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Jul 27 10:39:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:33.655132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3968e-0d20-4f2a-b311-74bea39699c6 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:33.748554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:33.758641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3968e-0d20-4f2a-b311-74bea39699c6 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:33.794048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d8623-0e0f-4c8d-8591-8bf41fe5ab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:33.794695 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d8623-0e0f-4c8d-8591-8bf41fe5ab44 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:33.794979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d8623-0e0f-4c8d-8591-8bf41fe5ab44 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:33.795257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d8623-0e0f-4c8d-8591-8bf41fe5ab44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:33.862713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d8623-0e0f-4c8d-8591-8bf41fe5ab44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:33.864155 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d8623-0e0f-4c8d-8591-8bf41fe5ab44 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:33.952408 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:33.963304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 640/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jul 27 10:39:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 10:39:33.969212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7895b-77ca-46e9-b2da-28805c0276ba None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:34.029539 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:34.068334 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7895b-77ca-46e9-b2da-28805c0276ba None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:34.102469 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0193b-2a70-4d65-99f9-b559b5db03b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:34.103278 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0193b-2a70-4d65-99f9-b559b5db03b3 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:34.103592 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0193b-2a70-4d65-99f9-b559b5db03b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:34.103871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0193b-2a70-4d65-99f9-b559b5db03b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:34.113931 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0193b-2a70-4d65-99f9-b559b5db03b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:34.115389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0193b-2a70-4d65-99f9-b559b5db03b3 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-71c0193b-2a70-4d65-99f9-b559b5db03b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 10:39:34.129692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:34.130788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:34.131900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 10:39:34.131900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 10:39:34.131900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 10:39:34.131900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:34.131900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 643/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:34.138076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d8623-0e0f-4c8d-8591-8bf41fe5ab44 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:34.238648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d8623-0e0f-4c8d-8591-8bf41fe5ab44 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:34.272091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0a84a-b2bf-43c0-9931-e9006e26c417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:34.272701 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a84a-b2bf-43c0-9931-e9006e26c417 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:34.272983 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a84a-b2bf-43c0-9931-e9006e26c417 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:34.273257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a84a-b2bf-43c0-9931-e9006e26c417 None admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:34.273946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0a84a-b2bf-43c0-9931-e9006e26c417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:34.274279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0a84a-b2bf-43c0-9931-e9006e26c417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:34.276332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0a84a-b2bf-43c0-9931-e9006e26c417 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:34.287500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 641/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jul 27 10:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:34.293440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0193b-2a70-4d65-99f9-b559b5db03b3 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:34.395996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0193b-2a70-4d65-99f9-b559b5db03b3 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:34.410474 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:34.436002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554cb4a-57b4-4c0b-833b-42ae4251cbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:34.436641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554cb4a-57b4-4c0b-833b-42ae4251cbc9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:34.436922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554cb4a-57b4-4c0b-833b-42ae4251cbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:34.437194 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554cb4a-57b4-4c0b-833b-42ae4251cbc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:34.444385 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554cb4a-57b4-4c0b-833b-42ae4251cbc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:34.445821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554cb4a-57b4-4c0b-833b-42ae4251cbc9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application [None req-8554cb4a-57b4-4c0b-833b-42ae4251cbc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 10:39:34.457888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:34.459021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:34.464862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 10:39:34.464862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 10:39:34.464862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 10:39:34.464862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 10:39:34.464862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 10:39:34.464862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 10:39:34.464862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 10:39:34.464862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: ERROR keystone.server.flask.application Jul 27 10:39:34.464862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 644/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jul 27 10:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:34.465468 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0a84a-b2bf-43c0-9931-e9006e26c417 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:34.515257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:34.565609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0a84a-b2bf-43c0-9931-e9006e26c417 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:34.599963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f71f3-cb59-4575-ad1e-3a12a48fed49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:34.600580 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f71f3-cb59-4575-ad1e-3a12a48fed49 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:34.600866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f71f3-cb59-4575-ad1e-3a12a48fed49 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:34.601145 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f71f3-cb59-4575-ad1e-3a12a48fed49 None admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:34.601898 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f71f3-cb59-4575-ad1e-3a12a48fed49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:34.602229 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f71f3-cb59-4575-ad1e-3a12a48fed49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:34.603960 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f71f3-cb59-4575-ad1e-3a12a48fed49 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:34.616590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 642/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jul 27 10:39:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:34.623289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554cb4a-57b4-4c0b-833b-42ae4251cbc9 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:34.722843 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554cb4a-57b4-4c0b-833b-42ae4251cbc9 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:34.755801 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e3612-c67e-4287-baaf-1081ccc898e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:34.756402 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e3612-c67e-4287-baaf-1081ccc898e5 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:34.756681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e3612-c67e-4287-baaf-1081ccc898e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:34.756951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e3612-c67e-4287-baaf-1081ccc898e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:34.757726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e3612-c67e-4287-baaf-1081ccc898e5 None admin] RBAC: Adding query filter params (role.id=36208a24005e4ff98d827138292bea37, scope.project.id=52e68e1a140146e28b504864955367c1, user.id=39830a354dee41b5b210d80807886299) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:34.758032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e3612-c67e-4287-baaf-1081ccc898e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:34.759623 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e3612-c67e-4287-baaf-1081ccc898e5 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:34.765377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 645/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jul 27 10:39:34 2022] GET /identity/v3/role_assignments?user.id=39830a354dee41b5b210d80807886299&scope.project.id=52e68e1a140146e28b504864955367c1&role.id=36208a24005e4ff98d827138292bea37 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:36.806767 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cdf35-d26b-4fb6-be5e-f9546aaec6cb None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:36.807326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cdf35-d26b-4fb6-be5e-f9546aaec6cb None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:36.807326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cdf35-d26b-4fb6-be5e-f9546aaec6cb None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:36.808683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 643/1288] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:39:36.814152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e263888-d2d1-4af8-9a1e-e15b04bc2dac None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:36.814616 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e263888-d2d1-4af8-9a1e-e15b04bc2dac None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:36.814731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e263888-d2d1-4af8-9a1e-e15b04bc2dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:36.832619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-5e263888-d2d1-4af8-9a1e-e15b04bc2dac None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:39:36.833798 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5e263888-d2d1-4af8-9a1e-e15b04bc2dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:39:36.864041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:36.905004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 646/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:39:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:39:36.927838 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cdf35-d26b-4fb6-be5e-f9546aaec6cb None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:37.039580 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cdf35-d26b-4fb6-be5e-f9546aaec6cb None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:37.051523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:37.076713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74d125-4767-4859-a8f2-d737c32e3755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:37.077278 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74d125-4767-4859-a8f2-d737c32e3755 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:37.077565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74d125-4767-4859-a8f2-d737c32e3755 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:37.077840 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74d125-4767-4859-a8f2-d737c32e3755 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:37.078563 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74d125-4767-4859-a8f2-d737c32e3755 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:37.079943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74d125-4767-4859-a8f2-d737c32e3755 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-0d74d125-4767-4859-a8f2-d737c32e3755 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:37.089360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:37.095412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:37.096376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 644/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jul 27 10:39:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:37.097212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e263888-d2d1-4af8-9a1e-e15b04bc2dac None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:37.194932 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e263888-d2d1-4af8-9a1e-e15b04bc2dac None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:37.232142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05aff4f-6a67-477d-bc1f-262a32aa23cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:37.232758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aff4f-6a67-477d-bc1f-262a32aa23cd None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:37.233040 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aff4f-6a67-477d-bc1f-262a32aa23cd None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:37.233318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05aff4f-6a67-477d-bc1f-262a32aa23cd None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:37.233998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05aff4f-6a67-477d-bc1f-262a32aa23cd None admin] RBAC: Adding query filter params (name=placement) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:37.234338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05aff4f-6a67-477d-bc1f-262a32aa23cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:37.235704 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05aff4f-6a67-477d-bc1f-262a32aa23cd None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:37.240660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 647/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Wed Jul 27 10:39:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:37.246467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74d125-4767-4859-a8f2-d737c32e3755 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:37.345652 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74d125-4767-4859-a8f2-d737c32e3755 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:37.379968 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad4549-a9b9-4765-810f-00457362b6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:37.380588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad4549-a9b9-4765-810f-00457362b6db None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:37.380869 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad4549-a9b9-4765-810f-00457362b6db None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:37.381146 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad4549-a9b9-4765-810f-00457362b6db None admin] PATH_INFO: `/v3/services` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:37.381827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad4549-a9b9-4765-810f-00457362b6db None admin] RBAC: Adding query filter params (type=placement) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:37.382135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad4549-a9b9-4765-810f-00457362b6db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:37.384138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad4549-a9b9-4765-810f-00457362b6db None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:37.388751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 645/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Wed Jul 27 10:39:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:39.378080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802988e-eaf5-4841-8ac4-30500e8b699c None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:39.378646 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802988e-eaf5-4841-8ac4-30500e8b699c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:39.378756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802988e-eaf5-4841-8ac4-30500e8b699c None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:39.380019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 648/1293] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:39:39.385993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67f308-2d4d-46b7-9997-e6a57fd226c8 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:39.386475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67f308-2d4d-46b7-9997-e6a57fd226c8 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:39.386568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67f308-2d4d-46b7-9997-e6a57fd226c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:39.405267 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-2b67f308-2d4d-46b7-9997-e6a57fd226c8 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:39:39.406498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-2b67f308-2d4d-46b7-9997-e6a57fd226c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:39:39.441610 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:39.489012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 646/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:39:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:39:39.518122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802988e-eaf5-4841-8ac4-30500e8b699c None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:39.549703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:39.620987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802988e-eaf5-4841-8ac4-30500e8b699c None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:39.655998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf3814-56db-44d6-b64e-ab403d8c710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:39.656540 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf3814-56db-44d6-b64e-ab403d8c710e None admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:39.656822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf3814-56db-44d6-b64e-ab403d8c710e None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:39.657099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf3814-56db-44d6-b64e-ab403d8c710e None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:39.657788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf3814-56db-44d6-b64e-ab403d8c710e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:39.659181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf3814-56db-44d6-b64e-ab403d8c710e None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:39.673466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 649/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jul 27 10:39:39 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:39:41.689778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675ce4f-9169-4f81-aa36-b5ae5c0f6600 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:41.690392 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675ce4f-9169-4f81-aa36-b5ae5c0f6600 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:41.690392 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675ce4f-9169-4f81-aa36-b5ae5c0f6600 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:41.691742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 647/1296] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:39:41.696991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb90b0-1d6e-4783-8e2f-27eb7751f687 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:41.697390 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb90b0-1d6e-4783-8e2f-27eb7751f687 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:41.697550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb90b0-1d6e-4783-8e2f-27eb7751f687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:41.716378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-f4eb90b0-1d6e-4783-8e2f-27eb7751f687 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:39:41.717590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f4eb90b0-1d6e-4783-8e2f-27eb7751f687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:39:41.789307 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 650/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:39:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 10:39:41.813269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675ce4f-9169-4f81-aa36-b5ae5c0f6600 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:41.918564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675ce4f-9169-4f81-aa36-b5ae5c0f6600 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:41.952524 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888ff8d-666c-4d2c-a813-0fb36ef7df68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:41.953119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888ff8d-666c-4d2c-a813-0fb36ef7df68 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:41.953403 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888ff8d-666c-4d2c-a813-0fb36ef7df68 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:41.953682 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888ff8d-666c-4d2c-a813-0fb36ef7df68 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:41.954345 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888ff8d-666c-4d2c-a813-0fb36ef7df68 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:41.955716 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888ff8d-666c-4d2c-a813-0fb36ef7df68 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-e888ff8d-666c-4d2c-a813-0fb36ef7df68 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:41.965001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:41.966219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:41.967311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 648/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jul 27 10:39:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:41.972357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb90b0-1d6e-4783-8e2f-27eb7751f687 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:41.991242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:42.074678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb90b0-1d6e-4783-8e2f-27eb7751f687 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:42.109378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d1300-775d-4068-b015-02f3a950afe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:42.109994 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d1300-775d-4068-b015-02f3a950afe1 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:42.110307 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d1300-775d-4068-b015-02f3a950afe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:42.110588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d1300-775d-4068-b015-02f3a950afe1 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:42.111268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d1300-775d-4068-b015-02f3a950afe1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:42.111577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d1300-775d-4068-b015-02f3a950afe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:42.112945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d1300-775d-4068-b015-02f3a950afe1 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:42.118391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 651/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Wed Jul 27 10:39:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:42.124148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888ff8d-666c-4d2c-a813-0fb36ef7df68 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:42.155846 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:42.224646 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888ff8d-666c-4d2c-a813-0fb36ef7df68 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:42.258737 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5971e-7d40-424f-85e8-1ae1454f6cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:42.259355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5971e-7d40-424f-85e8-1ae1454f6cd7 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:42.259640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5971e-7d40-424f-85e8-1ae1454f6cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:42.259916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5971e-7d40-424f-85e8-1ae1454f6cd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:42.260680 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5971e-7d40-424f-85e8-1ae1454f6cd7 None admin] RBAC: Adding query filter params (interface=public, service_id=f3869641ca534aaea76c3ecbc981bc12, region_id=RegionOne) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:42.260996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5971e-7d40-424f-85e8-1ae1454f6cd7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:42.262394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5971e-7d40-424f-85e8-1ae1454f6cd7 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:42.267374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 649/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jul 27 10:39:42 2022] GET /identity/v3/endpoints?service_id=f3869641ca534aaea76c3ecbc981bc12&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:42.273154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d1300-775d-4068-b015-02f3a950afe1 None admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:42.356363 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:42.374595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d1300-775d-4068-b015-02f3a950afe1 None admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:42.408874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533ed8-c8a1-4ee2-91e2-15b160f7afb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:42.409485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533ed8-c8a1-4ee2-91e2-15b160f7afb1 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:42.409767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533ed8-c8a1-4ee2-91e2-15b160f7afb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:42.410043 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533ed8-c8a1-4ee2-91e2-15b160f7afb1 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:42.410723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8533ed8-c8a1-4ee2-91e2-15b160f7afb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:42.412093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8533ed8-c8a1-4ee2-91e2-15b160f7afb1 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:42.418828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 652/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jul 27 10:39:42 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:39:44.433017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7347e41-7908-4fe0-918b-7bde95bb4745 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:44.433553 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7347e41-7908-4fe0-918b-7bde95bb4745 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:44.433724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7347e41-7908-4fe0-918b-7bde95bb4745 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:44.435446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 650/1302] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:39:44.441360 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb50b4-24c3-4890-8d87-1dd764b4fe40 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:44.441915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb50b4-24c3-4890-8d87-1dd764b4fe40 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:44.442035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb50b4-24c3-4890-8d87-1dd764b4fe40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:44.460845 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-65cb50b4-24c3-4890-8d87-1dd764b4fe40 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:39:44.462899 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-65cb50b4-24c3-4890-8d87-1dd764b4fe40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:39:44.532318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 653/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:39:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 10:39:44.555229 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7347e41-7908-4fe0-918b-7bde95bb4745 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:44.652820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:44.660085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7347e41-7908-4fe0-918b-7bde95bb4745 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:44.693147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a043754-b5d3-48a0-ae0e-f4a4b504fbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:44.693797 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a043754-b5d3-48a0-ae0e-f4a4b504fbd5 None admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:44.693995 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a043754-b5d3-48a0-ae0e-f4a4b504fbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:44.694298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a043754-b5d3-48a0-ae0e-f4a4b504fbd5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:44.694933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a043754-b5d3-48a0-ae0e-f4a4b504fbd5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:44.696782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a043754-b5d3-48a0-ae0e-f4a4b504fbd5 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application [None req-8a043754-b5d3-48a0-ae0e-f4a4b504fbd5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 10:39:44.705506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 10:39:44.706712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application with Lock( Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self._enter() Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application return self.creator() Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application created_value = creator( Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: ERROR keystone.server.flask.application Jul 27 10:39:44.707739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 651/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jul 27 10:39:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 10:39:44.713383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb50b4-24c3-4890-8d87-1dd764b4fe40 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:44.788889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:44.812255 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb50b4-24c3-4890-8d87-1dd764b4fe40 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:44.846940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32943bc4-fd24-49b1-a702-e42e0046abc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:44.847602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32943bc4-fd24-49b1-a702-e42e0046abc9 None admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:44.847898 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32943bc4-fd24-49b1-a702-e42e0046abc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:44.848172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32943bc4-fd24-49b1-a702-e42e0046abc9 None admin] PATH_INFO: `/v3/services` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:44.848852 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32943bc4-fd24-49b1-a702-e42e0046abc9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:39:44.849159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32943bc4-fd24-49b1-a702-e42e0046abc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:44.850551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32943bc4-fd24-49b1-a702-e42e0046abc9 None admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:44.855774 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 654/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Wed Jul 27 10:39:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:39:44.861607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a043754-b5d3-48a0-ae0e-f4a4b504fbd5 None admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:39:44.961635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a043754-b5d3-48a0-ae0e-f4a4b504fbd5 None admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:39:44.995079 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1c565-fa2d-440c-8a86-cb3b3584ce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:39:44.995692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1c565-fa2d-440c-8a86-cb3b3584ce31 None admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:39:44.995971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1c565-fa2d-440c-8a86-cb3b3584ce31 None admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:39:44.996243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1c565-fa2d-440c-8a86-cb3b3584ce31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:39:44.996962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1c565-fa2d-440c-8a86-cb3b3584ce31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:39:44.998349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1c565-fa2d-440c-8a86-cb3b3584ce31 None admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:39:45.018037 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 652/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:39:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:39:54.853059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=30 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:39:55.013754 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:40:50.071837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80c1b2-fb54-4ded-b0ee-b8fcf9de0346 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:50.073896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80c1b2-fb54-4ded-b0ee-b8fcf9de0346 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:50.074631 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80c1b2-fb54-4ded-b0ee-b8fcf9de0346 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:40:50.076955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 655/1307] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:40:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:40:50.082253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f72d0-b8e9-40ba-b61d-dc6978594c10 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:50.082777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f72d0-b8e9-40ba-b61d-dc6978594c10 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:50.082917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f72d0-b8e9-40ba-b61d-dc6978594c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:40:50.241469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-6b3f72d0-b8e9-40ba-b61d-dc6978594c10 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:40:50.242706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6b3f72d0-b8e9-40ba-b61d-dc6978594c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:40:50.375572 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 653/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:40:50.427020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0ff6f-3d92-4476-99b5-c721c0122f20 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:50.427716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0ff6f-3d92-4476-99b5-c721c0122f20 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:50.428211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0ff6f-3d92-4476-99b5-c721c0122f20 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:40:50.429682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 656/1309] 10.222.0.43 () {54 vars in 965 bytes} [Wed Jul 27 10:40:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:40:50.437361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e6c76-af24-46ad-90b6-cdb6b68caf84 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:50.437605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e6c76-af24-46ad-90b6-cdb6b68caf84 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:50.437870 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e6c76-af24-46ad-90b6-cdb6b68caf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:40:50.537054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-387e6c76-af24-46ad-90b6-cdb6b68caf84 None None] MFA Rules not processed for user `6b33631df63d4657a8e2ad108ca9f670`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:40:50.538372 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-387e6c76-af24-46ad-90b6-cdb6b68caf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:40:50.564590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:40:50.630026 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 654/1310] 10.222.0.43 () {58 vars in 1062 bytes} [Wed Jul 27 10:40:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:40:50.639011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0ff6f-3d92-4476-99b5-c721c0122f20 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:40:50.640770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-44d0ff6f-3d92-4476-99b5-c721c0122f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:40:50.791667 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0ff6f-3d92-4476-99b5-c721c0122f20 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:40:50.885339 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df096321-a0d8-4eda-87cb-930a9fddf937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:40:50.885977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096321-a0d8-4eda-87cb-930a9fddf937 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:50.886287 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096321-a0d8-4eda-87cb-930a9fddf937 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:50.886568 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df096321-a0d8-4eda-87cb-930a9fddf937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:40:50.888397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-df096321-a0d8-4eda-87cb-930a9fddf937 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:40:50.955275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:40:51.018734 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df096321-a0d8-4eda-87cb-930a9fddf937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:40:51.020772 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df096321-a0d8-4eda-87cb-930a9fddf937 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:40:51.042443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 657/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:40:53.386064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645df61-50b7-49c3-9dba-03ff84699230 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:53.386631 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645df61-50b7-49c3-9dba-03ff84699230 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:53.386727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645df61-50b7-49c3-9dba-03ff84699230 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:40:53.388026 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 655/1312] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:40:53.393119 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529cdd-827a-47d8-9304-8a4482020d2b None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:53.393576 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529cdd-827a-47d8-9304-8a4482020d2b None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:53.393709 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529cdd-827a-47d8-9304-8a4482020d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:40:53.478984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-89529cdd-827a-47d8-9304-8a4482020d2b None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:40:53.480207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-89529cdd-827a-47d8-9304-8a4482020d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:40:53.585318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 658/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:40:53.624215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645df61-50b7-49c3-9dba-03ff84699230 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:40:53.625783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a645df61-50b7-49c3-9dba-03ff84699230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:40:53.729545 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645df61-50b7-49c3-9dba-03ff84699230 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:40:53.802564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:40:53.805490 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c2aae-8b62-4ebe-8a79-28a7036cdf7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:40:53.806270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c2aae-8b62-4ebe-8a79-28a7036cdf7d service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:53.806753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c2aae-8b62-4ebe-8a79-28a7036cdf7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:53.807018 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c2aae-8b62-4ebe-8a79-28a7036cdf7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:40:53.808670 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d06c2aae-8b62-4ebe-8a79-28a7036cdf7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:40:53.919299 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c2aae-8b62-4ebe-8a79-28a7036cdf7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:40:53.920747 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c2aae-8b62-4ebe-8a79-28a7036cdf7d service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:40:53.940337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 656/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:40:56.296698 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a260cb7-a4c8-4700-9791-f12cff19b142 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:56.297256 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a260cb7-a4c8-4700-9791-f12cff19b142 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:56.297256 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a260cb7-a4c8-4700-9791-f12cff19b142 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:40:56.298591 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 659/1315] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:40:56.304535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc3369-d68c-4d7a-98ac-1a4feccddfa6 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:56.304987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc3369-d68c-4d7a-98ac-1a4feccddfa6 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:56.305212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc3369-d68c-4d7a-98ac-1a4feccddfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:40:56.380551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b0dc3369-d68c-4d7a-98ac-1a4feccddfa6 None None] MFA Rules not processed for user `219a03f07bac42d1b262d74a9cd3c014`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:40:56.381764 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b0dc3369-d68c-4d7a-98ac-1a4feccddfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:40:56.440451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:40:56.486058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 657/1316] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:40:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:40:56.541404 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9132a30-b116-4f45-bb61-57ad5ef9eadf None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:56.541685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9132a30-b116-4f45-bb61-57ad5ef9eadf None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:56.541964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9132a30-b116-4f45-bb61-57ad5ef9eadf None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:40:56.543339 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 660/1317] 10.222.0.43 () {54 vars in 965 bytes} [Wed Jul 27 10:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:40:56.549356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1222-a642-4bd5-9b85-87f338ce814d None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:56.549584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1222-a642-4bd5-9b85-87f338ce814d None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:56.549873 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f1222-a642-4bd5-9b85-87f338ce814d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:40:56.629765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-fd0f1222-a642-4bd5-9b85-87f338ce814d None None] MFA Rules not processed for user `6b33631df63d4657a8e2ad108ca9f670`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:40:56.631041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-fd0f1222-a642-4bd5-9b85-87f338ce814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:40:56.705638 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 658/1318] 10.222.0.43 () {58 vars in 1062 bytes} [Wed Jul 27 10:40:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:40:56.714977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9132a30-b116-4f45-bb61-57ad5ef9eadf None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:40:56.716525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a9132a30-b116-4f45-bb61-57ad5ef9eadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:40:56.726545 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:40:56.822807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9132a30-b116-4f45-bb61-57ad5ef9eadf None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:40:56.898489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdf59c-0458-4045-9ca9-ab0ccfca7067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:40:56.899112 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdf59c-0458-4045-9ca9-ab0ccfca7067 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:56.899388 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdf59c-0458-4045-9ca9-ab0ccfca7067 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:56.899659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdf59c-0458-4045-9ca9-ab0ccfca7067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:40:56.901275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a4bdf59c-0458-4045-9ca9-ab0ccfca7067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:40:56.965143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:40:57.013128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdf59c-0458-4045-9ca9-ab0ccfca7067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:40:57.014700 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdf59c-0458-4045-9ca9-ab0ccfca7067 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:40:57.032888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 661/1319] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:40:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:40:59.984321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a7cf-1e7e-41d3-8968-11de8a72ae3c None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:59.984875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a7cf-1e7e-41d3-8968-11de8a72ae3c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:59.984875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a7cf-1e7e-41d3-8968-11de8a72ae3c None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:40:59.986278 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 659/1320] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:40:59.991473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b66f4f-b17d-4b5a-8302-00d6dceb644c None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:40:59.991909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b66f4f-b17d-4b5a-8302-00d6dceb644c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:40:59.992031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b66f4f-b17d-4b5a-8302-00d6dceb644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:00.057644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-b4b66f4f-b17d-4b5a-8302-00d6dceb644c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:00.058886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b4b66f4f-b17d-4b5a-8302-00d6dceb644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:00.159902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 662/1321] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:40:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:00.199062 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19a7cf-1e7e-41d3-8968-11de8a72ae3c None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:00.200621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1b19a7cf-1e7e-41d3-8968-11de8a72ae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:00.251689 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:00.306962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19a7cf-1e7e-41d3-8968-11de8a72ae3c None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:00.384842 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c80327-1f2b-48f5-a8f7-cd04697046b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:00.385462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c80327-1f2b-48f5-a8f7-cd04697046b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:00.385749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c80327-1f2b-48f5-a8f7-cd04697046b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:00.386022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c80327-1f2b-48f5-a8f7-cd04697046b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:00.387708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-18c80327-1f2b-48f5-a8f7-cd04697046b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:00.483982 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:00.498111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c80327-1f2b-48f5-a8f7-cd04697046b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:00.499586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c80327-1f2b-48f5-a8f7-cd04697046b8 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:00.517988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 660/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:41:03.245462 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e50a-c91d-44f7-b2c0-b8e2b16509c2 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:03.245989 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e50a-c91d-44f7-b2c0-b8e2b16509c2 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:03.245989 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e50a-c91d-44f7-b2c0-b8e2b16509c2 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:03.247294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 663/1323] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:03.252579 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d4ff2-50b2-420c-8733-b4b9b1a4226c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:03.253063 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d4ff2-50b2-420c-8733-b4b9b1a4226c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:03.253366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d4ff2-50b2-420c-8733-b4b9b1a4226c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:03.320991 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-786d4ff2-50b2-420c-8733-b4b9b1a4226c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:03.322255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-786d4ff2-50b2-420c-8733-b4b9b1a4226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:03.428143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 661/1324] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:03.466334 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332e50a-c91d-44f7-b2c0-b8e2b16509c2 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:03.467926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5332e50a-c91d-44f7-b2c0-b8e2b16509c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:03.489490 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:03.582226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332e50a-c91d-44f7-b2c0-b8e2b16509c2 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:03.662050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17a243-4b37-4c9d-a942-698d8c090e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:03.662706 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17a243-4b37-4c9d-a942-698d8c090e6b service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:03.662987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17a243-4b37-4c9d-a942-698d8c090e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:03.663262 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17a243-4b37-4c9d-a942-698d8c090e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:03.664906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3f17a243-4b37-4c9d-a942-698d8c090e6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:03.738158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:03.779377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17a243-4b37-4c9d-a942-698d8c090e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:03.780735 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17a243-4b37-4c9d-a942-698d8c090e6b service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:03.800157 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 664/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:41:05.883971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84143e2-3eec-4d7a-a160-4f0e528851fd None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:05.884433 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84143e2-3eec-4d7a-a160-4f0e528851fd None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:05.884551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84143e2-3eec-4d7a-a160-4f0e528851fd None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:05.886041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 662/1326] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:05.891210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f72df9-ea64-4fce-97b6-a75be8196370 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:05.891703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f72df9-ea64-4fce-97b6-a75be8196370 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:05.891793 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f72df9-ea64-4fce-97b6-a75be8196370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:05.963240 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-d8f72df9-ea64-4fce-97b6-a75be8196370 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:05.964441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-d8f72df9-ea64-4fce-97b6-a75be8196370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:06.062201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 665/1327] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:06.098128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84143e2-3eec-4d7a-a160-4f0e528851fd None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:06.099783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c84143e2-3eec-4d7a-a160-4f0e528851fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:06.167048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:06.212104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84143e2-3eec-4d7a-a160-4f0e528851fd None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:06.288864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905c4f7-0bf4-45cb-8f18-cc27f9a400f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:06.289762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c4f7-0bf4-45cb-8f18-cc27f9a400f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:06.290046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c4f7-0bf4-45cb-8f18-cc27f9a400f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:06.290351 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c4f7-0bf4-45cb-8f18-cc27f9a400f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:06.291986 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4905c4f7-0bf4-45cb-8f18-cc27f9a400f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:06.411122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:06.413836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905c4f7-0bf4-45cb-8f18-cc27f9a400f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:06.415930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905c4f7-0bf4-45cb-8f18-cc27f9a400f0 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:06.437808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 663/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:41:08.548270 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9c822-5b1e-45cb-bc45-9fbdd71ee2cb None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:08.548848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9c822-5b1e-45cb-bc45-9fbdd71ee2cb None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:08.548848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9c822-5b1e-45cb-bc45-9fbdd71ee2cb None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:08.550653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 666/1329] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:08.555911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4f726-20e4-4896-ad9e-60ea552c2298 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:08.556364 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4f726-20e4-4896-ad9e-60ea552c2298 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:08.556495 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4f726-20e4-4896-ad9e-60ea552c2298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:08.625010 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-4ca4f726-20e4-4896-ad9e-60ea552c2298 None None] MFA Rules not processed for user `219a03f07bac42d1b262d74a9cd3c014`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:08.626242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4ca4f726-20e4-4896-ad9e-60ea552c2298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:08.732080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 664/1330] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:08.772046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9c822-5b1e-45cb-bc45-9fbdd71ee2cb None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:08.773624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-73b9c822-5b1e-45cb-bc45-9fbdd71ee2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:08.807268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:08.886543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9c822-5b1e-45cb-bc45-9fbdd71ee2cb None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:08.965454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468c73c-51e7-4547-8ed0-9c5d90376a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:08.966001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468c73c-51e7-4547-8ed0-9c5d90376a2a service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:08.966324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468c73c-51e7-4547-8ed0-9c5d90376a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:08.966602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468c73c-51e7-4547-8ed0-9c5d90376a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:08.968238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3468c73c-51e7-4547-8ed0-9c5d90376a2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:09.048892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:09.082058 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468c73c-51e7-4547-8ed0-9c5d90376a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:09.083521 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468c73c-51e7-4547-8ed0-9c5d90376a2a service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:09.101755 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 667/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:41:11.433450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c256-3cfd-47b4-bbba-31ef154a33a5 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:11.433998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c256-3cfd-47b4-bbba-31ef154a33a5 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:11.433998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c256-3cfd-47b4-bbba-31ef154a33a5 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:11.435385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 665/1332] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:11.441534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedd9d-2eab-4b3b-831b-c11e06e0d7de None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:11.441949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedd9d-2eab-4b3b-831b-c11e06e0d7de None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:11.442078 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedd9d-2eab-4b3b-831b-c11e06e0d7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:11.508152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-7bfedd9d-2eab-4b3b-831b-c11e06e0d7de None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:11.509344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7bfedd9d-2eab-4b3b-831b-c11e06e0d7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:11.610925 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 668/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:11.649062 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79c256-3cfd-47b4-bbba-31ef154a33a5 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:11.650684 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-8d79c256-3cfd-47b4-bbba-31ef154a33a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:11.726671 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:11.763526 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79c256-3cfd-47b4-bbba-31ef154a33a5 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:11.840206 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa479ca-a079-4db6-843f-6806f266ae84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:11.840849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa479ca-a079-4db6-843f-6806f266ae84 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:11.841117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa479ca-a079-4db6-843f-6806f266ae84 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:11.841389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa479ca-a079-4db6-843f-6806f266ae84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:11.843078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ffa479ca-a079-4db6-843f-6806f266ae84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:11.960620 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa479ca-a079-4db6-843f-6806f266ae84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:11.961979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa479ca-a079-4db6-843f-6806f266ae84 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:11.971977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:11.980465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 666/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:41:14.060503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea643bf-5bdd-45a7-af90-d1ba0ae13f7c None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:14.061042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea643bf-5bdd-45a7-af90-d1ba0ae13f7c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:14.061042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea643bf-5bdd-45a7-af90-d1ba0ae13f7c None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:14.062395 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 669/1335] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:14.068238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0665b52-ba80-491a-9618-d76a450af416 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:14.068629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0665b52-ba80-491a-9618-d76a450af416 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:14.068799 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0665b52-ba80-491a-9618-d76a450af416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:14.135828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b0665b52-ba80-491a-9618-d76a450af416 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:14.137027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b0665b52-ba80-491a-9618-d76a450af416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:14.234412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 667/1336] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:14.274877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea643bf-5bdd-45a7-af90-d1ba0ae13f7c None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:14.276439 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6ea643bf-5bdd-45a7-af90-d1ba0ae13f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:14.317246 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:14.381101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea643bf-5bdd-45a7-af90-d1ba0ae13f7c None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:14.462466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d42be5-35f2-487e-b542-6a259faf2064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:14.462994 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d42be5-35f2-487e-b542-6a259faf2064 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:14.463272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d42be5-35f2-487e-b542-6a259faf2064 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:14.463544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d42be5-35f2-487e-b542-6a259faf2064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:14.465206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-81d42be5-35f2-487e-b542-6a259faf2064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:14.549831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:14.575570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d42be5-35f2-487e-b542-6a259faf2064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:14.577013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d42be5-35f2-487e-b542-6a259faf2064 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:14.595202 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 670/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:41:17.085909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775673ce-23f2-4e06-912b-4f9f834c629c None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:17.086487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775673ce-23f2-4e06-912b-4f9f834c629c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:17.086487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775673ce-23f2-4e06-912b-4f9f834c629c None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:17.088124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 668/1338] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:17.093461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f21a5-dd4d-4cc8-823c-53f7aab31943 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:17.093919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f21a5-dd4d-4cc8-823c-53f7aab31943 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:17.094034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f21a5-dd4d-4cc8-823c-53f7aab31943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:17.160744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-c87f21a5-dd4d-4cc8-823c-53f7aab31943 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:17.161963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c87f21a5-dd4d-4cc8-823c-53f7aab31943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:17.258783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 671/1339] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:41:17.296165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775673ce-23f2-4e06-912b-4f9f834c629c None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:17.297697 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-775673ce-23f2-4e06-912b-4f9f834c629c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:17.373909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:17.402843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775673ce-23f2-4e06-912b-4f9f834c629c None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:17.479794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff47e0d-b4f7-4836-9a5f-49b9806f3cc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:17.480415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff47e0d-b4f7-4836-9a5f-49b9806f3cc8 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:17.480697 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff47e0d-b4f7-4836-9a5f-49b9806f3cc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:17.480970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff47e0d-b4f7-4836-9a5f-49b9806f3cc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:17.482645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-cff47e0d-b4f7-4836-9a5f-49b9806f3cc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:17.592393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff47e0d-b4f7-4836-9a5f-49b9806f3cc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:17.593830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff47e0d-b4f7-4836-9a5f-49b9806f3cc8 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:17.612335 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 669/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:41:21.829449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d2b4f-dda3-4ab4-8f18-d80f356a16c7 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:21.829986 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d2b4f-dda3-4ab4-8f18-d80f356a16c7 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:21.830380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d2b4f-dda3-4ab4-8f18-d80f356a16c7 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:21.831784 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 672/1341] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:21.837519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b9f4b-1f2b-48d3-916f-4b6b9847803a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:21.837989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b9f4b-1f2b-48d3-916f-4b6b9847803a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:21.838083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b9f4b-1f2b-48d3-916f-4b6b9847803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:21.843602 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:21.917679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-620b9f4b-1f2b-48d3-916f-4b6b9847803a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:21.919036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-620b9f4b-1f2b-48d3-916f-4b6b9847803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:22.021789 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 670/1342] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:22.062365 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d2b4f-dda3-4ab4-8f18-d80f356a16c7 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:22.064059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-552d2b4f-dda3-4ab4-8f18-d80f356a16c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:22.118967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:22.177778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d2b4f-dda3-4ab4-8f18-d80f356a16c7 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:22.254019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6a9dd-ea3c-4c9d-b34c-0b8957d20ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:22.254679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6a9dd-ea3c-4c9d-b34c-0b8957d20ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:22.254965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6a9dd-ea3c-4c9d-b34c-0b8957d20ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:22.255241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6a9dd-ea3c-4c9d-b34c-0b8957d20ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:22.256870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-92f6a9dd-ea3c-4c9d-b34c-0b8957d20ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:22.358238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:22.374855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6a9dd-ea3c-4c9d-b34c-0b8957d20ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:22.376336 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6a9dd-ea3c-4c9d-b34c-0b8957d20ab2 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:22.396115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 673/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:41:25.041237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f016b-00cf-4653-b1d1-3df91658f1c5 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:25.041812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f016b-00cf-4653-b1d1-3df91658f1c5 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:25.041812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f016b-00cf-4653-b1d1-3df91658f1c5 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:25.043440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 671/1344] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:25.050303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863a871-db6b-4ba5-bb71-12a986be63d2 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:25.050854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863a871-db6b-4ba5-bb71-12a986be63d2 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:25.051003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863a871-db6b-4ba5-bb71-12a986be63d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:25.126594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-5863a871-db6b-4ba5-bb71-12a986be63d2 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:25.127745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5863a871-db6b-4ba5-bb71-12a986be63d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:25.236638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 674/1345] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:25.274025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f016b-00cf-4653-b1d1-3df91658f1c5 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:25.275610 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-df2f016b-00cf-4653-b1d1-3df91658f1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:25.367583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:25.385789 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f016b-00cf-4653-b1d1-3df91658f1c5 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:25.467911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fa6a1-e3c9-4cc1-9c04-00ab4d0388a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:25.468452 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fa6a1-e3c9-4cc1-9c04-00ab4d0388a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:25.468736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fa6a1-e3c9-4cc1-9c04-00ab4d0388a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:25.469001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fa6a1-e3c9-4cc1-9c04-00ab4d0388a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:25.471312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-879fa6a1-e3c9-4cc1-9c04-00ab4d0388a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:25.594072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fa6a1-e3c9-4cc1-9c04-00ab4d0388a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:25.595722 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fa6a1-e3c9-4cc1-9c04-00ab4d0388a0 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:25.614281 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 672/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:41:29.761451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb00355-791d-4a58-bee7-aa393e338e7a None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:29.762046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb00355-791d-4a58-bee7-aa393e338e7a None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:29.762046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb00355-791d-4a58-bee7-aa393e338e7a None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:29.763565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 675/1347] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:29.769586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35877886-e195-447d-b06c-c862c4a152f2 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:29.770097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35877886-e195-447d-b06c-c862c4a152f2 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:29.770228 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35877886-e195-447d-b06c-c862c4a152f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:29.786624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:29.840473 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-35877886-e195-447d-b06c-c862c4a152f2 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:29.841702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-35877886-e195-447d-b06c-c862c4a152f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:29.970546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 673/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:30.009538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb00355-791d-4a58-bee7-aa393e338e7a None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:30.011104 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3cb00355-791d-4a58-bee7-aa393e338e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:30.075309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:30.127474 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb00355-791d-4a58-bee7-aa393e338e7a None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:30.206993 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4fe77-512a-4096-a9c6-7ffe22942368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:30.207653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4fe77-512a-4096-a9c6-7ffe22942368 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:30.207936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4fe77-512a-4096-a9c6-7ffe22942368 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:30.208208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4fe77-512a-4096-a9c6-7ffe22942368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:30.209894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-03a4fe77-512a-4096-a9c6-7ffe22942368 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:30.328389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:30.335556 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4fe77-512a-4096-a9c6-7ffe22942368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:30.338772 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4fe77-512a-4096-a9c6-7ffe22942368 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:30.362092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 676/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:41:35.280284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f3463-22af-4562-b10b-bb9e8e20a2a6 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:35.280845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f3463-22af-4562-b10b-bb9e8e20a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:35.282561 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f3463-22af-4562-b10b-bb9e8e20a2a6 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:35.283553 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 674/1350] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jul 27 10:41:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:35.291875 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d04c46-cd3a-4676-90ae-b7cd9ad57143 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:35.292336 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d04c46-cd3a-4676-90ae-b7cd9ad57143 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:35.292686 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d04c46-cd3a-4676-90ae-b7cd9ad57143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:35.420997 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-50d04c46-cd3a-4676-90ae-b7cd9ad57143 None None] MFA Rules not processed for user `39830a354dee41b5b210d80807886299`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:35.422741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-50d04c46-cd3a-4676-90ae-b7cd9ad57143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:35.566845 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 677/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jul 27 10:41:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:39.691063 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4225048-7bd7-4de9-8aae-578bc2ff8533 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:39.691921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4225048-7bd7-4de9-8aae-578bc2ff8533 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:39.692199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4225048-7bd7-4de9-8aae-578bc2ff8533 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:39.693708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 675/1352] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jul 27 10:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:39.698668 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5e61a-316a-4453-b942-b6b0f1d16fc1 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:39.699495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5e61a-316a-4453-b942-b6b0f1d16fc1 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:39.699985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5e61a-316a-4453-b942-b6b0f1d16fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:39.761138 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:39.788133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-f7b5e61a-316a-4453-b942-b6b0f1d16fc1 None None] MFA Rules not processed for user `39830a354dee41b5b210d80807886299`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:39.789338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f7b5e61a-316a-4453-b942-b6b0f1d16fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:39.917370 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 678/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jul 27 10:41:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:39.967512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=59 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:41.354473 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0412f97-4cbe-424a-a68e-2d166a336c36 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:41.355072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0412f97-4cbe-424a-a68e-2d166a336c36 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:41.355072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0412f97-4cbe-424a-a68e-2d166a336c36 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:41.356290 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 676/1354] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jul 27 10:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:41.361491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5a45d-cd06-439c-aaaf-d60e327f764f None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:41.361946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5a45d-cd06-439c-aaaf-d60e327f764f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:41.362167 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5a45d-cd06-439c-aaaf-d60e327f764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:41.441944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-63d5a45d-cd06-439c-aaaf-d60e327f764f None None] MFA Rules not processed for user `39830a354dee41b5b210d80807886299`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:41.443176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-63d5a45d-cd06-439c-aaaf-d60e327f764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:41.486654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:41.555257 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 679/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jul 27 10:41:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:45.025402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd608dd7-1837-4dfc-aad1-41512780a335 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:45.025925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd608dd7-1837-4dfc-aad1-41512780a335 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:45.025925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd608dd7-1837-4dfc-aad1-41512780a335 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:45.027423 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 677/1356] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:45.033354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137a6bf-7fed-4a9d-be4c-0223e04b5b14 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:45.033838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137a6bf-7fed-4a9d-be4c-0223e04b5b14 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:45.033944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137a6bf-7fed-4a9d-be4c-0223e04b5b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:45.121744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-3137a6bf-7fed-4a9d-be4c-0223e04b5b14 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:45.122992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3137a6bf-7fed-4a9d-be4c-0223e04b5b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:45.229429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 680/1357] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:45.286482 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd95f9d-976b-46e0-9425-4ac124517f2e None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:45.287287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd95f9d-976b-46e0-9425-4ac124517f2e None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:45.287756 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd95f9d-976b-46e0-9425-4ac124517f2e None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:45.289852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 678/1358] 10.222.0.43 () {54 vars in 962 bytes} [Wed Jul 27 10:41:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:45.299850 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931abf0f-0472-483f-b9ab-d3d955f5f845 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:45.300540 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931abf0f-0472-483f-b9ab-d3d955f5f845 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:45.301264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931abf0f-0472-483f-b9ab-d3d955f5f845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:45.323949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:45.389011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-931abf0f-0472-483f-b9ab-d3d955f5f845 None None] MFA Rules not processed for user `3bb16c9232464cc2aeee12b7fa918b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:45.390376 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-931abf0f-0472-483f-b9ab-d3d955f5f845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:45.531935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 681/1359] 10.222.0.43 () {58 vars in 1059 bytes} [Wed Jul 27 10:41:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:41:45.539775 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd95f9d-976b-46e0-9425-4ac124517f2e None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:45.541906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0cd95f9d-976b-46e0-9425-4ac124517f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:45.703659 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd95f9d-976b-46e0-9425-4ac124517f2e None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:45.785760 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:45.835662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f04f21-afb8-4708-b7d9-786d460225b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:45.836394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04f21-afb8-4708-b7d9-786d460225b3 service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:45.836742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04f21-afb8-4708-b7d9-786d460225b3 service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:45.837100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f04f21-afb8-4708-b7d9-786d460225b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:45.838907 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e4f04f21-afb8-4708-b7d9-786d460225b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:45.941452 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f04f21-afb8-4708-b7d9-786d460225b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:45.944496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f04f21-afb8-4708-b7d9-786d460225b3 service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:45.967125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 679/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:41:48.264305 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858cc35-5705-4df7-8534-eade4e6e4ee5 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:48.264838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858cc35-5705-4df7-8534-eade4e6e4ee5 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:48.264946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858cc35-5705-4df7-8534-eade4e6e4ee5 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:48.266738 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 682/1361] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:48.272033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f3203-4273-4c98-8c9b-1c9dce688057 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:48.273070 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f3203-4273-4c98-8c9b-1c9dce688057 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:48.273735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f3203-4273-4c98-8c9b-1c9dce688057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:48.348251 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-449f3203-4273-4c98-8c9b-1c9dce688057 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:48.349631 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-449f3203-4273-4c98-8c9b-1c9dce688057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:48.395615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:48.474795 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 680/1362] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:48.515681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858cc35-5705-4df7-8534-eade4e6e4ee5 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:48.517209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8858cc35-5705-4df7-8534-eade4e6e4ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:48.592293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:48.715846 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858cc35-5705-4df7-8534-eade4e6e4ee5 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:48.854461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357bd01-e3f5-44e5-9a04-44b2537a2a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:48.855095 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357bd01-e3f5-44e5-9a04-44b2537a2a85 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:48.855393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357bd01-e3f5-44e5-9a04-44b2537a2a85 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:48.855655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357bd01-e3f5-44e5-9a04-44b2537a2a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:48.857543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b357bd01-e3f5-44e5-9a04-44b2537a2a85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:48.897024 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:48.973754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357bd01-e3f5-44e5-9a04-44b2537a2a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:48.975591 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357bd01-e3f5-44e5-9a04-44b2537a2a85 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:48.995927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 683/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:41:51.376693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a2866-5a1d-40b1-b223-70c0cdd0a4b9 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:51.377268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a2866-5a1d-40b1-b223-70c0cdd0a4b9 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:51.377268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a2866-5a1d-40b1-b223-70c0cdd0a4b9 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:51.378636 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 681/1364] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:41:51.384021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc3b8-dce7-46c5-bb1b-6ded24fde4ea None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:51.384437 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc3b8-dce7-46c5-bb1b-6ded24fde4ea None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:51.384629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc3b8-dce7-46c5-bb1b-6ded24fde4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:51.457807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-c25cc3b8-dce7-46c5-bb1b-6ded24fde4ea None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:51.459075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c25cc3b8-dce7-46c5-bb1b-6ded24fde4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:51.563942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:51.570361 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 684/1365] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:51.611655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21360883-3b8a-409d-95c6-0fb3c9d6b9ac None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:51.612353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21360883-3b8a-409d-95c6-0fb3c9d6b9ac None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:51.612640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21360883-3b8a-409d-95c6-0fb3c9d6b9ac None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:51.614058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 682/1366] 10.222.0.43 () {54 vars in 962 bytes} [Wed Jul 27 10:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:51.620500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528a507-0032-4036-9d48-1dc0c7fd8079 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:51.620778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528a507-0032-4036-9d48-1dc0c7fd8079 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:51.621059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528a507-0032-4036-9d48-1dc0c7fd8079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:51.703489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-0528a507-0032-4036-9d48-1dc0c7fd8079 None None] MFA Rules not processed for user `3bb16c9232464cc2aeee12b7fa918b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:51.704602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0528a507-0032-4036-9d48-1dc0c7fd8079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:51.841886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 685/1367] 10.222.0.43 () {58 vars in 1059 bytes} [Wed Jul 27 10:41:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:51.850605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21360883-3b8a-409d-95c6-0fb3c9d6b9ac None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:51.852147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-21360883-3b8a-409d-95c6-0fb3c9d6b9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:52.029196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21360883-3b8a-409d-95c6-0fb3c9d6b9ac None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:52.053693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:52.163142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2a38a-0af1-4689-a273-b86bc6838c7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:52.163765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2a38a-0af1-4689-a273-b86bc6838c7e service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:52.164044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2a38a-0af1-4689-a273-b86bc6838c7e service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:52.164315 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2a38a-0af1-4689-a273-b86bc6838c7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:52.165940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-50a2a38a-0af1-4689-a273-b86bc6838c7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:52.283798 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2a38a-0af1-4689-a273-b86bc6838c7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:52.286946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2a38a-0af1-4689-a273-b86bc6838c7e service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:52.323960 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 683/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:41:53.148912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e11d-c124-4c77-9030-6f105555badb None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:53.149446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e11d-c124-4c77-9030-6f105555badb None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:53.149446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e11d-c124-4c77-9030-6f105555badb None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:53.150938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 686/1369] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:53.156183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca93e1-dede-464d-bc26-41bb494749da None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:53.156648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca93e1-dede-464d-bc26-41bb494749da None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:53.156854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca93e1-dede-464d-bc26-41bb494749da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:53.191309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:53.229354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-94ca93e1-dede-464d-bc26-41bb494749da None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:53.231064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-94ca93e1-dede-464d-bc26-41bb494749da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:53.339870 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 684/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:53.652781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b20a-2efa-4ee5-ad76-939d97318509 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:53.653071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b20a-2efa-4ee5-ad76-939d97318509 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:53.653349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b20a-2efa-4ee5-ad76-939d97318509 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:53.654928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 687/1371] 10.222.0.43 () {54 vars in 964 bytes} [Wed Jul 27 10:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:53.660452 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037daf8b-ddcb-4196-a053-e7206c78320a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:53.660813 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037daf8b-ddcb-4196-a053-e7206c78320a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:53.661164 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037daf8b-ddcb-4196-a053-e7206c78320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:53.754445 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-037daf8b-ddcb-4196-a053-e7206c78320a None None] MFA Rules not processed for user `65bd5264306d4d33a2e14b01abb4364a`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:53.755660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-037daf8b-ddcb-4196-a053-e7206c78320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:53.810939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:53.847536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 685/1372] 10.222.0.43 () {58 vars in 1061 bytes} [Wed Jul 27 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:53.855762 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530b20a-2efa-4ee5-ad76-939d97318509 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:53.857423 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8530b20a-2efa-4ee5-ad76-939d97318509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:53.923077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:53.987105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530b20a-2efa-4ee5-ad76-939d97318509 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:54.071000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bea63-0a0e-41db-9de8-3bd5a181a2c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:54.071657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bea63-0a0e-41db-9de8-3bd5a181a2c4 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:54.072011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bea63-0a0e-41db-9de8-3bd5a181a2c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:54.072383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bea63-0a0e-41db-9de8-3bd5a181a2c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:54.074093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8b3bea63-0a0e-41db-9de8-3bd5a181a2c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:54.184416 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:54.200608 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bea63-0a0e-41db-9de8-3bd5a181a2c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:54.202999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bea63-0a0e-41db-9de8-3bd5a181a2c4 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:54.222922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 688/1373] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:41:54.481501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f7677-a1ba-447b-9e24-76c082e3d18a None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:54.482011 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f7677-a1ba-447b-9e24-76c082e3d18a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:54.482011 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f7677-a1ba-447b-9e24-76c082e3d18a None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:54.486746 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 686/1374] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:54.488844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88636db4-a824-440f-bbc7-64f1a54cb8dc None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:54.489018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88636db4-a824-440f-bbc7-64f1a54cb8dc None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:54.489282 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88636db4-a824-440f-bbc7-64f1a54cb8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:54.570787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-88636db4-a824-440f-bbc7-64f1a54cb8dc None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:54.571943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-88636db4-a824-440f-bbc7-64f1a54cb8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:54.679982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 689/1375] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:41:54.728876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f7677-a1ba-447b-9e24-76c082e3d18a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:54.730408 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-821f7677-a1ba-447b-9e24-76c082e3d18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:54.883333 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f7677-a1ba-447b-9e24-76c082e3d18a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:54.947791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:55.020886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21846b93-c154-4336-9983-10aa5a087a46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:55.021507 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846b93-c154-4336-9983-10aa5a087a46 service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:55.021783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846b93-c154-4336-9983-10aa5a087a46 service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:55.022052 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846b93-c154-4336-9983-10aa5a087a46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:55.023712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-21846b93-c154-4336-9983-10aa5a087a46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:55.116106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21846b93-c154-4336-9983-10aa5a087a46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:55.117834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21846b93-c154-4336-9983-10aa5a087a46 service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:55.137885 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 687/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:41:57.205019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e292f4-aa15-49dd-ac28-701594627444 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:57.205611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e292f4-aa15-49dd-ac28-701594627444 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:57.205611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e292f4-aa15-49dd-ac28-701594627444 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:57.206961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 690/1377] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:41:57.212297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe65b9-8e79-4dfd-b7aa-12bc773d42ab None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:57.212731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe65b9-8e79-4dfd-b7aa-12bc773d42ab None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:57.212891 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe65b9-8e79-4dfd-b7aa-12bc773d42ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:57.292966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-44fe65b9-8e79-4dfd-b7aa-12bc773d42ab None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:41:57.294368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-44fe65b9-8e79-4dfd-b7aa-12bc773d42ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:57.301889 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:57.416577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 688/1378] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:41:57.462000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e292f4-aa15-49dd-ac28-701594627444 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:41:57.463507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-57e292f4-aa15-49dd-ac28-701594627444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:57.524934 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:57.626144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e292f4-aa15-49dd-ac28-701594627444 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:41:57.769732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2844a8-212d-4779-841e-8a85b351f18a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:41:57.770987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2844a8-212d-4779-841e-8a85b351f18a service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:41:57.771100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2844a8-212d-4779-841e-8a85b351f18a service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:41:57.771437 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2844a8-212d-4779-841e-8a85b351f18a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:41:57.773684 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8d2844a8-212d-4779-841e-8a85b351f18a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:41:57.802268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:41:57.915180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2844a8-212d-4779-841e-8a85b351f18a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:41:57.917297 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2844a8-212d-4779-841e-8a85b351f18a service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:41:57.938488 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 691/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:00.015050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755450ae-4a05-43d1-9310-f5d4160fef57 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:00.015625 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755450ae-4a05-43d1-9310-f5d4160fef57 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:00.015625 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755450ae-4a05-43d1-9310-f5d4160fef57 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:00.017183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 689/1380] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:00.022284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894bb46-f0f0-4871-9c5b-5c79ee15e36d None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:00.022713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894bb46-f0f0-4871-9c5b-5c79ee15e36d None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:00.022898 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894bb46-f0f0-4871-9c5b-5c79ee15e36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:00.093929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-1894bb46-f0f0-4871-9c5b-5c79ee15e36d None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:00.095157 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1894bb46-f0f0-4871-9c5b-5c79ee15e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:00.205768 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:00.206339 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 692/1381] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:00.251000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755450ae-4a05-43d1-9310-f5d4160fef57 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:00.252513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-755450ae-4a05-43d1-9310-f5d4160fef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:00.409625 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:00.421775 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755450ae-4a05-43d1-9310-f5d4160fef57 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:00.547088 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5ff92-b8ff-41e9-ad1b-955a4cef9870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:00.547715 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5ff92-b8ff-41e9-ad1b-955a4cef9870 service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:00.548263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5ff92-b8ff-41e9-ad1b-955a4cef9870 service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:00.548536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5ff92-b8ff-41e9-ad1b-955a4cef9870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:00.550231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0fa5ff92-b8ff-41e9-ad1b-955a4cef9870 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:00.647929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5ff92-b8ff-41e9-ad1b-955a4cef9870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:00.649687 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5ff92-b8ff-41e9-ad1b-955a4cef9870 service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:00.663150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:00.675036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 690/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:02.785987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dda84-da67-4350-b68e-aaf9337e6a0c None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:02.786930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dda84-da67-4350-b68e-aaf9337e6a0c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:02.787222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693dda84-da67-4350-b68e-aaf9337e6a0c None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:02.788589 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 693/1383] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:02.795055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2b3b-16cf-4745-a864-8c5982b6482e None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:02.795575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2b3b-16cf-4745-a864-8c5982b6482e None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:02.795723 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda2b3b-16cf-4745-a864-8c5982b6482e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:02.865740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-ccda2b3b-16cf-4745-a864-8c5982b6482e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:02.867036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ccda2b3b-16cf-4745-a864-8c5982b6482e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:02.981865 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 691/1384] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:03.029895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dda84-da67-4350-b68e-aaf9337e6a0c None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:03.031571 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-693dda84-da67-4350-b68e-aaf9337e6a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:03.214578 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693dda84-da67-4350-b68e-aaf9337e6a0c None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:03.301417 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:03.353202 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d33b69-8da9-4ff3-b48e-31a79c129d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:03.353843 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d33b69-8da9-4ff3-b48e-31a79c129d1a service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:03.354143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d33b69-8da9-4ff3-b48e-31a79c129d1a service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:03.354465 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d33b69-8da9-4ff3-b48e-31a79c129d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:03.356190 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-75d33b69-8da9-4ff3-b48e-31a79c129d1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:03.461494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d33b69-8da9-4ff3-b48e-31a79c129d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:03.463189 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d33b69-8da9-4ff3-b48e-31a79c129d1a service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:03.486273 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 694/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:05.605240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11decc-e5c1-4379-a279-0c567b391bcd None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:05.605903 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11decc-e5c1-4379-a279-0c567b391bcd None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:05.605903 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11decc-e5c1-4379-a279-0c567b391bcd None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:05.607293 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 692/1386] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:05.614935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb699f-bdd9-4da6-aad8-8fe0de0dbc17 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:05.615560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb699f-bdd9-4da6-aad8-8fe0de0dbc17 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:05.615715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb699f-bdd9-4da6-aad8-8fe0de0dbc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:05.692003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-35fb699f-bdd9-4da6-aad8-8fe0de0dbc17 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:05.693611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-35fb699f-bdd9-4da6-aad8-8fe0de0dbc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:05.735835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:05.813323 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 695/1387] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:05.860744 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11decc-e5c1-4379-a279-0c567b391bcd None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:05.862321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-7d11decc-e5c1-4379-a279-0c567b391bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:05.961951 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:06.085903 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11decc-e5c1-4379-a279-0c567b391bcd None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:06.240041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b2e85-065e-4b42-b0e8-01127a99744a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:06.240668 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b2e85-065e-4b42-b0e8-01127a99744a service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:06.240952 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b2e85-065e-4b42-b0e8-01127a99744a service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:06.241231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b2e85-065e-4b42-b0e8-01127a99744a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:06.243255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-854b2e85-065e-4b42-b0e8-01127a99744a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:06.285707 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:06.353987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b2e85-065e-4b42-b0e8-01127a99744a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:06.355990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b2e85-065e-4b42-b0e8-01127a99744a service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:06.378887 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 693/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:08.722788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a28e2-5e44-4b1a-a2ab-8c287c4c4db4 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:08.723371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a28e2-5e44-4b1a-a2ab-8c287c4c4db4 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:08.723371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a28e2-5e44-4b1a-a2ab-8c287c4c4db4 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:08.724710 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 696/1389] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:08.729994 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725f77c-ed46-4d38-95d3-5f8ac0d7aa85 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:08.730433 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725f77c-ed46-4d38-95d3-5f8ac0d7aa85 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:08.730588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725f77c-ed46-4d38-95d3-5f8ac0d7aa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:08.800331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e725f77c-ed46-4d38-95d3-5f8ac0d7aa85 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:08.801563 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e725f77c-ed46-4d38-95d3-5f8ac0d7aa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:08.911576 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 694/1390] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:08.958269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a28e2-5e44-4b1a-a2ab-8c287c4c4db4 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:08.959800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7d2a28e2-5e44-4b1a-a2ab-8c287c4c4db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:09.115102 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a28e2-5e44-4b1a-a2ab-8c287c4c4db4 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:09.131986 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:09.230982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f780adc-8933-41da-8902-baf03db262d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:09.231607 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f780adc-8933-41da-8902-baf03db262d4 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:09.231890 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f780adc-8933-41da-8902-baf03db262d4 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:09.232169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f780adc-8933-41da-8902-baf03db262d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:09.234884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6f780adc-8933-41da-8902-baf03db262d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:09.327914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f780adc-8933-41da-8902-baf03db262d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:09.329557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f780adc-8933-41da-8902-baf03db262d4 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:09.348260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 697/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:09.867759 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe35c41-30f0-4995-b068-678ce0d57f4e None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:09.868455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe35c41-30f0-4995-b068-678ce0d57f4e None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:09.868455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe35c41-30f0-4995-b068-678ce0d57f4e None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:09.869885 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 695/1392] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:09.875517 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d25ac9-6856-4bc0-b77a-97d3730f5143 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:09.875997 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d25ac9-6856-4bc0-b77a-97d3730f5143 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:09.876101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d25ac9-6856-4bc0-b77a-97d3730f5143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:09.902088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:09.946659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-51d25ac9-6856-4bc0-b77a-97d3730f5143 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:09.947866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-51d25ac9-6856-4bc0-b77a-97d3730f5143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:10.047909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 698/1393] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:10.103422 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0930ae2-6497-4909-b77e-91b3f36f4967 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:10.103713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0930ae2-6497-4909-b77e-91b3f36f4967 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:10.103991 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0930ae2-6497-4909-b77e-91b3f36f4967 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:10.105368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 696/1394] 10.222.0.43 () {54 vars in 966 bytes} [Wed Jul 27 10:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:10.111077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec893e-f7a5-4262-be85-9b7cb1a48b6c None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:10.111365 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec893e-f7a5-4262-be85-9b7cb1a48b6c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:10.111752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec893e-f7a5-4262-be85-9b7cb1a48b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:10.190771 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-17ec893e-f7a5-4262-be85-9b7cb1a48b6c None None] MFA Rules not processed for user `bd4e81eb81934784b8632248ecf0894f`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:10.191962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-17ec893e-f7a5-4262-be85-9b7cb1a48b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:10.235360 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:10.273123 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 699/1395] 10.222.0.43 () {58 vars in 1063 bytes} [Wed Jul 27 10:42:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:10.281629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0930ae2-6497-4909-b77e-91b3f36f4967 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:10.283267 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d0930ae2-6497-4909-b77e-91b3f36f4967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:10.298074 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:10.399907 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0930ae2-6497-4909-b77e-91b3f36f4967 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:10.477278 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72bbca-f0ff-47c3-a38f-97ef1d2d1627 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4e81eb81934784b8632248ecf0894f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:10.477813 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72bbca-f0ff-47c3-a38f-97ef1d2d1627 service glance] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:10.478092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72bbca-f0ff-47c3-a38f-97ef1d2d1627 service glance] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:10.478395 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72bbca-f0ff-47c3-a38f-97ef1d2d1627 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:10.480025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3b72bbca-f0ff-47c3-a38f-97ef1d2d1627 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:10.556242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:10.599562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72bbca-f0ff-47c3-a38f-97ef1d2d1627 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:10.600996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72bbca-f0ff-47c3-a38f-97ef1d2d1627 service glance] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:10.619243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 697/1396] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:11.361512 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8432f1-e1b7-432b-98fa-ede1a73190d9 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:11.361994 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8432f1-e1b7-432b-98fa-ede1a73190d9 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:11.362085 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8432f1-e1b7-432b-98fa-ede1a73190d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:11.423494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c09c5-eb02-4290-8673-6439139c569c None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:11.424036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c09c5-eb02-4290-8673-6439139c569c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:11.424036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c09c5-eb02-4290-8673-6439139c569c None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:11.425528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 698/1397] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:42:11.430759 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5c06e-5ee8-4549-aec2-5f952ff33d65 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:11.431044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5c06e-5ee8-4549-aec2-5f952ff33d65 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:11.431210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-8c8432f1-e1b7-432b-98fa-ede1a73190d9 None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:11.431317 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5c06e-5ee8-4549-aec2-5f952ff33d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:11.432436 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8c8432f1-e1b7-432b-98fa-ede1a73190d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:11.499696 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-ead5c06e-5ee8-4549-aec2-5f952ff33d65 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:11.500919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ead5c06e-5ee8-4549-aec2-5f952ff33d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:11.524583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 700/1398] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:11.569223 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e2b5-e836-4d7c-b7ff-3c1a5a14a2ae None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:11.569513 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e2b5-e836-4d7c-b7ff-3c1a5a14a2ae None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:11.569796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05e2b5-e836-4d7c-b7ff-3c1a5a14a2ae None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:11.571182 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 701/1399] 10.222.0.43 () {54 vars in 943 bytes} [Wed Jul 27 10:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:42:11.578107 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96947786-3191-4717-9481-8d00617ab0b7 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:11.578570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96947786-3191-4717-9481-8d00617ab0b7 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:11.578925 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96947786-3191-4717-9481-8d00617ab0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:11.608329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 699/1400] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:11.650102 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:11.654008 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5c06e-5ee8-4549-aec2-5f952ff33d65 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:11.655393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ead5c06e-5ee8-4549-aec2-5f952ff33d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:11.659345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-96947786-3191-4717-9481-8d00617ab0b7 None None] MFA Rules not processed for user `dc3b05867de6493e94c01e3c478e1d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:11.660537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-96947786-3191-4717-9481-8d00617ab0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:11.683561 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:11.776077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 702/1401] 10.222.0.43 () {58 vars in 1040 bytes} [Wed Jul 27 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:42:11.781691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5c06e-5ee8-4549-aec2-5f952ff33d65 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:11.785688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96947786-3191-4717-9481-8d00617ab0b7 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:11.795761 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96947786-3191-4717-9481-8d00617ab0b7 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:11.902148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c25912-d56e-4c3b-85db-7f03fcbe839e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:11.902802 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c25912-d56e-4c3b-85db-7f03fcbe839e service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:11.903085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c25912-d56e-4c3b-85db-7f03fcbe839e service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:11.903357 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c25912-d56e-4c3b-85db-7f03fcbe839e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:11.905346 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b4c25912-d56e-4c3b-85db-7f03fcbe839e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:11.910173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80923d07-15a5-4292-b5a9-0afc8ca8ca58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:11.910831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923d07-15a5-4292-b5a9-0afc8ca8ca58 service swift] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:11.911245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923d07-15a5-4292-b5a9-0afc8ca8ca58 service swift] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:11.911529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80923d07-15a5-4292-b5a9-0afc8ca8ca58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:11.913193 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-80923d07-15a5-4292-b5a9-0afc8ca8ca58 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:11.915796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:11.926024 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:12.006692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80923d07-15a5-4292-b5a9-0afc8ca8ca58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:12.007088 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c25912-d56e-4c3b-85db-7f03fcbe839e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:12.008340 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80923d07-15a5-4292-b5a9-0afc8ca8ca58 service swift] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:12.008688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c25912-d56e-4c3b-85db-7f03fcbe839e service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:12.016698 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 703/1402] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 10:42:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 10:42:12.027997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 700/1403] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:42:14.160944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa1b47-1ea0-48a6-b6fb-e09caa1c056a None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:14.161536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa1b47-1ea0-48a6-b6fb-e09caa1c056a None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:14.161536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa1b47-1ea0-48a6-b6fb-e09caa1c056a None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:14.162878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 704/1404] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:14.168237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3616e-a25b-4eb5-8aa6-9912b99b4dbe None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:14.168667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3616e-a25b-4eb5-8aa6-9912b99b4dbe None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:14.168667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3616e-a25b-4eb5-8aa6-9912b99b4dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:14.247292 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-89a3616e-a25b-4eb5-8aa6-9912b99b4dbe None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:14.249158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-89a3616e-a25b-4eb5-8aa6-9912b99b4dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:14.361274 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:14.368475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 701/1405] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:14.416668 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa1b47-1ea0-48a6-b6fb-e09caa1c056a None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:14.418662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a8fa1b47-1ea0-48a6-b6fb-e09caa1c056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:14.612669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:14.615493 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa1b47-1ea0-48a6-b6fb-e09caa1c056a None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:14.746026 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7272f96-4246-4690-a1af-5182eec5d930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:14.746591 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7272f96-4246-4690-a1af-5182eec5d930 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:14.746872 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7272f96-4246-4690-a1af-5182eec5d930 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:14.747143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7272f96-4246-4690-a1af-5182eec5d930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:14.749367 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a7272f96-4246-4690-a1af-5182eec5d930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:14.851449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7272f96-4246-4690-a1af-5182eec5d930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:14.853354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7272f96-4246-4690-a1af-5182eec5d930 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:14.878023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 705/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:16.972467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d022b8-7a83-46f0-81d2-b3eb1afe7724 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:16.973055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d022b8-7a83-46f0-81d2-b3eb1afe7724 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:16.973055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d022b8-7a83-46f0-81d2-b3eb1afe7724 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:16.978494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 702/1407] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:42:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:16.979690 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46df2a-6554-4f7b-961d-63d74a122c20 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:16.980107 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46df2a-6554-4f7b-961d-63d74a122c20 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:16.980230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46df2a-6554-4f7b-961d-63d74a122c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:16.985459 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:17.054563 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-4f46df2a-6554-4f7b-961d-63d74a122c20 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:17.056340 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-4f46df2a-6554-4f7b-961d-63d74a122c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:17.182236 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 706/1408] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:42:17.221132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d022b8-7a83-46f0-81d2-b3eb1afe7724 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:17.222720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b6d022b8-7a83-46f0-81d2-b3eb1afe7724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:17.395701 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d022b8-7a83-46f0-81d2-b3eb1afe7724 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:17.470969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:17.521639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2491b04-ac02-42ea-b42e-9cc0442cc701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:17.522736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491b04-ac02-42ea-b42e-9cc0442cc701 service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:17.523244 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491b04-ac02-42ea-b42e-9cc0442cc701 service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:17.523738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491b04-ac02-42ea-b42e-9cc0442cc701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:17.525429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f2491b04-ac02-42ea-b42e-9cc0442cc701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:17.632805 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2491b04-ac02-42ea-b42e-9cc0442cc701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:17.634457 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2491b04-ac02-42ea-b42e-9cc0442cc701 service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:17.653818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 703/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:27.174217 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=64 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:27.651460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=64 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:34.889101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6061f-3f91-4feb-9c3c-5fc62033708b None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:34.889765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6061f-3f91-4feb-9c3c-5fc62033708b None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:34.890055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6061f-3f91-4feb-9c3c-5fc62033708b None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:34.891484 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 707/1410] 10.222.0.43 () {54 vars in 918 bytes} [Wed Jul 27 10:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:34.897033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fde795-18ff-47a0-bec7-2ef8accacc93 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:34.897654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fde795-18ff-47a0-bec7-2ef8accacc93 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:34.897654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fde795-18ff-47a0-bec7-2ef8accacc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:34.974715 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-04fde795-18ff-47a0-bec7-2ef8accacc93 None None] MFA Rules not processed for user `39830a354dee41b5b210d80807886299`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:34.975929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-04fde795-18ff-47a0-bec7-2ef8accacc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:35.086886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 704/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Jul 27 10:42:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:35.102117 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288fda0-46a8-452b-adde-47468913fc44 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:35.102440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288fda0-46a8-452b-adde-47468913fc44 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:35.102727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288fda0-46a8-452b-adde-47468913fc44 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:35.104092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 708/1412] 10.222.0.43 () {54 vars in 918 bytes} [Wed Jul 27 10:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:35.109486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168eec2-8d0b-4935-87ee-da7cc9b25294 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:35.109775 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168eec2-8d0b-4935-87ee-da7cc9b25294 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:35.110054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168eec2-8d0b-4935-87ee-da7cc9b25294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:35.186420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:35.190274 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e168eec2-8d0b-4935-87ee-da7cc9b25294 None None] MFA Rules not processed for user `3bb16c9232464cc2aeee12b7fa918b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:35.192103 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e168eec2-8d0b-4935-87ee-da7cc9b25294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:35.308423 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 705/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Jul 27 10:42:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:37.798934 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be25bb-c4f0-49a8-bc22-a5f0b9a544f2 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:37.799723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be25bb-c4f0-49a8-bc22-a5f0b9a544f2 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:37.799723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be25bb-c4f0-49a8-bc22-a5f0b9a544f2 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:37.801110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:37.806734 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ac737-bfc4-4bdc-8121-259b66a681a5 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:37.807214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ac737-bfc4-4bdc-8121-259b66a681a5 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:37.807384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ac737-bfc4-4bdc-8121-259b66a681a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:37.875346 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b12ac737-bfc4-4bdc-8121-259b66a681a5 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:37.876568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b12ac737-bfc4-4bdc-8121-259b66a681a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:37.938024 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:37.983435 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:38.028134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be25bb-c4f0-49a8-bc22-a5f0b9a544f2 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:38.029772 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-e4be25bb-c4f0-49a8-bc22-a5f0b9a544f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:38.181562 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be25bb-c4f0-49a8-bc22-a5f0b9a544f2 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:38.254455 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:38.295515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd3cbf-f2ed-4658-abe6-79f8e5eea759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:38.296482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd3cbf-f2ed-4658-abe6-79f8e5eea759 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:38.296763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd3cbf-f2ed-4658-abe6-79f8e5eea759 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:38.297035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd3cbf-f2ed-4658-abe6-79f8e5eea759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:38.298726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-56cd3cbf-f2ed-4658-abe6-79f8e5eea759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:38.391117 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd3cbf-f2ed-4658-abe6-79f8e5eea759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:38.392736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd3cbf-f2ed-4658-abe6-79f8e5eea759 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:38.411383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 710/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:39.313247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0e30d-f5f6-4e1a-8221-8867fc1cdc1e None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:39.313793 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0e30d-f5f6-4e1a-8221-8867fc1cdc1e None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:39.313793 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0e30d-f5f6-4e1a-8221-8867fc1cdc1e None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:39.315112 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 10:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:39.320306 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae110-2773-421d-8932-67b821772000 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:39.320709 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae110-2773-421d-8932-67b821772000 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:39.321441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae110-2773-421d-8932-67b821772000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:39.403326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-fccae110-2773-421d-8932-67b821772000 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:39.404539 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-fccae110-2773-421d-8932-67b821772000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:39.441670 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:39.516818 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 10:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:39.669324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0e30d-f5f6-4e1a-8221-8867fc1cdc1e None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:39.671112 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f5f0e30d-f5f6-4e1a-8221-8867fc1cdc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:39.819257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0e30d-f5f6-4e1a-8221-8867fc1cdc1e None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:39.860147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:39.939243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa810b-8093-4e78-b241-806a068d8395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:39.939869 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa810b-8093-4e78-b241-806a068d8395 service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:39.940148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa810b-8093-4e78-b241-806a068d8395 service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:39.940420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa810b-8093-4e78-b241-806a068d8395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:39.942066 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-66fa810b-8093-4e78-b241-806a068d8395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:40.032274 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa810b-8093-4e78-b241-806a068d8395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:40.033862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa810b-8093-4e78-b241-806a068d8395 service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:40.052005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 708/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:40.943309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a524b4-ad4d-4256-92ce-8251ffd5dcbc None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:40.943885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a524b4-ad4d-4256-92ce-8251ffd5dcbc None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:40.943885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a524b4-ad4d-4256-92ce-8251ffd5dcbc None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:40.945240 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 10:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:40.950275 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd7873-cf42-46da-aec4-d56aeb515f75 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:40.950667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd7873-cf42-46da-aec4-d56aeb515f75 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:40.950844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd7873-cf42-46da-aec4-d56aeb515f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:41.005908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:41.028571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-22cd7873-cf42-46da-aec4-d56aeb515f75 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:41.029792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-22cd7873-cf42-46da-aec4-d56aeb515f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:41.132914 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 10:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:41.296775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a524b4-ad4d-4256-92ce-8251ffd5dcbc None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:41.298627 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-93a524b4-ad4d-4256-92ce-8251ffd5dcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:41.448436 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a524b4-ad4d-4256-92ce-8251ffd5dcbc None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:41.461754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:41.566739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a729e-f56f-4731-b91e-635be20ac642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:41.567368 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a729e-f56f-4731-b91e-635be20ac642 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:41.567650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a729e-f56f-4731-b91e-635be20ac642 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:41.567927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a729e-f56f-4731-b91e-635be20ac642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:41.569605 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-db6a729e-f56f-4731-b91e-635be20ac642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:41.660297 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a729e-f56f-4731-b91e-635be20ac642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:41.661902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a729e-f56f-4731-b91e-635be20ac642 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:41.680634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 713/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:42.564928 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e770b19-372e-4f4d-bce3-80447eaabc3f None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:42.565828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e770b19-372e-4f4d-bce3-80447eaabc3f None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:42.565828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e770b19-372e-4f4d-bce3-80447eaabc3f None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:42.566870 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 10:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:42.572250 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74749648-212a-4188-ae1d-833488b9c7d0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:42.572712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74749648-212a-4188-ae1d-833488b9c7d0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:42.572834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74749648-212a-4188-ae1d-833488b9c7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:42.593736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:42.651503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-74749648-212a-4188-ae1d-833488b9c7d0 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:42.652718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-74749648-212a-4188-ae1d-833488b9c7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:42.752398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 10:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:42.901967 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e770b19-372e-4f4d-bce3-80447eaabc3f None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:42.903520 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0e770b19-372e-4f4d-bce3-80447eaabc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:43.013784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:43.052448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e770b19-372e-4f4d-bce3-80447eaabc3f None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:43.169496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7940f-4c0b-401c-bde6-3697ffecf01e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:43.170025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7940f-4c0b-401c-bde6-3697ffecf01e service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:43.170431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7940f-4c0b-401c-bde6-3697ffecf01e service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:43.170635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7940f-4c0b-401c-bde6-3697ffecf01e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:43.172485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-70d7940f-4c0b-401c-bde6-3697ffecf01e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:43.249095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:43.262941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7940f-4c0b-401c-bde6-3697ffecf01e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:43.265106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7940f-4c0b-401c-bde6-3697ffecf01e service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:43.284332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 711/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:44.154051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7119-fce3-4ca6-ba2e-d6b19ea6aeba None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:44.154611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7119-fce3-4ca6-ba2e-d6b19ea6aeba None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:44.154611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7119-fce3-4ca6-ba2e-d6b19ea6aeba None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:44.156054 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 10:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:44.161143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8583843-4209-4e92-86c4-1e9fcec3928e None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:44.161586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8583843-4209-4e92-86c4-1e9fcec3928e None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:44.161697 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8583843-4209-4e92-86c4-1e9fcec3928e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:44.237730 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-a8583843-4209-4e92-86c4-1e9fcec3928e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:44.238961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a8583843-4209-4e92-86c4-1e9fcec3928e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:44.336975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 10:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:44.490841 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a7119-fce3-4ca6-ba2e-d6b19ea6aeba None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:44.492303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-e54a7119-fce3-4ca6-ba2e-d6b19ea6aeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:44.576728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:44.640485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a7119-fce3-4ca6-ba2e-d6b19ea6aeba None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:44.754442 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fe418-374f-48e6-95ea-93dfdf0a4daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:44.754968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fe418-374f-48e6-95ea-93dfdf0a4daa service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:44.755245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fe418-374f-48e6-95ea-93dfdf0a4daa service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:44.755523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fe418-374f-48e6-95ea-93dfdf0a4daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:44.757133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1e9fe418-374f-48e6-95ea-93dfdf0a4daa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:44.804979 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:44.847514 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fe418-374f-48e6-95ea-93dfdf0a4daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:44.849118 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fe418-374f-48e6-95ea-93dfdf0a4daa service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:44.868288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 716/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:45.743284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06d6f5-ef24-4988-86f7-514ee1840cec None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:45.743898 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06d6f5-ef24-4988-86f7-514ee1840cec None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:45.743898 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06d6f5-ef24-4988-86f7-514ee1840cec None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:45.745212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 10:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:45.750296 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9e4fb-9c38-42fb-9b50-ddcd27494f40 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:45.750723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9e4fb-9c38-42fb-9b50-ddcd27494f40 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:45.750832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9e4fb-9c38-42fb-9b50-ddcd27494f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:45.826809 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-dcb9e4fb-9c38-42fb-9b50-ddcd27494f40 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:45.828240 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-dcb9e4fb-9c38-42fb-9b50-ddcd27494f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:45.928393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 10:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:46.081206 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06d6f5-ef24-4988-86f7-514ee1840cec None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:46.082763 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-db06d6f5-ef24-4988-86f7-514ee1840cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:46.137499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:46.238131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06d6f5-ef24-4988-86f7-514ee1840cec None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:46.356120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19bdbe-7f54-4390-afbf-6048c0f6cf26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:46.356780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19bdbe-7f54-4390-afbf-6048c0f6cf26 service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:46.357068 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19bdbe-7f54-4390-afbf-6048c0f6cf26 service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:46.357344 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19bdbe-7f54-4390-afbf-6048c0f6cf26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:46.359156 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4f19bdbe-7f54-4390-afbf-6048c0f6cf26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:46.366336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:46.453454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19bdbe-7f54-4390-afbf-6048c0f6cf26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:46.455036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19bdbe-7f54-4390-afbf-6048c0f6cf26 service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:46.478722 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 714/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:47.307371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1170d6-8970-4811-a14e-4ec8b5252f6f None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:47.307958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1170d6-8970-4811-a14e-4ec8b5252f6f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:47.307958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1170d6-8970-4811-a14e-4ec8b5252f6f None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:47.309272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 10:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:47.315116 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ec7b4-fc37-40a6-a203-d0ef5991f5f4 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:47.315611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ec7b4-fc37-40a6-a203-d0ef5991f5f4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:47.315711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ec7b4-fc37-40a6-a203-d0ef5991f5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:47.393406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-cc1ec7b4-fc37-40a6-a203-d0ef5991f5f4 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:47.394673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-cc1ec7b4-fc37-40a6-a203-d0ef5991f5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:47.465135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:47.494154 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 10:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:47.657082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1170d6-8970-4811-a14e-4ec8b5252f6f None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:47.658645 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5c1170d6-8970-4811-a14e-4ec8b5252f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:47.677498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:47.810558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1170d6-8970-4811-a14e-4ec8b5252f6f None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:47.898857 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:47.926759 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb508d1-a50f-434e-a646-7bc6cf2b9e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:47.927385 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb508d1-a50f-434e-a646-7bc6cf2b9e63 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:47.927667 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb508d1-a50f-434e-a646-7bc6cf2b9e63 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:47.927939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb508d1-a50f-434e-a646-7bc6cf2b9e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:47.929597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8bb508d1-a50f-434e-a646-7bc6cf2b9e63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:48.023978 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb508d1-a50f-434e-a646-7bc6cf2b9e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:48.025605 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb508d1-a50f-434e-a646-7bc6cf2b9e63 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:48.045249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 719/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:48.863143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318c9cd-0559-4909-944e-3f1e9fd57d09 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:48.863680 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318c9cd-0559-4909-944e-3f1e9fd57d09 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:48.863680 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318c9cd-0559-4909-944e-3f1e9fd57d09 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:48.864978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 10:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:48.870455 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349d733-3de8-4a93-ae1c-f3b642336168 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:48.871007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349d733-3de8-4a93-ae1c-f3b642336168 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:48.871007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349d733-3de8-4a93-ae1c-f3b642336168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:48.954906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-5349d733-3de8-4a93-ae1c-f3b642336168 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:48.956130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5349d733-3de8-4a93-ae1c-f3b642336168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:49.002996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:49.063544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 10:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:49.223496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318c9cd-0559-4909-944e-3f1e9fd57d09 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:49.225047 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-2318c9cd-0559-4909-944e-3f1e9fd57d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:49.417005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318c9cd-0559-4909-944e-3f1e9fd57d09 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:49.481971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:49.557462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283eea8-6732-4699-8753-a649e49726db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:49.558673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283eea8-6732-4699-8753-a649e49726db service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:49.559180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283eea8-6732-4699-8753-a649e49726db service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:49.559687 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283eea8-6732-4699-8753-a649e49726db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:49.563058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3283eea8-6732-4699-8753-a649e49726db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:49.676409 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283eea8-6732-4699-8753-a649e49726db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:49.678067 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283eea8-6732-4699-8753-a649e49726db service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:49.699305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 717/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:50.676257 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c571377-ea3a-4c5f-87d8-9bfb8aece88d None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:50.676862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c571377-ea3a-4c5f-87d8-9bfb8aece88d None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:50.676862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c571377-ea3a-4c5f-87d8-9bfb8aece88d None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:50.678158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 10:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:50.683068 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdf5a0-057f-4e9d-8537-1d42e7542076 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:50.683510 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdf5a0-057f-4e9d-8537-1d42e7542076 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:50.683626 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdf5a0-057f-4e9d-8537-1d42e7542076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:50.766488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-d3bdf5a0-057f-4e9d-8537-1d42e7542076 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:50.767716 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d3bdf5a0-057f-4e9d-8537-1d42e7542076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:50.769784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:50.872042 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 10:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:51.023936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c571377-ea3a-4c5f-87d8-9bfb8aece88d None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:51.025403 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9c571377-ea3a-4c5f-87d8-9bfb8aece88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:51.195734 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c571377-ea3a-4c5f-87d8-9bfb8aece88d None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:51.238773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:51.344108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1260a-33b8-48f2-98f0-8edf781fb114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:51.344635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1260a-33b8-48f2-98f0-8edf781fb114 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:51.344919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1260a-33b8-48f2-98f0-8edf781fb114 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:51.345191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1260a-33b8-48f2-98f0-8edf781fb114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:51.346856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f6a1260a-33b8-48f2-98f0-8edf781fb114 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:51.438829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1260a-33b8-48f2-98f0-8edf781fb114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:51.440444 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1260a-33b8-48f2-98f0-8edf781fb114 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:51.460590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 722/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:53.939340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab391e17-6727-4941-a8bd-7c22f21cdf7a None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:53.940171 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab391e17-6727-4941-a8bd-7c22f21cdf7a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:53.940171 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab391e17-6727-4941-a8bd-7c22f21cdf7a None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:53.942721 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:42:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:53.951068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb3055-01fa-4331-a653-c6cd3bb6026a None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:53.952122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb3055-01fa-4331-a653-c6cd3bb6026a None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:53.952122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb3055-01fa-4331-a653-c6cd3bb6026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:54.016829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:54.053561 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-9ceb3055-01fa-4331-a653-c6cd3bb6026a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:54.054819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9ceb3055-01fa-4331-a653-c6cd3bb6026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:54.214868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:42:54.264174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab391e17-6727-4941-a8bd-7c22f21cdf7a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:54.266757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ab391e17-6727-4941-a8bd-7c22f21cdf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:54.384867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab391e17-6727-4941-a8bd-7c22f21cdf7a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:54.432399 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:54.486005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9107475-0bda-4102-a278-490a8a6b3dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:54.486722 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9107475-0bda-4102-a278-490a8a6b3dde service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:54.487005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9107475-0bda-4102-a278-490a8a6b3dde service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:54.487281 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9107475-0bda-4102-a278-490a8a6b3dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:54.488936 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b9107475-0bda-4102-a278-490a8a6b3dde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:54.602125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9107475-0bda-4102-a278-490a8a6b3dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:54.604138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9107475-0bda-4102-a278-490a8a6b3dde service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:54.628764 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 720/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:42:57.173371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99c990-6594-4ea0-8ce7-8f12b4dceb8b None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:57.174004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99c990-6594-4ea0-8ce7-8f12b4dceb8b None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:57.174004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99c990-6594-4ea0-8ce7-8f12b4dceb8b None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:57.175576 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:42:57.184860 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d13921-04f3-421b-a318-207edb392136 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:57.185319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d13921-04f3-421b-a318-207edb392136 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:57.185463 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d13921-04f3-421b-a318-207edb392136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:57.286244 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e2d13921-04f3-421b-a318-207edb392136 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:42:57.287480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e2d13921-04f3-421b-a318-207edb392136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:57.301350 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:57.397134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:42:57.458316 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99c990-6594-4ea0-8ce7-8f12b4dceb8b None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:42:57.458316 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5e99c990-6594-4ea0-8ce7-8f12b4dceb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:57.589999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99c990-6594-4ea0-8ce7-8f12b4dceb8b None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:42:57.603825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:42:57.696539 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc90f7-50ad-4941-8be9-686a6f17cf22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:42:57.697567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc90f7-50ad-4941-8be9-686a6f17cf22 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:42:57.698110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc90f7-50ad-4941-8be9-686a6f17cf22 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:42:57.698683 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc90f7-50ad-4941-8be9-686a6f17cf22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:42:57.701642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-06cc90f7-50ad-4941-8be9-686a6f17cf22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:42:57.862635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc90f7-50ad-4941-8be9-686a6f17cf22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:42:57.864785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc90f7-50ad-4941-8be9-686a6f17cf22 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:42:57.896842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 725/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:43:00.415316 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea967-6e97-44ad-a796-abfdfb7671b3 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:00.416028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea967-6e97-44ad-a796-abfdfb7671b3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:00.416028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ea967-6e97-44ad-a796-abfdfb7671b3 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:00.417214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:00.423830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3d3d6-5c13-4fe3-8be7-f665c68ff7a6 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:00.424373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3d3d6-5c13-4fe3-8be7-f665c68ff7a6 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:00.424683 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3d3d6-5c13-4fe3-8be7-f665c68ff7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:00.477425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:00.498516 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-a2c3d3d6-5c13-4fe3-8be7-f665c68ff7a6 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:00.500637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a2c3d3d6-5c13-4fe3-8be7-f665c68ff7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:00.603708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:00.644486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea967-6e97-44ad-a796-abfdfb7671b3 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:00.646092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-418ea967-6e97-44ad-a796-abfdfb7671b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:00.766570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ea967-6e97-44ad-a796-abfdfb7671b3 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:00.809032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:00.846797 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f81da-d523-4fd0-b873-631c4b58bb83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:00.847413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f81da-d523-4fd0-b873-631c4b58bb83 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:00.847692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f81da-d523-4fd0-b873-631c4b58bb83 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:00.847963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f81da-d523-4fd0-b873-631c4b58bb83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:00.849619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-126f81da-d523-4fd0-b873-631c4b58bb83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:01.098937 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f81da-d523-4fd0-b873-631c4b58bb83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:01.100412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f81da-d523-4fd0-b873-631c4b58bb83 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:01.119615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 723/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:43:03.352634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6184d3e-7bed-4b28-8da9-b472b0f33886 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:03.353158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6184d3e-7bed-4b28-8da9-b472b0f33886 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:03.353158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6184d3e-7bed-4b28-8da9-b472b0f33886 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:03.354506 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:03.360835 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f5e18-cbc3-4f6d-8c7a-5cb747e1336b None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:03.361301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f5e18-cbc3-4f6d-8c7a-5cb747e1336b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:03.361464 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f5e18-cbc3-4f6d-8c7a-5cb747e1336b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:03.455170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-124f5e18-cbc3-4f6d-8c7a-5cb747e1336b None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:03.456441 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-124f5e18-cbc3-4f6d-8c7a-5cb747e1336b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:03.480085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:03.583866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:03.631793 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6184d3e-7bed-4b28-8da9-b472b0f33886 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:03.633538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b6184d3e-7bed-4b28-8da9-b472b0f33886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:03.783550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6184d3e-7bed-4b28-8da9-b472b0f33886 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:03.821893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:04.028628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67ffe4-a455-4b48-80f2-7a138f3d02ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:04.029161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67ffe4-a455-4b48-80f2-7a138f3d02ea service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:04.029443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67ffe4-a455-4b48-80f2-7a138f3d02ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:04.029720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67ffe4-a455-4b48-80f2-7a138f3d02ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:04.033359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-4a67ffe4-a455-4b48-80f2-7a138f3d02ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:04.162828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67ffe4-a455-4b48-80f2-7a138f3d02ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:04.165410 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67ffe4-a455-4b48-80f2-7a138f3d02ea service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:04.193201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 728/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:43:06.366080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fc66c-5b3e-431e-aec1-02d8068fb9a8 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:06.366654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fc66c-5b3e-431e-aec1-02d8068fb9a8 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:06.366654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fc66c-5b3e-431e-aec1-02d8068fb9a8 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:06.368045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:06.373655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb0f8a-da2f-4ad8-b3ec-afca9d47a6ce None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:06.374793 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb0f8a-da2f-4ad8-b3ec-afca9d47a6ce None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:06.374910 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb0f8a-da2f-4ad8-b3ec-afca9d47a6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:06.440094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:06.443729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-87bb0f8a-da2f-4ad8-b3ec-afca9d47a6ce None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:06.445375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-87bb0f8a-da2f-4ad8-b3ec-afca9d47a6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:06.542822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:06.582261 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fc66c-5b3e-431e-aec1-02d8068fb9a8 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:06.583815 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-707fc66c-5b3e-431e-aec1-02d8068fb9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:06.692959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fc66c-5b3e-431e-aec1-02d8068fb9a8 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:06.743983 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:06.769388 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94e899-3344-49d1-84b8-6fbe0f27e3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:06.770014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e899-3344-49d1-84b8-6fbe0f27e3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:06.770341 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e899-3344-49d1-84b8-6fbe0f27e3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:06.770615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e899-3344-49d1-84b8-6fbe0f27e3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:06.772268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-db94e899-3344-49d1-84b8-6fbe0f27e3f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:06.889388 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94e899-3344-49d1-84b8-6fbe0f27e3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:06.891208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94e899-3344-49d1-84b8-6fbe0f27e3f3 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:06.911651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 726/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:43:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:43:09.058590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b1751-d165-44b4-bc3e-38a991b1f35a None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:09.059124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b1751-d165-44b4-bc3e-38a991b1f35a None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:09.059124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b1751-d165-44b4-bc3e-38a991b1f35a None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:09.060467 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:09.066110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4f777-feda-4047-b68e-1ca11f674332 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:09.066571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4f777-feda-4047-b68e-1ca11f674332 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:09.066732 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4f777-feda-4047-b68e-1ca11f674332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:09.133866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-dbd4f777-feda-4047-b68e-1ca11f674332 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:09.135048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-dbd4f777-feda-4047-b68e-1ca11f674332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:09.164912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:09.234436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:09.272362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b1751-d165-44b4-bc3e-38a991b1f35a None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:09.273884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-211b1751-d165-44b4-bc3e-38a991b1f35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:09.381183 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b1751-d165-44b4-bc3e-38a991b1f35a None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:09.410408 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:09.460254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53124374-63b2-4316-ac73-f4f86d424bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:09.460876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53124374-63b2-4316-ac73-f4f86d424bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:09.461159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53124374-63b2-4316-ac73-f4f86d424bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:09.461437 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53124374-63b2-4316-ac73-f4f86d424bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:09.463107 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-53124374-63b2-4316-ac73-f4f86d424bb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:09.572563 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53124374-63b2-4316-ac73-f4f86d424bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:09.574006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53124374-63b2-4316-ac73-f4f86d424bb9 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:09.592399 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 731/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:43:11.788314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116ecc3-a9b7-4e29-9981-418772ec0a9a None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:11.788876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116ecc3-a9b7-4e29-9981-418772ec0a9a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:11.788876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116ecc3-a9b7-4e29-9981-418772ec0a9a None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:11.790246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:11.795623 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aaabd-96fc-4665-8f4d-5041b8d2bdd2 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:11.796574 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aaabd-96fc-4665-8f4d-5041b8d2bdd2 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:11.796688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aaabd-96fc-4665-8f4d-5041b8d2bdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:11.869776 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-af1aaabd-96fc-4665-8f4d-5041b8d2bdd2 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:11.871067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-af1aaabd-96fc-4665-8f4d-5041b8d2bdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:11.880655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:11.976904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:12.014747 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116ecc3-a9b7-4e29-9981-418772ec0a9a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:12.016649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f116ecc3-a9b7-4e29-9981-418772ec0a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:12.122864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116ecc3-a9b7-4e29-9981-418772ec0a9a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:12.181792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:12.200639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540863a-99e1-4618-ac76-006eee12fa89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:12.201250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540863a-99e1-4618-ac76-006eee12fa89 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:12.201534 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540863a-99e1-4618-ac76-006eee12fa89 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:12.201807 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540863a-99e1-4618-ac76-006eee12fa89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:12.203655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b540863a-99e1-4618-ac76-006eee12fa89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:12.325437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540863a-99e1-4618-ac76-006eee12fa89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:12.326984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540863a-99e1-4618-ac76-006eee12fa89 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:12.348254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 729/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:43:14.519337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bafdeb-48e3-4a62-a572-4b2f826799b2 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:14.520164 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bafdeb-48e3-4a62-a572-4b2f826799b2 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:14.520164 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bafdeb-48e3-4a62-a572-4b2f826799b2 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:14.521233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:14.528041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefc311-faa3-4730-8c7d-b569e920e85a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:14.528586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefc311-faa3-4730-8c7d-b569e920e85a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:14.528938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefc311-faa3-4730-8c7d-b569e920e85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:14.616342 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-4fefc311-faa3-4730-8c7d-b569e920e85a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:14.617603 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4fefc311-faa3-4730-8c7d-b569e920e85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:14.674706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:14.748754 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:14.792981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bafdeb-48e3-4a62-a572-4b2f826799b2 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:14.794601 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-50bafdeb-48e3-4a62-a572-4b2f826799b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:14.910493 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bafdeb-48e3-4a62-a572-4b2f826799b2 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:14.949833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:14.988352 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bf37a-b908-4f43-99fa-fafff94ec87f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:14.988978 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bf37a-b908-4f43-99fa-fafff94ec87f service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:14.989259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bf37a-b908-4f43-99fa-fafff94ec87f service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:14.989556 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bf37a-b908-4f43-99fa-fafff94ec87f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:14.991209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-446bf37a-b908-4f43-99fa-fafff94ec87f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:15.118633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bf37a-b908-4f43-99fa-fafff94ec87f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:15.120189 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bf37a-b908-4f43-99fa-fafff94ec87f service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:15.144239 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 734/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:43:17.282753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e62998-bd3f-40c4-9817-34d61e7f5db0 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:17.283367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e62998-bd3f-40c4-9817-34d61e7f5db0 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:17.283367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e62998-bd3f-40c4-9817-34d61e7f5db0 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:17.284671 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:17.290077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078480ed-6d78-46f1-bb9b-2442ec9ab585 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:17.290652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078480ed-6d78-46f1-bb9b-2442ec9ab585 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:17.290652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078480ed-6d78-46f1-bb9b-2442ec9ab585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:17.363350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-078480ed-6d78-46f1-bb9b-2442ec9ab585 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:17.364560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-078480ed-6d78-46f1-bb9b-2442ec9ab585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:17.383210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:17.464982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:17.503201 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e62998-bd3f-40c4-9817-34d61e7f5db0 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:17.504752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-89e62998-bd3f-40c4-9817-34d61e7f5db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:17.620258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e62998-bd3f-40c4-9817-34d61e7f5db0 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:17.688721 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:17.695938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dac889-5ddb-4532-8a5a-a609027dea83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:17.696552 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dac889-5ddb-4532-8a5a-a609027dea83 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:17.696832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dac889-5ddb-4532-8a5a-a609027dea83 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:17.697109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dac889-5ddb-4532-8a5a-a609027dea83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:17.698774 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b8dac889-5ddb-4532-8a5a-a609027dea83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:17.814515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dac889-5ddb-4532-8a5a-a609027dea83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:17.815960 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dac889-5ddb-4532-8a5a-a609027dea83 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:17.835567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 732/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:43:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:43:19.958296 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f03441-a757-4a56-be73-38292ac8dd8f None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:19.958855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f03441-a757-4a56-be73-38292ac8dd8f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:19.958855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f03441-a757-4a56-be73-38292ac8dd8f None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:19.960193 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:19.965689 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b0e5f-5087-4363-84e7-96e34c13ca38 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:19.966156 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b0e5f-5087-4363-84e7-96e34c13ca38 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:19.966287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b0e5f-5087-4363-84e7-96e34c13ca38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:20.034693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-1b5b0e5f-5087-4363-84e7-96e34c13ca38 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:20.035869 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1b5b0e5f-5087-4363-84e7-96e34c13ca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:20.086965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:20.137269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:20.173998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f03441-a757-4a56-be73-38292ac8dd8f None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:20.175687 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-28f03441-a757-4a56-be73-38292ac8dd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:20.302481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f03441-a757-4a56-be73-38292ac8dd8f None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:20.351651 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:20.383356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b2d03-00f4-416b-aad9-e6e16a59ab0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:20.383979 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b2d03-00f4-416b-aad9-e6e16a59ab0a service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:20.384253 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b2d03-00f4-416b-aad9-e6e16a59ab0a service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:20.384518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b2d03-00f4-416b-aad9-e6e16a59ab0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:20.386155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-fd1b2d03-00f4-416b-aad9-e6e16a59ab0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:20.506200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b2d03-00f4-416b-aad9-e6e16a59ab0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:20.507565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b2d03-00f4-416b-aad9-e6e16a59ab0a service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:20.525771 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 737/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:43:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:43:30.135399 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=22 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:30.523462 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=66 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:40.497881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98d85a-ce81-48f5-9a60-e61f0d0c7757 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:40.498509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98d85a-ce81-48f5-9a60-e61f0d0c7757 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:40.498509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98d85a-ce81-48f5-9a60-e61f0d0c7757 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:40.500453 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 734/1471] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:43:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:40.505712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363adf98-89a7-4ec4-867d-567b5331fd6e None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:40.506158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363adf98-89a7-4ec4-867d-567b5331fd6e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:40.506281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363adf98-89a7-4ec4-867d-567b5331fd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:40.573014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-363adf98-89a7-4ec4-867d-567b5331fd6e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:40.574259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-363adf98-89a7-4ec4-867d-567b5331fd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:40.673924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 738/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:40.758908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e83cb1-5048-46b9-a526-512f4ea7bb39 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:40.759227 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e83cb1-5048-46b9-a526-512f4ea7bb39 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:40.759537 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e83cb1-5048-46b9-a526-512f4ea7bb39 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:40.760897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 735/1473] 10.222.0.43 () {54 vars in 966 bytes} [Wed Jul 27 10:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:40.765927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981963d-80ad-473d-b90c-cc65d714b18c None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:40.766258 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981963d-80ad-473d-b90c-cc65d714b18c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:40.766537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981963d-80ad-473d-b90c-cc65d714b18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:40.842903 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-9981963d-80ad-473d-b90c-cc65d714b18c None None] MFA Rules not processed for user `bd4e81eb81934784b8632248ecf0894f`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:40.844725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9981963d-80ad-473d-b90c-cc65d714b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:40.865846 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:40.923597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 739/1474] 10.222.0.43 () {58 vars in 1063 bytes} [Wed Jul 27 10:43:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:40.931569 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e83cb1-5048-46b9-a526-512f4ea7bb39 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:40.933121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-49e83cb1-5048-46b9-a526-512f4ea7bb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:41.037158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e83cb1-5048-46b9-a526-512f4ea7bb39 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:41.112291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cdf6a-15c6-4ba7-bb96-9ecfcd5fa9da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4e81eb81934784b8632248ecf0894f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:41.113012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cdf6a-15c6-4ba7-bb96-9ecfcd5fa9da service glance] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:41.113283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cdf6a-15c6-4ba7-bb96-9ecfcd5fa9da service glance] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:41.113475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cdf6a-15c6-4ba7-bb96-9ecfcd5fa9da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:41.115157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-711cdf6a-15c6-4ba7-bb96-9ecfcd5fa9da service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:41.170578 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:41.226132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cdf6a-15c6-4ba7-bb96-9ecfcd5fa9da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:41.227585 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cdf6a-15c6-4ba7-bb96-9ecfcd5fa9da service glance] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:41.245613 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 736/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:43:43.350680 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624764-71cb-4e3b-bc5c-458c90f242ed None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:43.351220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624764-71cb-4e3b-bc5c-458c90f242ed None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:43.351220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624764-71cb-4e3b-bc5c-458c90f242ed None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:43.352491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 740/1476] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:43.357785 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755010a-92a3-4572-8fb0-11542765a534 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:43.358260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755010a-92a3-4572-8fb0-11542765a534 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:43.358376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755010a-92a3-4572-8fb0-11542765a534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:43.425455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-4755010a-92a3-4572-8fb0-11542765a534 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:43.426717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4755010a-92a3-4572-8fb0-11542765a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:43.525223 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 737/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:43.547938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624764-71cb-4e3b-bc5c-458c90f242ed None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:43.549464 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-27624764-71cb-4e3b-bc5c-458c90f242ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:43.681016 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624764-71cb-4e3b-bc5c-458c90f242ed None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:43.731522 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:43.778803 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14152404-fa61-49f3-81f2-6b5a0d49f7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:43.779446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14152404-fa61-49f3-81f2-6b5a0d49f7cd admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:43.779734 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14152404-fa61-49f3-81f2-6b5a0d49f7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:43.780022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14152404-fa61-49f3-81f2-6b5a0d49f7cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:43.781170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14152404-fa61-49f3-81f2-6b5a0d49f7cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:43.783032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: WARNING py.warnings [None req-14152404-fa61-49f3-81f2-6b5a0d49f7cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:43:43.783032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: warnings.warn(msg) Jul 27 10:43:43.783032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: Jul 27 10:43:43.784318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14152404-fa61-49f3-81f2-6b5a0d49f7cd admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:43.803974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 741/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jul 27 10:43:43 2022] GET /identity/v3/projects => generated 2553 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:43:45.867528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb87499-560e-40f8-aa08-cba7edc50780 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:45.868074 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb87499-560e-40f8-aa08-cba7edc50780 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:45.868074 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb87499-560e-40f8-aa08-cba7edc50780 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:45.869416 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 738/1479] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:45.875206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a124ba5-118e-4c2d-ace0-9b89e8410abb None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:45.875634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a124ba5-118e-4c2d-ace0-9b89e8410abb None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:45.875763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a124ba5-118e-4c2d-ace0-9b89e8410abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:45.944068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-4a124ba5-118e-4c2d-ace0-9b89e8410abb None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:45.945311 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-4a124ba5-118e-4c2d-ace0-9b89e8410abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:46.042739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 742/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:46.086998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb87499-560e-40f8-aa08-cba7edc50780 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:46.088592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-dfb87499-560e-40f8-aa08-cba7edc50780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:46.099077 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:46.236707 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb87499-560e-40f8-aa08-cba7edc50780 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:46.317994 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:46.352356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc73846-2ec4-41b2-a985-364b470b6538 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:46.352980 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73846-2ec4-41b2-a985-364b470b6538 service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:46.353265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73846-2ec4-41b2-a985-364b470b6538 service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:46.353543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73846-2ec4-41b2-a985-364b470b6538 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:46.355234 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-fcc73846-2ec4-41b2-a985-364b470b6538 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:46.444531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73846-2ec4-41b2-a985-364b470b6538 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:46.446138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73846-2ec4-41b2-a985-364b470b6538 service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:46.465571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 739/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:43:48.719329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e171-9b74-4da8-ab72-07a6406d8ac1 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:48.719953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e171-9b74-4da8-ab72-07a6406d8ac1 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:48.719953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8e171-9b74-4da8-ab72-07a6406d8ac1 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:48.721265 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 743/1482] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:48.726430 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a21882-8380-4b67-8def-b81aa7a01224 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:48.726851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a21882-8380-4b67-8def-b81aa7a01224 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:48.726965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a21882-8380-4b67-8def-b81aa7a01224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:48.794839 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e6a21882-8380-4b67-8def-b81aa7a01224 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:48.795962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e6a21882-8380-4b67-8def-b81aa7a01224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:48.847247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:48.902945 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 740/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:48.942537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8e171-9b74-4da8-ab72-07a6406d8ac1 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:48.944216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-71d8e171-9b74-4da8-ab72-07a6406d8ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:48.968492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:49.050433 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8e171-9b74-4da8-ab72-07a6406d8ac1 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:49.131272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c6563-63e2-49db-be85-8a7e3e40770a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:49.131891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c6563-63e2-49db-be85-8a7e3e40770a service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:49.132179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c6563-63e2-49db-be85-8a7e3e40770a service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:49.132452 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c6563-63e2-49db-be85-8a7e3e40770a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:49.134088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-560c6563-63e2-49db-be85-8a7e3e40770a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:49.210018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:49.245985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c6563-63e2-49db-be85-8a7e3e40770a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:49.247454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c6563-63e2-49db-be85-8a7e3e40770a service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:49.266287 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 744/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:43:51.346056 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af8dc4-3a50-41da-8360-ad5b22b6b94b None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:51.346657 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af8dc4-3a50-41da-8360-ad5b22b6b94b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:51.346657 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af8dc4-3a50-41da-8360-ad5b22b6b94b None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:51.348051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 741/1485] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:51.353385 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279975f-2cdc-43d0-9206-4f16f5be5fc4 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:51.353801 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279975f-2cdc-43d0-9206-4f16f5be5fc4 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:51.353939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279975f-2cdc-43d0-9206-4f16f5be5fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:51.421036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-b279975f-2cdc-43d0-9206-4f16f5be5fc4 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:51.422357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b279975f-2cdc-43d0-9206-4f16f5be5fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:51.520126 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 745/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:51.558726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af8dc4-3a50-41da-8360-ad5b22b6b94b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:51.560260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e9af8dc4-3a50-41da-8360-ad5b22b6b94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:51.666728 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af8dc4-3a50-41da-8360-ad5b22b6b94b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:51.740163 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:51.742442 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b5c20-3cfd-4374-b387-22a7b9582702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:51.743274 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b5c20-3cfd-4374-b387-22a7b9582702 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:51.743749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b5c20-3cfd-4374-b387-22a7b9582702 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:51.744244 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b5c20-3cfd-4374-b387-22a7b9582702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:51.745925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5b3b5c20-3cfd-4374-b387-22a7b9582702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:51.859847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b5c20-3cfd-4374-b387-22a7b9582702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:51.861165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b5c20-3cfd-4374-b387-22a7b9582702 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:51.882148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 742/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:43:54.014691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9d525-324f-4469-b487-46b4907f78b5 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:54.015275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9d525-324f-4469-b487-46b4907f78b5 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:54.015409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9d525-324f-4469-b487-46b4907f78b5 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:54.016652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 746/1488] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:54.022008 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59888833-93a9-4fb6-857d-8aeb41c2fcd7 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:54.022507 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59888833-93a9-4fb6-857d-8aeb41c2fcd7 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:54.022605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59888833-93a9-4fb6-857d-8aeb41c2fcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:54.091154 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-59888833-93a9-4fb6-857d-8aeb41c2fcd7 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:54.092387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-59888833-93a9-4fb6-857d-8aeb41c2fcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:54.147574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:54.193437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 743/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:54.234913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9d525-324f-4469-b487-46b4907f78b5 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:54.236486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-fbd9d525-324f-4469-b487-46b4907f78b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:54.271937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:54.341233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9d525-324f-4469-b487-46b4907f78b5 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:54.426689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a548b05-24e0-4096-a03e-4c55dcce007f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:54.427224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a548b05-24e0-4096-a03e-4c55dcce007f service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:54.427763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a548b05-24e0-4096-a03e-4c55dcce007f service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:54.428039 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a548b05-24e0-4096-a03e-4c55dcce007f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:54.429666 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5a548b05-24e0-4096-a03e-4c55dcce007f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:54.511265 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:54.541941 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a548b05-24e0-4096-a03e-4c55dcce007f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:54.543419 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a548b05-24e0-4096-a03e-4c55dcce007f service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:54.563368 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 747/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:43:56.831434 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f2995-376f-4e99-a377-2c2d868eb13b None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:56.832014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f2995-376f-4e99-a377-2c2d868eb13b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:56.832014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f2995-376f-4e99-a377-2c2d868eb13b None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:56.833356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 744/1491] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jul 27 10:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:43:56.838635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc905610-c415-4776-b238-d6220217b79f None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:56.839056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc905610-c415-4776-b238-d6220217b79f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:56.839189 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc905610-c415-4776-b238-d6220217b79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:56.907959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-cc905610-c415-4776-b238-d6220217b79f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:43:56.909169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-cc905610-c415-4776-b238-d6220217b79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:57.013543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 748/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jul 27 10:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:43:57.053579 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f2995-376f-4e99-a377-2c2d868eb13b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:43:57.055167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-413f2995-376f-4e99-a377-2c2d868eb13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:57.164469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f2995-376f-4e99-a377-2c2d868eb13b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:43:57.240583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33992f24-72ba-4bd3-814a-f114b21e3b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:43:57.241211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33992f24-72ba-4bd3-814a-f114b21e3b67 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:43:57.241495 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33992f24-72ba-4bd3-814a-f114b21e3b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:43:57.241773 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33992f24-72ba-4bd3-814a-f114b21e3b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:43:57.243469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-33992f24-72ba-4bd3-814a-f114b21e3b67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:43:57.253498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:43:57.356537 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33992f24-72ba-4bd3-814a-f114b21e3b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:43:57.357971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33992f24-72ba-4bd3-814a-f114b21e3b67 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:43:57.377032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 745/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:44:07.011684 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=82 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:44:07.374127 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=50 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:45:26.079853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fa83e-ac32-414f-a9f8-52abc35c6ea5 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:26.080461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fa83e-ac32-414f-a9f8-52abc35c6ea5 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:26.080461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0fa83e-ac32-414f-a9f8-52abc35c6ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:26.157371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6b0fa83e-ac32-414f-a9f8-52abc35c6ea5 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:45:26.158533 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6b0fa83e-ac32-414f-a9f8-52abc35c6ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:26.255067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 749/1494] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:45:26.263433 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0e55b-84da-4948-a8b4-b597097f7398 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:26.264576 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0e55b-84da-4948-a8b4-b597097f7398 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:26.264576 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0e55b-84da-4948-a8b4-b597097f7398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:26.340239 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-2fb0e55b-84da-4948-a8b4-b597097f7398 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:45:26.341501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-2fb0e55b-84da-4948-a8b4-b597097f7398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:26.440681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 746/1495] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:45:26.445439 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fa83e-ac32-414f-a9f8-52abc35c6ea5 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:45:26.446701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6b0fa83e-ac32-414f-a9f8-52abc35c6ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:26.459015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0fa83e-ac32-414f-a9f8-52abc35c6ea5 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:45:26.520812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:45:26.554573 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb13c04-f109-49cd-84df-bd763140fece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:45:26.555450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb13c04-f109-49cd-84df-bd763140fece admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:26.555729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb13c04-f109-49cd-84df-bd763140fece admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:26.556000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb13c04-f109-49cd-84df-bd763140fece admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:26.556683 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb13c04-f109-49cd-84df-bd763140fece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:45:26.556982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb13c04-f109-49cd-84df-bd763140fece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:45:26.557982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: WARNING py.warnings [None req-2eb13c04-f109-49cd-84df-bd763140fece admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:45:26.557982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: warnings.warn(msg) Jul 27 10:45:26.557982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: Jul 27 10:45:26.558989 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb13c04-f109-49cd-84df-bd763140fece admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:45:26.570705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 750/1496] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:45:26.580242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0e55b-84da-4948-a8b4-b597097f7398 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:45:26.589486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0e55b-84da-4948-a8b4-b597097f7398 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:45:26.651253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:45:26.687582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8f495-ff42-4ae5-b266-57da92c0e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:45:26.688212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8f495-ff42-4ae5-b266-57da92c0e907 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:26.688491 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8f495-ff42-4ae5-b266-57da92c0e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:26.688766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8f495-ff42-4ae5-b266-57da92c0e907 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:26.689609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8f495-ff42-4ae5-b266-57da92c0e907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:45:26.691435 dv-cinder-850840-3-smb devstack@keystone.service[86616]: WARNING py.warnings [None req-b9a8f495-ff42-4ae5-b266-57da92c0e907 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:45:26.691435 dv-cinder-850840-3-smb devstack@keystone.service[86616]: warnings.warn(msg) Jul 27 10:45:26.691435 dv-cinder-850840-3-smb devstack@keystone.service[86616]: Jul 27 10:45:26.692586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8f495-ff42-4ae5-b266-57da92c0e907 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:45:26.750853 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 747/1497] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:45:26 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:45:26.755099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb13c04-f109-49cd-84df-bd763140fece admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:45:26.756723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2eb13c04-f109-49cd-84df-bd763140fece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:26.791986 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb13c04-f109-49cd-84df-bd763140fece admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:45:26.887447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd9f4d-8b96-4b57-bbd6-61a35f723022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:45:26.888072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd9f4d-8b96-4b57-bbd6-61a35f723022 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:26.888354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd9f4d-8b96-4b57-bbd6-61a35f723022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:26.888632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd9f4d-8b96-4b57-bbd6-61a35f723022 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:26.889844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd9f4d-8b96-4b57-bbd6-61a35f723022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:45:26.890893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: WARNING py.warnings [None req-6cfd9f4d-8b96-4b57-bbd6-61a35f723022 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:45:26.890893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: warnings.warn(msg) Jul 27 10:45:26.890893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: Jul 27 10:45:26.892108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd9f4d-8b96-4b57-bbd6-61a35f723022 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:45:26.936111 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 751/1498] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:45:26 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:45:26.940236 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8f495-ff42-4ae5-b266-57da92c0e907 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:45:26.942001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b9a8f495-ff42-4ae5-b266-57da92c0e907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:27.012245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8f495-ff42-4ae5-b266-57da92c0e907 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:45:27.097284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:45:27.109063 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084a682-6965-41ff-8dc2-1faf5cbe3080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:45:27.109719 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a682-6965-41ff-8dc2-1faf5cbe3080 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:27.110001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a682-6965-41ff-8dc2-1faf5cbe3080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:27.110324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084a682-6965-41ff-8dc2-1faf5cbe3080 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:27.111122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084a682-6965-41ff-8dc2-1faf5cbe3080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:45:27.112150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: WARNING py.warnings [None req-5084a682-6965-41ff-8dc2-1faf5cbe3080 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:45:27.112150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: warnings.warn(msg) Jul 27 10:45:27.112150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: Jul 27 10:45:27.113033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084a682-6965-41ff-8dc2-1faf5cbe3080 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:45:27.126037 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 748/1499] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:45:27.130291 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd9f4d-8b96-4b57-bbd6-61a35f723022 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:45:27.131863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6cfd9f4d-8b96-4b57-bbd6-61a35f723022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:27.144099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd9f4d-8b96-4b57-bbd6-61a35f723022 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:45:27.170126 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:45:27.240561 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb82e2-a92b-4c12-ab28-e91e98c5840f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:45:27.241089 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb82e2-a92b-4c12-ab28-e91e98c5840f admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:27.241365 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb82e2-a92b-4c12-ab28-e91e98c5840f admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:27.241634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb82e2-a92b-4c12-ab28-e91e98c5840f admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:27.242350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb82e2-a92b-4c12-ab28-e91e98c5840f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:45:27.243349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: WARNING py.warnings [None req-aabb82e2-a92b-4c12-ab28-e91e98c5840f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:45:27.243349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: warnings.warn(msg) Jul 27 10:45:27.243349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: Jul 27 10:45:27.244226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb82e2-a92b-4c12-ab28-e91e98c5840f admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:45:27.257615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 752/1500] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:45:27.261916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084a682-6965-41ff-8dc2-1faf5cbe3080 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:45:27.263506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5084a682-6965-41ff-8dc2-1faf5cbe3080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:27.297580 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084a682-6965-41ff-8dc2-1faf5cbe3080 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:45:27.394832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f09adb-3414-4478-a490-0b929eaedec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:45:27.395507 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f09adb-3414-4478-a490-0b929eaedec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:27.395788 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f09adb-3414-4478-a490-0b929eaedec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:27.396062 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f09adb-3414-4478-a490-0b929eaedec7 admin admin] PATH_INFO: `/v3/projects/0e7d163325cb4c3cb0802b91730f1b2d/users/ca9fedec25da4b2696b554d7f1e9f277/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:27.418255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f09adb-3414-4478-a490-0b929eaedec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7d163325cb4c3cb0802b91730f1b2d, user_id=ca9fedec25da4b2696b554d7f1e9f277, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:45:27.419311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: WARNING py.warnings [None req-93f09adb-3414-4478-a490-0b929eaedec7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:45:27.419311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: warnings.warn(msg) Jul 27 10:45:27.419311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: Jul 27 10:45:27.421948 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f09adb-3414-4478-a490-0b929eaedec7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:45:27.447572 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 749/1501] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:45:27 2022] PUT /identity/v3/projects/0e7d163325cb4c3cb0802b91730f1b2d/users/ca9fedec25da4b2696b554d7f1e9f277/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:45:27.460439 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e633073-e6de-4585-b221-ac0d29d2f709 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:27.460751 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e633073-e6de-4585-b221-ac0d29d2f709 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:27.461018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e633073-e6de-4585-b221-ac0d29d2f709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:27.520666 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-9e633073-e6de-4585-b221-ac0d29d2f709 None None] MFA Rules not processed for user `ca9fedec25da4b2696b554d7f1e9f277`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:45:27.521786 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9e633073-e6de-4585-b221-ac0d29d2f709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:27.600212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 753/1502] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:45:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:45:27.614175 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e67097-bbf0-4d2a-bae7-87bc2f80d6bc None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:27.614488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e67097-bbf0-4d2a-bae7-87bc2f80d6bc None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:27.614765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e67097-bbf0-4d2a-bae7-87bc2f80d6bc None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:27.616132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 750/1503] 10.222.0.43 () {54 vars in 964 bytes} [Wed Jul 27 10:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:45:27.621084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac522a-16cf-4cea-9e09-24f9d7d09d47 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:27.621377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac522a-16cf-4cea-9e09-24f9d7d09d47 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:27.621659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac522a-16cf-4cea-9e09-24f9d7d09d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:27.653392 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:45:27.701853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-11ac522a-16cf-4cea-9e09-24f9d7d09d47 None None] MFA Rules not processed for user `65bd5264306d4d33a2e14b01abb4364a`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:45:27.703238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-11ac522a-16cf-4cea-9e09-24f9d7d09d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:27.779531 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 754/1504] 10.222.0.43 () {58 vars in 1061 bytes} [Wed Jul 27 10:45:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:45:27.787242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e67097-bbf0-4d2a-bae7-87bc2f80d6bc None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:45:27.788771 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a8e67097-bbf0-4d2a-bae7-87bc2f80d6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:27.842641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:45:27.898660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e67097-bbf0-4d2a-bae7-87bc2f80d6bc None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:45:27.972691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300c4f7-a50a-4907-a611-9ad8acae7e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:45:27.973307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300c4f7-a50a-4907-a611-9ad8acae7e7e service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:27.973584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300c4f7-a50a-4907-a611-9ad8acae7e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:27.973849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300c4f7-a50a-4907-a611-9ad8acae7e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:27.975519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-9300c4f7-a50a-4907-a611-9ad8acae7e7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:28.075146 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300c4f7-a50a-4907-a611-9ad8acae7e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:45:28.077182 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300c4f7-a50a-4907-a611-9ad8acae7e7e service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:45:28.080726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:45:28.096618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 751/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:45:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:45:28.142672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb612-1ba6-42f5-acdc-c53635c1d138 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:28.143102 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb612-1ba6-42f5-acdc-c53635c1d138 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:28.143227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb612-1ba6-42f5-acdc-c53635c1d138 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:28.144486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 755/1506] 10.222.0.43 () {52 vars in 830 bytes} [Wed Jul 27 10:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:45:28.148154 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300c4f7-a50a-4907-a611-9ad8acae7e7e service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:45:28.149384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-9300c4f7-a50a-4907-a611-9ad8acae7e7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:28.250324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300c4f7-a50a-4907-a611-9ad8acae7e7e service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:45:28.344925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:45:28.345712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:28.345820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:28.346006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] PATH_INFO: `/v3/users/ca9fedec25da4b2696b554d7f1e9f277` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:28.358982 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9fedec25da4b2696b554d7f1e9f277)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:45:28.360014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: WARNING py.warnings [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:45:28.360014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: warnings.warn(msg) Jul 27 10:45:28.360014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: Jul 27 10:45:28.361596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:45:28.370930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:45:28.427014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9fedec25da4b2696b554d7f1e9f277'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:45:28.427562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9fedec25da4b2696b554d7f1e9f277'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:45:28.440858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9fedec25da4b2696b554d7f1e9f277'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:45:28.441313 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9fedec25da4b2696b554d7f1e9f277'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:45:28.450756 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9fedec25da4b2696b554d7f1e9f277'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:45:28.476222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 752/1507] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:45:28 2022] DELETE /identity/v3/users/ca9fedec25da4b2696b554d7f1e9f277 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:45:28.480660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80d51-b8af-4641-b9be-9c437c0c8daa None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:28.480962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80d51-b8af-4641-b9be-9c437c0c8daa None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:28.481245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80d51-b8af-4641-b9be-9c437c0c8daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:28.539041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-30a80d51-b8af-4641-b9be-9c437c0c8daa None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:45:28.540259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-30a80d51-b8af-4641-b9be-9c437c0c8daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:28.616301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:45:28.629137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 756/1508] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:45:28.639137 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:45:28.640378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:28.743252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9194d-1e51-4259-ad42-e72e86bd1e4e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:45:28.798343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:45:28.818673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae788efb-5522-43b1-8d80-75ce6039c03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:45:28.819303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae788efb-5522-43b1-8d80-75ce6039c03f service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:28.819585 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae788efb-5522-43b1-8d80-75ce6039c03f service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:28.819860 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae788efb-5522-43b1-8d80-75ce6039c03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:28.821529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ae788efb-5522-43b1-8d80-75ce6039c03f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:28.936368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae788efb-5522-43b1-8d80-75ce6039c03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:45:28.937808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae788efb-5522-43b1-8d80-75ce6039c03f service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:45:28.958002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 753/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:45:29.306834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a80d51-b8af-4641-b9be-9c437c0c8daa None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:45:29.308213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-30a80d51-b8af-4641-b9be-9c437c0c8daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:45:29.320795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a80d51-b8af-4641-b9be-9c437c0c8daa None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:45:29.422002 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c58db-a678-4dae-b284-701b62503fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:45:29.422594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c58db-a678-4dae-b284-701b62503fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:45:29.422885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c58db-a678-4dae-b284-701b62503fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:45:29.423164 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c58db-a678-4dae-b284-701b62503fc3 admin admin] PATH_INFO: `/v3/projects/0e7d163325cb4c3cb0802b91730f1b2d` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:45:29.434178 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c58db-a678-4dae-b284-701b62503fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e7d163325cb4c3cb0802b91730f1b2d)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:45:29.435232 dv-cinder-850840-3-smb devstack@keystone.service[86617]: WARNING py.warnings [None req-1d8c58db-a678-4dae-b284-701b62503fc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:45:29.435232 dv-cinder-850840-3-smb devstack@keystone.service[86617]: warnings.warn(msg) Jul 27 10:45:29.435232 dv-cinder-850840-3-smb devstack@keystone.service[86617]: Jul 27 10:45:29.436543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c58db-a678-4dae-b284-701b62503fc3 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:45:29.496991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1d8c58db-a678-4dae-b284-701b62503fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7d163325cb4c3cb0802b91730f1b2d', 'request_id': 'req-1d8c58db-a678-4dae-b284-701b62503fc3'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:45:29.510421 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1d8c58db-a678-4dae-b284-701b62503fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7d163325cb4c3cb0802b91730f1b2d', 'request_id': 'req-1d8c58db-a678-4dae-b284-701b62503fc3'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:45:29.516829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1d8c58db-a678-4dae-b284-701b62503fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7d163325cb4c3cb0802b91730f1b2d', 'request_id': 'req-1d8c58db-a678-4dae-b284-701b62503fc3'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:45:29.542988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1d8c58db-a678-4dae-b284-701b62503fc3 admin admin] The token cache is being invalidate because project 0e7d163325cb4c3cb0802b91730f1b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:45:29.543277 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1d8c58db-a678-4dae-b284-701b62503fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:45:29.543797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1d8c58db-a678-4dae-b284-701b62503fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:45:29.545811 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 757/1510] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:45:29 2022] DELETE /identity/v3/projects/0e7d163325cb4c3cb0802b91730f1b2d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:45:38.955605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=62 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:45:39.540968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:47:22.611412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c09238-11e5-4b5a-87ae-ef80ebbeb1e0 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:22.612025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c09238-11e5-4b5a-87ae-ef80ebbeb1e0 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:22.612025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c09238-11e5-4b5a-87ae-ef80ebbeb1e0 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:22.613386 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 10:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:47:22.618582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300fe5f-b7b5-4ac1-b462-abb626eb76f0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:22.619187 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300fe5f-b7b5-4ac1-b462-abb626eb76f0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:22.619187 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300fe5f-b7b5-4ac1-b462-abb626eb76f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:22.704694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-7300fe5f-b7b5-4ac1-b462-abb626eb76f0 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:47:22.705915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7300fe5f-b7b5-4ac1-b462-abb626eb76f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:47:22.809765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 10:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:47:22.964123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c09238-11e5-4b5a-87ae-ef80ebbeb1e0 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:47:22.966331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-00c09238-11e5-4b5a-87ae-ef80ebbeb1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:47:23.089466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c09238-11e5-4b5a-87ae-ef80ebbeb1e0 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:47:23.095877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310ca5f-a7de-4a52-91f4-bc4bd054a37d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:47:23.096509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310ca5f-a7de-4a52-91f4-bc4bd054a37d service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:23.096790 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310ca5f-a7de-4a52-91f4-bc4bd054a37d service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:23.097060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310ca5f-a7de-4a52-91f4-bc4bd054a37d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:23.106812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310ca5f-a7de-4a52-91f4-bc4bd054a37d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:47:23.108452 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310ca5f-a7de-4a52-91f4-bc4bd054a37d service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:47:23.118359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 755/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:47:23.946959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be5aad-a1f9-4041-9698-c3d25b0f2a3e None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:23.947544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be5aad-a1f9-4041-9698-c3d25b0f2a3e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:23.947544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be5aad-a1f9-4041-9698-c3d25b0f2a3e None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:23.948884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 10:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:47:23.954289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929bddb-f8bb-4592-a3f4-4e0dc4bb7e20 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:23.954875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929bddb-f8bb-4592-a3f4-4e0dc4bb7e20 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:23.954968 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929bddb-f8bb-4592-a3f4-4e0dc4bb7e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:23.980875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-8929bddb-f8bb-4592-a3f4-4e0dc4bb7e20 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:47:23.982071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-8929bddb-f8bb-4592-a3f4-4e0dc4bb7e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:47:23.987306 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec075eca-2237-42c1-9f46-47b3add05cb6 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:23.987588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec075eca-2237-42c1-9f46-47b3add05cb6 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:23.987864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec075eca-2237-42c1-9f46-47b3add05cb6 None None] PATH_INFO: `/v3` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:23.989131 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 760/1515] 10.222.0.82 () {54 vars in 925 bytes} [Wed Jul 27 10:47:23 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:47:23.991543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 756/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 10:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:47:23.995625 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e96e9d-5d5f-4250-9bb4-559fe7b096f0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:23.995844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e96e9d-5d5f-4250-9bb4-559fe7b096f0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:23.996115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e96e9d-5d5f-4250-9bb4-559fe7b096f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:24.059828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-a3e96e9d-5d5f-4250-9bb4-559fe7b096f0 None None] MFA Rules not processed for user `39830a354dee41b5b210d80807886299`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:47:24.061047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a3e96e9d-5d5f-4250-9bb4-559fe7b096f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:47:24.093660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:47:24.136380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 761/1517] 10.222.0.82 () {58 vars in 1015 bytes} [Wed Jul 27 10:47:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:47:24.148811 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929bddb-f8bb-4592-a3f4-4e0dc4bb7e20 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:47:24.161367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929bddb-f8bb-4592-a3f4-4e0dc4bb7e20 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:47:24.167221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e57d0f-5783-403e-a5cc-29f1f888ce1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:47:24.167839 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e57d0f-5783-403e-a5cc-29f1f888ce1d service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:24.168122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e57d0f-5783-403e-a5cc-29f1f888ce1d service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:24.168398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e57d0f-5783-403e-a5cc-29f1f888ce1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:24.176783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e57d0f-5783-403e-a5cc-29f1f888ce1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:47:24.178394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e57d0f-5783-403e-a5cc-29f1f888ce1d service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:47:24.188620 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 757/1518] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:47:33.125634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7fdfd-81c7-4cbe-beba-378e3947d0e7 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:33.126288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7fdfd-81c7-4cbe-beba-378e3947d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:33.126288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7fdfd-81c7-4cbe-beba-378e3947d0e7 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:33.127546 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 762/1519] 10.222.0.43 () {54 vars in 961 bytes} [Wed Jul 27 10:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:47:33.132659 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512f0d7-b018-4d13-b4ea-ca5be7e21187 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:33.133271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512f0d7-b018-4d13-b4ea-ca5be7e21187 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:33.133271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512f0d7-b018-4d13-b4ea-ca5be7e21187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:33.153407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-6512f0d7-b018-4d13-b4ea-ca5be7e21187 None None] MFA Rules not processed for user `39830a354dee41b5b210d80807886299`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:47:33.154659 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6512f0d7-b018-4d13-b4ea-ca5be7e21187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:47:33.163797 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 758/1520] 10.222.0.43 () {58 vars in 1058 bytes} [Wed Jul 27 10:47:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:47:33.171503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7fdfd-81c7-4cbe-beba-378e3947d0e7 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:47:33.185109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7fdfd-81c7-4cbe-beba-378e3947d0e7 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:47:33.190841 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dfe6e-0a7d-4f15-aa11-ec886deb4cd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:47:33.191446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dfe6e-0a7d-4f15-aa11-ec886deb4cd0 service placement] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:33.191726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dfe6e-0a7d-4f15-aa11-ec886deb4cd0 service placement] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:33.191997 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dfe6e-0a7d-4f15-aa11-ec886deb4cd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:33.200195 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dfe6e-0a7d-4f15-aa11-ec886deb4cd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:47:33.201757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383dfe6e-0a7d-4f15-aa11-ec886deb4cd0 service placement] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:47:33.211868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 763/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:47:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:47:35.425636 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6924f-a374-4f72-aa4d-83147f07a42e None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:35.426230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6924f-a374-4f72-aa4d-83147f07a42e None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:35.426230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6924f-a374-4f72-aa4d-83147f07a42e None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:35.427595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 10:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:47:35.432831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ea67-433f-4166-92a8-1633a61410a0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:35.433256 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ea67-433f-4166-92a8-1633a61410a0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:35.433372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ea67-433f-4166-92a8-1633a61410a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:35.453822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-14d4ea67-433f-4166-92a8-1633a61410a0 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:47:35.455055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-14d4ea67-433f-4166-92a8-1633a61410a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:47:35.462937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 10:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:47:35.618554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6924f-a374-4f72-aa4d-83147f07a42e None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:47:35.633937 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6924f-a374-4f72-aa4d-83147f07a42e None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:47:35.639530 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8ba67-0055-4080-a015-ad3c44e4caab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:47:35.640177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ba67-0055-4080-a015-ad3c44e4caab service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:35.640459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ba67-0055-4080-a015-ad3c44e4caab service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:35.640736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ba67-0055-4080-a015-ad3c44e4caab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:35.649358 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8ba67-0055-4080-a015-ad3c44e4caab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:47:35.650981 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8ba67-0055-4080-a015-ad3c44e4caab service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:47:35.660689 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 760/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:47:36.512295 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01830366-fb01-40ed-984f-73902fdd1c06 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:36.512896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01830366-fb01-40ed-984f-73902fdd1c06 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:36.512896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01830366-fb01-40ed-984f-73902fdd1c06 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:36.514608 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 10:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:47:36.520272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bfa7f-02c8-4210-be75-ab8cadf58b52 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:36.520759 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bfa7f-02c8-4210-be75-ab8cadf58b52 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:36.520877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bfa7f-02c8-4210-be75-ab8cadf58b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:36.541418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-046bfa7f-02c8-4210-be75-ab8cadf58b52 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:47:36.542660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-046bfa7f-02c8-4210-be75-ab8cadf58b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:47:36.551060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:47:36.704437 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01830366-fb01-40ed-984f-73902fdd1c06 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:47:36.718938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01830366-fb01-40ed-984f-73902fdd1c06 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:47:36.724476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3e694-3012-4ac4-8782-b8d3b7c8b2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:47:36.725097 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3e694-3012-4ac4-8782-b8d3b7c8b2bb service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:36.725373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3e694-3012-4ac4-8782-b8d3b7c8b2bb service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:36.725650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3e694-3012-4ac4-8782-b8d3b7c8b2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:36.735415 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3e694-3012-4ac4-8782-b8d3b7c8b2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:47:36.737043 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3e694-3012-4ac4-8782-b8d3b7c8b2bb service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:47:36.746818 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 766/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:47:40.745589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ec4f9-ac56-48a3-8145-8535ef8372da None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:40.746300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ec4f9-ac56-48a3-8145-8535ef8372da None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:40.746300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ec4f9-ac56-48a3-8145-8535ef8372da None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:40.747557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:47:40.753494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec12b57-b7a4-40b6-87b6-a24f1334934c None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:40.753953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec12b57-b7a4-40b6-87b6-a24f1334934c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:40.754066 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec12b57-b7a4-40b6-87b6-a24f1334934c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:40.774559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-8ec12b57-b7a4-40b6-87b6-a24f1334934c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:47:40.775764 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8ec12b57-b7a4-40b6-87b6-a24f1334934c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:47:40.784585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:47:40.859153 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ec4f9-ac56-48a3-8145-8535ef8372da None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:47:40.860852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4f6ec4f9-ac56-48a3-8145-8535ef8372da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:47:40.928252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:47:40.943851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ec4f9-ac56-48a3-8145-8535ef8372da None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:47:40.947821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38582c-2cbd-4113-96a2-7623052cea09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:47:40.948448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38582c-2cbd-4113-96a2-7623052cea09 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:40.948761 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38582c-2cbd-4113-96a2-7623052cea09 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:40.949038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38582c-2cbd-4113-96a2-7623052cea09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:40.958872 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38582c-2cbd-4113-96a2-7623052cea09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:47:40.960368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38582c-2cbd-4113-96a2-7623052cea09 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:47:40.970481 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 763/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:47:42.986302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6692b1-d719-4577-a539-e4ff89ff870d None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:42.986844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6692b1-d719-4577-a539-e4ff89ff870d None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:42.986962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6692b1-d719-4577-a539-e4ff89ff870d None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:42.988213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:47:42.993591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f78ad-79af-4fab-afe3-9192e88df48a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:42.994026 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f78ad-79af-4fab-afe3-9192e88df48a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:42.994123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f78ad-79af-4fab-afe3-9192e88df48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:43.013556 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-a68f78ad-79af-4fab-afe3-9192e88df48a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:47:43.015790 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a68f78ad-79af-4fab-afe3-9192e88df48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:47:43.023717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:47:43.060479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6692b1-d719-4577-a539-e4ff89ff870d None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:47:43.072417 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6692b1-d719-4577-a539-e4ff89ff870d None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:47:43.075889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0c931-21bb-4665-abac-311f7da205cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:47:43.076481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0c931-21bb-4665-abac-311f7da205cb service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:43.076760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0c931-21bb-4665-abac-311f7da205cb service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:43.077054 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0c931-21bb-4665-abac-311f7da205cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:43.086424 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0c931-21bb-4665-abac-311f7da205cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:47:43.087873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0c931-21bb-4665-abac-311f7da205cb service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:47:43.097345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 769/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:47:46.613245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa08455-93f6-4e05-bcf3-25692c607510 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:46.613846 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa08455-93f6-4e05-bcf3-25692c607510 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:46.613846 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa08455-93f6-4e05-bcf3-25692c607510 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:46.615216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:47:46.620637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2887-580c-491a-a6fa-f6f4f5abb575 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:46.621097 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2887-580c-491a-a6fa-f6f4f5abb575 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:46.621203 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2887-580c-491a-a6fa-f6f4f5abb575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:46.640758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-0b7d2887-580c-491a-a6fa-f6f4f5abb575 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:47:46.641967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0b7d2887-580c-491a-a6fa-f6f4f5abb575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:47:46.649860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:47:46.958929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa08455-93f6-4e05-bcf3-25692c607510 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:47:46.960690 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4fa08455-93f6-4e05-bcf3-25692c607510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:47:47.046397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa08455-93f6-4e05-bcf3-25692c607510 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:47:47.050212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19591e9a-6d18-4753-98d5-2ae0654ee8f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:47:47.050842 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19591e9a-6d18-4753-98d5-2ae0654ee8f5 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:47.051134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19591e9a-6d18-4753-98d5-2ae0654ee8f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:47.051412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19591e9a-6d18-4753-98d5-2ae0654ee8f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:47.060776 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19591e9a-6d18-4753-98d5-2ae0654ee8f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:47:47.062410 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19591e9a-6d18-4753-98d5-2ae0654ee8f5 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:47:47.071936 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 766/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:47:49.102377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8acf4e-3aa4-411d-a072-e16bed527945 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:49.102377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8acf4e-3aa4-411d-a072-e16bed527945 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:49.102954 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8acf4e-3aa4-411d-a072-e16bed527945 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:49.104354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 10:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:47:49.110536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2daba5-eced-4e92-b47c-f061eb113942 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:49.111035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2daba5-eced-4e92-b47c-f061eb113942 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:49.111141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2daba5-eced-4e92-b47c-f061eb113942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:49.133425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-6d2daba5-eced-4e92-b47c-f061eb113942 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:47:49.134620 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6d2daba5-eced-4e92-b47c-f061eb113942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:47:49.142906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:47:49.448281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8acf4e-3aa4-411d-a072-e16bed527945 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:47:49.450029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6f8acf4e-3aa4-411d-a072-e16bed527945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:47:49.463175 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8acf4e-3aa4-411d-a072-e16bed527945 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:47:49.466664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b3401-137c-4e29-84bd-5591c4312ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:47:49.467274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3401-137c-4e29-84bd-5591c4312ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:47:49.468223 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3401-137c-4e29-84bd-5591c4312ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:47:49.468571 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b3401-137c-4e29-84bd-5591c4312ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:47:49.477438 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b3401-137c-4e29-84bd-5591c4312ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:47:49.478907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b3401-137c-4e29-84bd-5591c4312ed6 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:47:49.488840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 772/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:47:59.128669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=50 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:47:59.484854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=50 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:36.054354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c3f53-d895-43dd-8ea0-e459430d919b None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.056098 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c3f53-d895-43dd-8ea0-e459430d919b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.056706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c3f53-d895-43dd-8ea0-e459430d919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.094229 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-933c3f53-d895-43dd-8ea0-e459430d919b None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:36.096191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-933c3f53-d895-43dd-8ea0-e459430d919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:36.110471 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 768/1540] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:36.120159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e149b87-2c05-4b09-8918-66594024e383 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.120789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e149b87-2c05-4b09-8918-66594024e383 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.120789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e149b87-2c05-4b09-8918-66594024e383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.150751 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-5e149b87-2c05-4b09-8918-66594024e383 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:36.151987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5e149b87-2c05-4b09-8918-66594024e383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:36.171971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 773/1541] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:36.177017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c3f53-d895-43dd-8ea0-e459430d919b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:36.191965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c3f53-d895-43dd-8ea0-e459430d919b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:36.200858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cc027-d091-4ee1-af3b-7bbf7ee6e32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:36.202082 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cc027-d091-4ee1-af3b-7bbf7ee6e32f admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.202688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cc027-d091-4ee1-af3b-7bbf7ee6e32f admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.203199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cc027-d091-4ee1-af3b-7bbf7ee6e32f admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.204226 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cc027-d091-4ee1-af3b-7bbf7ee6e32f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:49:36.204792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cc027-d091-4ee1-af3b-7bbf7ee6e32f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:36.206351 dv-cinder-850840-3-smb devstack@keystone.service[86616]: WARNING py.warnings [None req-442cc027-d091-4ee1-af3b-7bbf7ee6e32f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:49:36.206351 dv-cinder-850840-3-smb devstack@keystone.service[86616]: warnings.warn(msg) Jul 27 10:49:36.206351 dv-cinder-850840-3-smb devstack@keystone.service[86616]: Jul 27 10:49:36.207831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cc027-d091-4ee1-af3b-7bbf7ee6e32f admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:36.234040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 769/1542] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:49:36.242065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e149b87-2c05-4b09-8918-66594024e383 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:36.256803 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e149b87-2c05-4b09-8918-66594024e383 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:36.261949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e179a4-467e-4e80-8a84-ecc03c8bd617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:36.262654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e179a4-467e-4e80-8a84-ecc03c8bd617 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.263640 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e179a4-467e-4e80-8a84-ecc03c8bd617 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.264020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e179a4-467e-4e80-8a84-ecc03c8bd617 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.264736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e179a4-467e-4e80-8a84-ecc03c8bd617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:36.265797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: WARNING py.warnings [None req-48e179a4-467e-4e80-8a84-ecc03c8bd617 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:49:36.265797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: warnings.warn(msg) Jul 27 10:49:36.265797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: Jul 27 10:49:36.267089 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e179a4-467e-4e80-8a84-ecc03c8bd617 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:36.332454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 774/1543] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:49:36.336485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cc027-d091-4ee1-af3b-7bbf7ee6e32f admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:36.352280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cc027-d091-4ee1-af3b-7bbf7ee6e32f admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:36.445415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f069a90-9f50-4a1d-81a6-6ac45715da79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:36.446972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f069a90-9f50-4a1d-81a6-6ac45715da79 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.447603 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f069a90-9f50-4a1d-81a6-6ac45715da79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.448130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f069a90-9f50-4a1d-81a6-6ac45715da79 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.449111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f069a90-9f50-4a1d-81a6-6ac45715da79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:36.451025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: WARNING py.warnings [None req-2f069a90-9f50-4a1d-81a6-6ac45715da79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:49:36.451025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: warnings.warn(msg) Jul 27 10:49:36.451025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: Jul 27 10:49:36.452970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f069a90-9f50-4a1d-81a6-6ac45715da79 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:36.487772 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 770/1544] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:36.495394 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e179a4-467e-4e80-8a84-ecc03c8bd617 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:36.514356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e179a4-467e-4e80-8a84-ecc03c8bd617 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:36.528113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7901c1a-9656-4a2d-8076-337f0d31e0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:36.528839 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7901c1a-9656-4a2d-8076-337f0d31e0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.529127 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7901c1a-9656-4a2d-8076-337f0d31e0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.529935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7901c1a-9656-4a2d-8076-337f0d31e0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.530693 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7901c1a-9656-4a2d-8076-337f0d31e0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:36.532492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7901c1a-9656-4a2d-8076-337f0d31e0a5 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:36.550226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 775/1545] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:36.555072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f069a90-9f50-4a1d-81a6-6ac45715da79 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:36.558524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccba30-af38-442a-8859-302505995aad None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.558821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccba30-af38-442a-8859-302505995aad None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.559197 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccba30-af38-442a-8859-302505995aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.575397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f069a90-9f50-4a1d-81a6-6ac45715da79 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:36.584268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f8e3f-9169-4bcf-b3bc-6929b777e8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:36.585320 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f8e3f-9169-4bcf-b3bc-6929b777e8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.585852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f8e3f-9169-4bcf-b3bc-6929b777e8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.586459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f8e3f-9169-4bcf-b3bc-6929b777e8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.587444 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f8e3f-9169-4bcf-b3bc-6929b777e8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:36.589758 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f8e3f-9169-4bcf-b3bc-6929b777e8b6 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:36.597431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-e1ccba30-af38-442a-8859-302505995aad None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:36.597431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-e1ccba30-af38-442a-8859-302505995aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:36.610284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 771/1546] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:36.614678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 776/1547] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:36.615558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccba30-af38-442a-8859-302505995aad None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:36.617640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0cf7b-ec64-4d15-a0f9-67fe5eeb7b65 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.618610 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0cf7b-ec64-4d15-a0f9-67fe5eeb7b65 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.619752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0cf7b-ec64-4d15-a0f9-67fe5eeb7b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.628515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccba30-af38-442a-8859-302505995aad None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:36.646219 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2260f9-6d68-4c4d-87a8-60f9339af735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:36.646219 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2260f9-6d68-4c4d-87a8-60f9339af735 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.646219 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2260f9-6d68-4c4d-87a8-60f9339af735 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.646219 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2260f9-6d68-4c4d-87a8-60f9339af735 admin admin] PATH_INFO: `/v3/projects/07940c3aa68f4dd3bc96fdb74b8bb2eb/users/9c6c44ca3dc44632b7d064d19a9cf1b1/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.668041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-c0a0cf7b-ec64-4d15-a0f9-67fe5eeb7b65 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:36.671552 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c0a0cf7b-ec64-4d15-a0f9-67fe5eeb7b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:36.671779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2260f9-6d68-4c4d-87a8-60f9339af735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07940c3aa68f4dd3bc96fdb74b8bb2eb, user_id=9c6c44ca3dc44632b7d064d19a9cf1b1, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:36.672840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: WARNING py.warnings [None req-3e2260f9-6d68-4c4d-87a8-60f9339af735 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:49:36.672840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: warnings.warn(msg) Jul 27 10:49:36.672840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: Jul 27 10:49:36.674835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2260f9-6d68-4c4d-87a8-60f9339af735 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:36.693566 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 772/1548] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:49:36.699818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97547bf-52dd-4ed4-8861-bf0bf35ac536 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.700603 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97547bf-52dd-4ed4-8861-bf0bf35ac536 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.701151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97547bf-52dd-4ed4-8861-bf0bf35ac536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.708520 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 777/1549] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:36 2022] PUT /identity/v3/projects/07940c3aa68f4dd3bc96fdb74b8bb2eb/users/9c6c44ca3dc44632b7d064d19a9cf1b1/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:36.709842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bc2a2-2fb1-461b-aa41-e4d59cf4129d None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.710218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bc2a2-2fb1-461b-aa41-e4d59cf4129d None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.710497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bc2a2-2fb1-461b-aa41-e4d59cf4129d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.745850 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6c8bc2a2-2fb1-461b-aa41-e4d59cf4129d None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:36.747364 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6c8bc2a2-2fb1-461b-aa41-e4d59cf4129d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:36.750977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-f97547bf-52dd-4ed4-8861-bf0bf35ac536 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:36.752552 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f97547bf-52dd-4ed4-8861-bf0bf35ac536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:36.862102 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 773/1550] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:36.863913 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecae3dc-ccb0-438e-aa9c-7f3ed6c004ef None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.864229 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecae3dc-ccb0-438e-aa9c-7f3ed6c004ef None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.864593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecae3dc-ccb0-438e-aa9c-7f3ed6c004ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.870275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 778/1551] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:36.870275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226e35d-e008-4da0-bcc5-2c09395bab04 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.870275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226e35d-e008-4da0-bcc5-2c09395bab04 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.870275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226e35d-e008-4da0-bcc5-2c09395bab04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.890807 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-3ecae3dc-ccb0-438e-aa9c-7f3ed6c004ef None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:36.892325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3ecae3dc-ccb0-438e-aa9c-7f3ed6c004ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:36.892888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-8226e35d-e008-4da0-bcc5-2c09395bab04 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:36.894659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8226e35d-e008-4da0-bcc5-2c09395bab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:36.901978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 774/1552] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:36.903921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d22be-b37d-4cf6-b11f-33d761b1ddf7 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.904211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d22be-b37d-4cf6-b11f-33d761b1ddf7 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.904512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d22be-b37d-4cf6-b11f-33d761b1ddf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.905244 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 779/1553] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:36.908939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9163419-ede1-4576-aeb7-2574746c27ce None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.909750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9163419-ede1-4576-aeb7-2574746c27ce None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.910333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9163419-ede1-4576-aeb7-2574746c27ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.926162 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-9a2d22be-b37d-4cf6-b11f-33d761b1ddf7 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:36.927415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-9a2d22be-b37d-4cf6-b11f-33d761b1ddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:36.935487 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-a9163419-ede1-4576-aeb7-2574746c27ce None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:36.935837 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 775/1554] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:36.937079 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e59e71-fcac-4e11-b330-038dffd51c48 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.937366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e59e71-fcac-4e11-b330-038dffd51c48 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.937637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e59e71-fcac-4e11-b330-038dffd51c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.938174 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a9163419-ede1-4576-aeb7-2574746c27ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:36.949229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 780/1555] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:36.955745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe56285-1ca2-4f3f-9d70-8ec9c1643d1f None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.956033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe56285-1ca2-4f3f-9d70-8ec9c1643d1f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.956315 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe56285-1ca2-4f3f-9d70-8ec9c1643d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.959273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-29e59e71-fcac-4e11-b330-038dffd51c48 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:36.960477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-29e59e71-fcac-4e11-b330-038dffd51c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:36.969760 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 776/1556] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:36.970636 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e59e71-fcac-4e11-b330-038dffd51c48 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:36.978293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-dbe56285-1ca2-4f3f-9d70-8ec9c1643d1f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:36.979515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-dbe56285-1ca2-4f3f-9d70-8ec9c1643d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:36.983984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e59e71-fcac-4e11-b330-038dffd51c48 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:36.990257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86903d44-a2bb-42dc-b992-6a5de2692a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:36.991280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 781/1557] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:36.991516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86903d44-a2bb-42dc-b992-6a5de2692a6f admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.991818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86903d44-a2bb-42dc-b992-6a5de2692a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.992527 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86903d44-a2bb-42dc-b992-6a5de2692a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:36.993355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86903d44-a2bb-42dc-b992-6a5de2692a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:49:36.993666 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86903d44-a2bb-42dc-b992-6a5de2692a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:36.995354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86903d44-a2bb-42dc-b992-6a5de2692a6f admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:36.996176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382270-8e05-4c6c-bb37-026549d79841 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:36.997044 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382270-8e05-4c6c-bb37-026549d79841 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:36.998732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83382270-8e05-4c6c-bb37-026549d79841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.011307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 777/1558] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:49:37.013623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86903d44-a2bb-42dc-b992-6a5de2692a6f admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.023440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-83382270-8e05-4c6c-bb37-026549d79841 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:37.024671 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-83382270-8e05-4c6c-bb37-026549d79841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:37.024807 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86903d44-a2bb-42dc-b992-6a5de2692a6f admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.030414 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fba447-0a3f-40c9-b7a3-e065d092725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.031170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fba447-0a3f-40c9-b7a3-e065d092725c admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.031643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fba447-0a3f-40c9-b7a3-e065d092725c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.032061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fba447-0a3f-40c9-b7a3-e065d092725c admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.032731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fba447-0a3f-40c9-b7a3-e065d092725c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:49:37.033064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fba447-0a3f-40c9-b7a3-e065d092725c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.034767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 782/1559] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:37.035090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fba447-0a3f-40c9-b7a3-e065d092725c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.035608 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83382270-8e05-4c6c-bb37-026549d79841 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.050242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 778/1560] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:49:37.050962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7962d9-7687-47ad-9027-38cc9bb6cde0 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.051250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7962d9-7687-47ad-9027-38cc9bb6cde0 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.051523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7962d9-7687-47ad-9027-38cc9bb6cde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.069701 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:37.076584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-ca7962d9-7687-47ad-9027-38cc9bb6cde0 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:37.078901 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ca7962d9-7687-47ad-9027-38cc9bb6cde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:37.086675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 779/1561] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:37.087895 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ce1d6-ed77-4b68-b660-5608e7ce837b None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.088179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ce1d6-ed77-4b68-b660-5608e7ce837b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.088449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ce1d6-ed77-4b68-b660-5608e7ce837b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.096096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83382270-8e05-4c6c-bb37-026549d79841 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.099848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246cfbd-9b85-48fe-984f-73af26edfef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.100464 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246cfbd-9b85-48fe-984f-73af26edfef2 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.100751 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246cfbd-9b85-48fe-984f-73af26edfef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.101033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246cfbd-9b85-48fe-984f-73af26edfef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.110712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-904ce1d6-ed77-4b68-b660-5608e7ce837b None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:37.111988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-904ce1d6-ed77-4b68-b660-5608e7ce837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:37.115934 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246cfbd-9b85-48fe-984f-73af26edfef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.117440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246cfbd-9b85-48fe-984f-73af26edfef2 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.120488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 780/1562] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:37.121975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea90d08-fad6-4ef8-a38a-cb50c6f3f46a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.122781 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea90d08-fad6-4ef8-a38a-cb50c6f3f46a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.123036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea90d08-fad6-4ef8-a38a-cb50c6f3f46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.123749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:37.131750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 783/1563] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:37.133130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a628c-97d6-4c88-b686-3ac380cb65fa None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.133426 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a628c-97d6-4c88-b686-3ac380cb65fa None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.133708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a628c-97d6-4c88-b686-3ac380cb65fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.148972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-cea90d08-fad6-4ef8-a38a-cb50c6f3f46a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:37.150291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-cea90d08-fad6-4ef8-a38a-cb50c6f3f46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:37.159554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 781/1564] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:37.160306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea90d08-fad6-4ef8-a38a-cb50c6f3f46a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.166544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-936a628c-97d6-4c88-b686-3ac380cb65fa None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:37.170283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-936a628c-97d6-4c88-b686-3ac380cb65fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:37.173180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea90d08-fad6-4ef8-a38a-cb50c6f3f46a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.179107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac87c7-c69b-4579-8fe4-e5be80486935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.179871 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac87c7-c69b-4579-8fe4-e5be80486935 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.180004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 784/1565] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:37.180252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac87c7-c69b-4579-8fe4-e5be80486935 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.180533 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac87c7-c69b-4579-8fe4-e5be80486935 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.181743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac87c7-c69b-4579-8fe4-e5be80486935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.183082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a628c-97d6-4c88-b686-3ac380cb65fa None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.184085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac87c7-c69b-4579-8fe4-e5be80486935 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.195433 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a628c-97d6-4c88-b686-3ac380cb65fa None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.202927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d608c4-f974-4280-a7ae-a612a9234d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.203610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d608c4-f974-4280-a7ae-a612a9234d51 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.203892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d608c4-f974-4280-a7ae-a612a9234d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.204196 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d608c4-f974-4280-a7ae-a612a9234d51 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.204900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d608c4-f974-4280-a7ae-a612a9234d51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:49:37.205272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d608c4-f974-4280-a7ae-a612a9234d51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.207356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d608c4-f974-4280-a7ae-a612a9234d51 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.222951 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 782/1566] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:37 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:37.223302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 785/1567] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:49:37.223703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d608c4-f974-4280-a7ae-a612a9234d51 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.223826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac87c7-c69b-4579-8fe4-e5be80486935 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.241326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d608c4-f974-4280-a7ae-a612a9234d51 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.308121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac87c7-c69b-4579-8fe4-e5be80486935 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.316361 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c1129-60ce-4494-9b53-b168da63750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.316606 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4715568-4666-4099-933c-0c07489227d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.317142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4715568-4666-4099-933c-0c07489227d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.317433 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4715568-4666-4099-933c-0c07489227d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.317711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4715568-4666-4099-933c-0c07489227d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.318487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4715568-4666-4099-933c-0c07489227d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.318922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c1129-60ce-4494-9b53-b168da63750b admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.319504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c1129-60ce-4494-9b53-b168da63750b admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.319789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c1129-60ce-4494-9b53-b168da63750b admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.320482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c1129-60ce-4494-9b53-b168da63750b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:49:37.320805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c1129-60ce-4494-9b53-b168da63750b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.320979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4715568-4666-4099-933c-0c07489227d0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.322489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c1129-60ce-4494-9b53-b168da63750b admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.338323 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 786/1568] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:49:37.340511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c1129-60ce-4494-9b53-b168da63750b admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.355679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c1129-60ce-4494-9b53-b168da63750b admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.359268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67782d4f-9499-4ab3-8e79-8a5c44f2bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.360042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67782d4f-9499-4ab3-8e79-8a5c44f2bebb admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.360329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67782d4f-9499-4ab3-8e79-8a5c44f2bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.360603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67782d4f-9499-4ab3-8e79-8a5c44f2bebb admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.361766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67782d4f-9499-4ab3-8e79-8a5c44f2bebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:49:37.362215 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67782d4f-9499-4ab3-8e79-8a5c44f2bebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.364527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67782d4f-9499-4ab3-8e79-8a5c44f2bebb admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.367390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 783/1569] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:37 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:37.369061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4715568-4666-4099-933c-0c07489227d0 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.382120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 787/1570] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:49:37.391048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67782d4f-9499-4ab3-8e79-8a5c44f2bebb admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.403600 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67782d4f-9499-4ab3-8e79-8a5c44f2bebb admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.447162 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4715568-4666-4099-933c-0c07489227d0 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.453781 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de721b-9624-40de-8221-b6e334a0e008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.454919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de721b-9624-40de-8221-b6e334a0e008 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.455342 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de721b-9624-40de-8221-b6e334a0e008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.456108 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de721b-9624-40de-8221-b6e334a0e008 admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.456833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de721b-9624-40de-8221-b6e334a0e008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:49:37.457223 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de721b-9624-40de-8221-b6e334a0e008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.458898 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de721b-9624-40de-8221-b6e334a0e008 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.476830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e993b-615a-4835-8a13-e0478b572ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.477252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 784/1571] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:49:37.478210 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de721b-9624-40de-8221-b6e334a0e008 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.482684 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e993b-615a-4835-8a13-e0478b572ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.483267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e993b-615a-4835-8a13-e0478b572ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.484036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e993b-615a-4835-8a13-e0478b572ea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.486014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e993b-615a-4835-8a13-e0478b572ea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:49:37.486520 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e993b-615a-4835-8a13-e0478b572ea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.488317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e993b-615a-4835-8a13-e0478b572ea9 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.488883 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de721b-9624-40de-8221-b6e334a0e008 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.499819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec2746-4d98-42eb-831b-81501721063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.500656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec2746-4d98-42eb-831b-81501721063f admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.501012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec2746-4d98-42eb-831b-81501721063f admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.501302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec2746-4d98-42eb-831b-81501721063f admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.504872 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec2746-4d98-42eb-831b-81501721063f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.505143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 788/1572] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:49:37.505143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e993b-615a-4835-8a13-e0478b572ea9 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.505376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec2746-4d98-42eb-831b-81501721063f admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.516708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e993b-615a-4835-8a13-e0478b572ea9 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.523655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a0945-913d-47cd-a223-48b69a95ada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.524224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a0945-913d-47cd-a223-48b69a95ada8 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.524510 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a0945-913d-47cd-a223-48b69a95ada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.524844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a0945-913d-47cd-a223-48b69a95ada8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.525876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a0945-913d-47cd-a223-48b69a95ada8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.528780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a0945-913d-47cd-a223-48b69a95ada8 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.537562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 785/1573] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:37 2022] POST /identity/v3/users => generated 286 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:37.538594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec2746-4d98-42eb-831b-81501721063f admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.555139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec2746-4d98-42eb-831b-81501721063f admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.562709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382b682-26f1-40c9-846d-1c7f2de9f20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.563585 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382b682-26f1-40c9-846d-1c7f2de9f20d admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.563881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382b682-26f1-40c9-846d-1c7f2de9f20d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.564157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382b682-26f1-40c9-846d-1c7f2de9f20d admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.564949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382b682-26f1-40c9-846d-1c7f2de9f20d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.565892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 789/1574] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:37 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:37.567355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382b682-26f1-40c9-846d-1c7f2de9f20d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.570569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a0945-913d-47cd-a223-48b69a95ada8 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.605371 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 786/1575] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:37 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:37.605371 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382b682-26f1-40c9-846d-1c7f2de9f20d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.615885 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:37.630078 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:37.666868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a0945-913d-47cd-a223-48b69a95ada8 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.687134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382b682-26f1-40c9-846d-1c7f2de9f20d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.695661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1a5e4-ca8d-425c-909c-91c9f1f0bd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.696712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1a5e4-ca8d-425c-909c-91c9f1f0bd6a admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.697011 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1a5e4-ca8d-425c-909c-91c9f1f0bd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.697299 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1a5e4-ca8d-425c-909c-91c9f1f0bd6a admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.697978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1a5e4-ca8d-425c-909c-91c9f1f0bd6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.701638 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1a5e4-ca8d-425c-909c-91c9f1f0bd6a admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.734986 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 787/1576] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:37 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:37.735828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1a5e4-ca8d-425c-909c-91c9f1f0bd6a admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.739695 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dcb28-363f-4158-aa6d-d36394d4fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.740699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dcb28-363f-4158-aa6d-d36394d4fbcd admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.741208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dcb28-363f-4158-aa6d-d36394d4fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.741750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dcb28-363f-4158-aa6d-d36394d4fbcd admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.742749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dcb28-363f-4158-aa6d-d36394d4fbcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.744958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dcb28-363f-4158-aa6d-d36394d4fbcd admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.772059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 790/1577] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:37 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:37.772970 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dcb28-363f-4158-aa6d-d36394d4fbcd admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.784956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dcb28-363f-4158-aa6d-d36394d4fbcd admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.821663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1a5e4-ca8d-425c-909c-91c9f1f0bd6a admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.829466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363793f-094f-40c4-85dc-1e01ce8de0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.837431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363793f-094f-40c4-85dc-1e01ce8de0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.837431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363793f-094f-40c4-85dc-1e01ce8de0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.837431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363793f-094f-40c4-85dc-1e01ce8de0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.837431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363793f-094f-40c4-85dc-1e01ce8de0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.837431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363793f-094f-40c4-85dc-1e01ce8de0c6 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.872752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deb64d-b4f0-4fc5-a05c-412b2dae769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:37.873519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb64d-b4f0-4fc5-a05c-412b2dae769f admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:37.873804 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb64d-b4f0-4fc5-a05c-412b2dae769f admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:37.874087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb64d-b4f0-4fc5-a05c-412b2dae769f admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:37.874804 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87deb64d-b4f0-4fc5-a05c-412b2dae769f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:37.880591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 788/1578] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:37 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:37.880905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87deb64d-b4f0-4fc5-a05c-412b2dae769f admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:37.881023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363793f-094f-40c4-85dc-1e01ce8de0c6 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.922066 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 791/1579] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:37 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:37.923565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deb64d-b4f0-4fc5-a05c-412b2dae769f admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:37.995393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363793f-094f-40c4-85dc-1e01ce8de0c6 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:37.999007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:38.019109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deb64d-b4f0-4fc5-a05c-412b2dae769f admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.029391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:38.031987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe2558-897e-4093-9d84-d6144b884347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.033340 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe2558-897e-4093-9d84-d6144b884347 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.033340 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe2558-897e-4093-9d84-d6144b884347 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.034045 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe2558-897e-4093-9d84-d6144b884347 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.035009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe2558-897e-4093-9d84-d6144b884347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.037722 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe2558-897e-4093-9d84-d6144b884347 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.070024 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 792/1580] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:37 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:38.071547 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe2558-897e-4093-9d84-d6144b884347 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.086808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe2558-897e-4093-9d84-d6144b884347 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.087609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef6901-312e-4736-9cdd-7655dfaf6f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.088363 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef6901-312e-4736-9cdd-7655dfaf6f57 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.088656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef6901-312e-4736-9cdd-7655dfaf6f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.089092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef6901-312e-4736-9cdd-7655dfaf6f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.089976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef6901-312e-4736-9cdd-7655dfaf6f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.092976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef6901-312e-4736-9cdd-7655dfaf6f57 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.093233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99486861-93d8-4383-ac76-3c111871c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.094137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99486861-93d8-4383-ac76-3c111871c937 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.094742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99486861-93d8-4383-ac76-3c111871c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.095090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99486861-93d8-4383-ac76-3c111871c937 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.096165 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99486861-93d8-4383-ac76-3c111871c937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.098316 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99486861-93d8-4383-ac76-3c111871c937 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.107477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 789/1581] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:38.108430 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef6901-312e-4736-9cdd-7655dfaf6f57 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.121636 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef6901-312e-4736-9cdd-7655dfaf6f57 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.127748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32ea4c-09d9-4452-95de-78f3f2fbd468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.128556 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32ea4c-09d9-4452-95de-78f3f2fbd468 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.128944 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32ea4c-09d9-4452-95de-78f3f2fbd468 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.129298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32ea4c-09d9-4452-95de-78f3f2fbd468 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.130295 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32ea4c-09d9-4452-95de-78f3f2fbd468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.133065 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32ea4c-09d9-4452-95de-78f3f2fbd468 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.133905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 793/1582] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:38 2022] POST /identity/v3/users => generated 285 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:38.135210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99486861-93d8-4383-ac76-3c111871c937 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.157553 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99486861-93d8-4383-ac76-3c111871c937 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.161985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 790/1583] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:38 2022] POST /identity/v3/users => generated 290 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:38.162884 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32ea4c-09d9-4452-95de-78f3f2fbd468 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.166747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2c22d-07aa-4164-be47-f38f5057fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.167482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2c22d-07aa-4164-be47-f38f5057fb1e admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.167791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2c22d-07aa-4164-be47-f38f5057fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.168102 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2c22d-07aa-4164-be47-f38f5057fb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.168970 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2c22d-07aa-4164-be47-f38f5057fb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.170812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2c22d-07aa-4164-be47-f38f5057fb1e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.175310 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32ea4c-09d9-4452-95de-78f3f2fbd468 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.181297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec0a5e-1797-4e8a-acb5-1e08feceda3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.181795 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0a5e-1797-4e8a-acb5-1e08feceda3d admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.183015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0a5e-1797-4e8a-acb5-1e08feceda3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.183308 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0a5e-1797-4e8a-acb5-1e08feceda3d admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.184006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec0a5e-1797-4e8a-acb5-1e08feceda3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.187568 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 794/1584] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:38.188653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2c22d-07aa-4164-be47-f38f5057fb1e admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.190468 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec0a5e-1797-4e8a-acb5-1e08feceda3d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.204530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2c22d-07aa-4164-be47-f38f5057fb1e admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.211157 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10368749-af15-48f1-99e0-055b038bad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.211852 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10368749-af15-48f1-99e0-055b038bad6f admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.212227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10368749-af15-48f1-99e0-055b038bad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.212592 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10368749-af15-48f1-99e0-055b038bad6f admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.213418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10368749-af15-48f1-99e0-055b038bad6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.216096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10368749-af15-48f1-99e0-055b038bad6f admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.216567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 791/1585] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:38 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:38.220557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec0a5e-1797-4e8a-acb5-1e08feceda3d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.232689 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec0a5e-1797-4e8a-acb5-1e08feceda3d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.239617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76ac09-159f-4d70-a859-6992096d020e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.240323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76ac09-159f-4d70-a859-6992096d020e admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.240614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76ac09-159f-4d70-a859-6992096d020e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.241038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76ac09-159f-4d70-a859-6992096d020e admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.241856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76ac09-159f-4d70-a859-6992096d020e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.243532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76ac09-159f-4d70-a859-6992096d020e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.252960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 795/1586] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:38 2022] POST /identity/v3/users => generated 282 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:38.254701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10368749-af15-48f1-99e0-055b038bad6f admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.258308 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 792/1587] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:38.259190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76ac09-159f-4d70-a859-6992096d020e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.271039 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76ac09-159f-4d70-a859-6992096d020e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.271756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10368749-af15-48f1-99e0-055b038bad6f admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.276523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fe2de-15a7-49e9-9285-dc397d2a349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.277436 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d27aa-27c5-47cf-9100-e44a84334cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.277570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fe2de-15a7-49e9-9285-dc397d2a349b admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.277870 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fe2de-15a7-49e9-9285-dc397d2a349b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.278069 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d27aa-27c5-47cf-9100-e44a84334cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.278830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fe2de-15a7-49e9-9285-dc397d2a349b admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.279113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d27aa-27c5-47cf-9100-e44a84334cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.279765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fe2de-15a7-49e9-9285-dc397d2a349b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.279920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d27aa-27c5-47cf-9100-e44a84334cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.280636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d27aa-27c5-47cf-9100-e44a84334cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.282636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d27aa-27c5-47cf-9100-e44a84334cd8 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.282958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fe2de-15a7-49e9-9285-dc397d2a349b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.295991 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 793/1588] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:38.297287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fe2de-15a7-49e9-9285-dc397d2a349b admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.300191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 796/1589] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:38.301043 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d27aa-27c5-47cf-9100-e44a84334cd8 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.318562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fe2de-15a7-49e9-9285-dc397d2a349b admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.319042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d27aa-27c5-47cf-9100-e44a84334cd8 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.325629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a65f5-efa4-4c85-8461-90083c9b0359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.326384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a65f5-efa4-4c85-8461-90083c9b0359 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.326580 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295fdc1-741e-48bd-a696-76285673a84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.326723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a65f5-efa4-4c85-8461-90083c9b0359 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.327187 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a65f5-efa4-4c85-8461-90083c9b0359 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.327543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fdc1-741e-48bd-a696-76285673a84d admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.328171 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fdc1-741e-48bd-a696-76285673a84d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.328492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a65f5-efa4-4c85-8461-90083c9b0359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.328628 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295fdc1-741e-48bd-a696-76285673a84d admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.329518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295fdc1-741e-48bd-a696-76285673a84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.330762 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a65f5-efa4-4c85-8461-90083c9b0359 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.331358 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295fdc1-741e-48bd-a696-76285673a84d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.349224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 797/1590] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:38.349622 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 794/1591] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:38.350951 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295fdc1-741e-48bd-a696-76285673a84d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.354006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a65f5-efa4-4c85-8461-90083c9b0359 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.368466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a65f5-efa4-4c85-8461-90083c9b0359 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.369544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295fdc1-741e-48bd-a696-76285673a84d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.376327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d27129-c88a-4f3a-8c11-bc3f2a13ab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.376565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51f5a5-beee-435f-bbc3-9cf874088b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.377314 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51f5a5-beee-435f-bbc3-9cf874088b1a admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.377828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d27129-c88a-4f3a-8c11-bc3f2a13ab26 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.378275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51f5a5-beee-435f-bbc3-9cf874088b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.378725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d27129-c88a-4f3a-8c11-bc3f2a13ab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.379166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51f5a5-beee-435f-bbc3-9cf874088b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.379519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d27129-c88a-4f3a-8c11-bc3f2a13ab26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.380483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d27129-c88a-4f3a-8c11-bc3f2a13ab26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.380609 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51f5a5-beee-435f-bbc3-9cf874088b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.382579 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d27129-c88a-4f3a-8c11-bc3f2a13ab26 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.382893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51f5a5-beee-435f-bbc3-9cf874088b1a admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.397665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 795/1592] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:38.399108 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d27129-c88a-4f3a-8c11-bc3f2a13ab26 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.401816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 798/1593] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:38.402784 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51f5a5-beee-435f-bbc3-9cf874088b1a admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.412205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d27129-c88a-4f3a-8c11-bc3f2a13ab26 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.415349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51f5a5-beee-435f-bbc3-9cf874088b1a admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.418603 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef8726-6e7f-45d0-ab03-36a0ed0bdafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.420107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef8726-6e7f-45d0-ab03-36a0ed0bdafa admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.420494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef8726-6e7f-45d0-ab03-36a0ed0bdafa admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.420797 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef8726-6e7f-45d0-ab03-36a0ed0bdafa admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.421541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef8726-6e7f-45d0-ab03-36a0ed0bdafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.422216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb432f-fa8a-48a4-b046-85ce5e933c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.422890 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb432f-fa8a-48a4-b046-85ce5e933c14 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.423157 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb432f-fa8a-48a4-b046-85ce5e933c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.423390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef8726-6e7f-45d0-ab03-36a0ed0bdafa admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.423496 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb432f-fa8a-48a4-b046-85ce5e933c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.424152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb432f-fa8a-48a4-b046-85ce5e933c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.425794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb432f-fa8a-48a4-b046-85ce5e933c14 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.437502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 796/1594] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:38.438640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef8726-6e7f-45d0-ab03-36a0ed0bdafa admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.444069 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 799/1595] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:38.445064 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb432f-fa8a-48a4-b046-85ce5e933c14 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.452857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef8726-6e7f-45d0-ab03-36a0ed0bdafa admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.459480 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb432f-fa8a-48a4-b046-85ce5e933c14 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.459631 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2952df-81b9-4812-8f43-550d95b7439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.460286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2952df-81b9-4812-8f43-550d95b7439d admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.460566 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2952df-81b9-4812-8f43-550d95b7439d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.460842 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2952df-81b9-4812-8f43-550d95b7439d admin admin] PATH_INFO: `/v3/projects/864691f7fd3c439985d9ba504482e8f6/users/e5928a48b85242bab39d847e239be14f/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.465584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fe901-1cbd-4c73-beb7-7cf35c5459a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.466954 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fe901-1cbd-4c73-beb7-7cf35c5459a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.467262 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fe901-1cbd-4c73-beb7-7cf35c5459a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.467512 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fe901-1cbd-4c73-beb7-7cf35c5459a5 admin admin] PATH_INFO: `/v3/projects/27cca23fea974855a8867ab5fbae1606/users/71fcdfd05fb146e88f43fb29c4b0232c/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.481926 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2952df-81b9-4812-8f43-550d95b7439d admin admin] RBAC: Authorizing `identity:create_grant(project_id=864691f7fd3c439985d9ba504482e8f6, user_id=e5928a48b85242bab39d847e239be14f, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.485718 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2952df-81b9-4812-8f43-550d95b7439d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.493751 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fe901-1cbd-4c73-beb7-7cf35c5459a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cca23fea974855a8867ab5fbae1606, user_id=71fcdfd05fb146e88f43fb29c4b0232c, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.497408 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fe901-1cbd-4c73-beb7-7cf35c5459a5 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.506968 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 797/1596] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:38 2022] PUT /identity/v3/projects/864691f7fd3c439985d9ba504482e8f6/users/e5928a48b85242bab39d847e239be14f/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:38.507942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2952df-81b9-4812-8f43-550d95b7439d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.520808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 800/1597] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:38 2022] PUT /identity/v3/projects/27cca23fea974855a8867ab5fbae1606/users/71fcdfd05fb146e88f43fb29c4b0232c/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:38.524968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fe901-1cbd-4c73-beb7-7cf35c5459a5 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.621733 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2952df-81b9-4812-8f43-550d95b7439d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.642757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:38.648310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fe901-1cbd-4c73-beb7-7cf35c5459a5 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.657017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347ada1-ac7f-4552-9785-b13d88965f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.658350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347ada1-ac7f-4552-9785-b13d88965f05 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.658743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347ada1-ac7f-4552-9785-b13d88965f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.659284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347ada1-ac7f-4552-9785-b13d88965f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.660412 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347ada1-ac7f-4552-9785-b13d88965f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.662063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347ada1-ac7f-4552-9785-b13d88965f05 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.678366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 801/1598] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:38.681143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347ada1-ac7f-4552-9785-b13d88965f05 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.693035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347ada1-ac7f-4552-9785-b13d88965f05 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.698309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acc91d-a75b-40ca-bcaa-f3cdfdf3de6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.699206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acc91d-a75b-40ca-bcaa-f3cdfdf3de6d admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.699206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acc91d-a75b-40ca-bcaa-f3cdfdf3de6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.699628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acc91d-a75b-40ca-bcaa-f3cdfdf3de6d admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.701077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acc91d-a75b-40ca-bcaa-f3cdfdf3de6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.702732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acc91d-a75b-40ca-bcaa-f3cdfdf3de6d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.715331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf565e-addf-45d3-b173-d2e449c00b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.716671 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf565e-addf-45d3-b173-d2e449c00b62 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.717017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf565e-addf-45d3-b173-d2e449c00b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.718017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf565e-addf-45d3-b173-d2e449c00b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.718235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf565e-addf-45d3-b173-d2e449c00b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.719931 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf565e-addf-45d3-b173-d2e449c00b62 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.735431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 798/1599] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:38.736251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 802/1600] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:38.736381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf565e-addf-45d3-b173-d2e449c00b62 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.737651 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acc91d-a75b-40ca-bcaa-f3cdfdf3de6d admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.749999 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf565e-addf-45d3-b173-d2e449c00b62 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.751431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acc91d-a75b-40ca-bcaa-f3cdfdf3de6d admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.756973 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813a4e5-0a6a-4468-9376-50abfc5d99fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.757369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2383a8c-c862-4159-8612-ec196af999bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.757971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813a4e5-0a6a-4468-9376-50abfc5d99fd admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.758300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813a4e5-0a6a-4468-9376-50abfc5d99fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.758412 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2383a8c-c862-4159-8612-ec196af999bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.758660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2383a8c-c862-4159-8612-ec196af999bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.758778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813a4e5-0a6a-4468-9376-50abfc5d99fd admin admin] PATH_INFO: `/v3/projects/7cc98e6ea388454aa3d7f77e91268f2e/users/65d210c95da44ee399c48322d4c919b3/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.758940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2383a8c-c862-4159-8612-ec196af999bb admin admin] PATH_INFO: `/v3/projects/681686cb5c384e7ca9733ca27090d716/users/aa0ae66f776944d580e2331684c72523/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.775626 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:38.779818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813a4e5-0a6a-4468-9376-50abfc5d99fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc98e6ea388454aa3d7f77e91268f2e, user_id=65d210c95da44ee399c48322d4c919b3, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.780908 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2383a8c-c862-4159-8612-ec196af999bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=681686cb5c384e7ca9733ca27090d716, user_id=aa0ae66f776944d580e2331684c72523, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:38.783440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813a4e5-0a6a-4468-9376-50abfc5d99fd admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.784483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2383a8c-c862-4159-8612-ec196af999bb admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:38.818240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 799/1602] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:38 2022] PUT /identity/v3/projects/7cc98e6ea388454aa3d7f77e91268f2e/users/65d210c95da44ee399c48322d4c919b3/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:38.818240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5e849-4783-4b1f-a092-5e579f7457ed None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.818240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5e849-4783-4b1f-a092-5e579f7457ed None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.818240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5e849-4783-4b1f-a092-5e579f7457ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.819168 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 803/1602] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:38 2022] PUT /identity/v3/projects/681686cb5c384e7ca9733ca27090d716/users/aa0ae66f776944d580e2331684c72523/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:38.822225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe686b-ae67-4d81-ab05-31e67456ee1f None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.822834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe686b-ae67-4d81-ab05-31e67456ee1f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.823321 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe686b-ae67-4d81-ab05-31e67456ee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:38.854289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-1abe686b-ae67-4d81-ab05-31e67456ee1f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:38.861360 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1abe686b-ae67-4d81-ab05-31e67456ee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:38.879486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-aff5e849-4783-4b1f-a092-5e579f7457ed None None] MFA Rules not processed for user `e5928a48b85242bab39d847e239be14f`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:38.880778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-aff5e849-4783-4b1f-a092-5e579f7457ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:38.958267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 804/1603] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:38.958267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe686b-ae67-4d81-ab05-31e67456ee1f None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:38.971155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe686b-ae67-4d81-ab05-31e67456ee1f None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:38.976398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e8c90-715d-471a-9273-0ea77dcb5533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:38.977264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e8c90-715d-471a-9273-0ea77dcb5533 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:38.977717 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e8c90-715d-471a-9273-0ea77dcb5533 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:38.978102 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e8c90-715d-471a-9273-0ea77dcb5533 admin admin] PATH_INFO: `/v3/projects/0d68a5cdbdfc4377b8611ac9b4a8713d/users/08fef54ec9364ae7a420dea05613e4b5/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.002405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 800/1604] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:39.002712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e8c90-715d-471a-9273-0ea77dcb5533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d68a5cdbdfc4377b8611ac9b4a8713d, user_id=08fef54ec9364ae7a420dea05613e4b5, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:39.005779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e8c90-715d-471a-9273-0ea77dcb5533 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:39.007613 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5e849-4783-4b1f-a092-5e579f7457ed None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:39.027734 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5e849-4783-4b1f-a092-5e579f7457ed None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:39.029844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 805/1605] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:38 2022] PUT /identity/v3/projects/0d68a5cdbdfc4377b8611ac9b4a8713d/users/08fef54ec9364ae7a420dea05613e4b5/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:39.030814 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e8c90-715d-471a-9273-0ea77dcb5533 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:39.128766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa380692-a92b-4536-8fb8-4e75a49da502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:39.129677 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa380692-a92b-4536-8fb8-4e75a49da502 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:39.130063 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa380692-a92b-4536-8fb8-4e75a49da502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:39.130700 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa380692-a92b-4536-8fb8-4e75a49da502 admin admin] PATH_INFO: `/v3/projects/a69aab1543094ede91409a577afee072/users/5797a18d030644c29a946de8a7602d37/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.135265 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e8c90-715d-471a-9273-0ea77dcb5533 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:39.142912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e02427-cf44-4dfa-8160-31084a4f9d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:39.143912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02427-cf44-4dfa-8160-31084a4f9d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:39.143912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02427-cf44-4dfa-8160-31084a4f9d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:39.144221 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e02427-cf44-4dfa-8160-31084a4f9d32 admin admin] PATH_INFO: `/v3/projects/d27a34fd28584fe9841976117eff7636/users/00e8fb23313f4e168eb2f690039379ae/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.242089 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e02427-cf44-4dfa-8160-31084a4f9d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27a34fd28584fe9841976117eff7636, user_id=00e8fb23313f4e168eb2f690039379ae, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:39.242089 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e02427-cf44-4dfa-8160-31084a4f9d32 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:39.244114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa380692-a92b-4536-8fb8-4e75a49da502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69aab1543094ede91409a577afee072, user_id=5797a18d030644c29a946de8a7602d37, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:39.244114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa380692-a92b-4536-8fb8-4e75a49da502 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:39.244114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:39.244564 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 806/1606] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:39 2022] PUT /identity/v3/projects/d27a34fd28584fe9841976117eff7636/users/00e8fb23313f4e168eb2f690039379ae/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:39.244564 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4a5ce-4967-4f5d-bcb7-4d766b2927a3 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:39.244564 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4a5ce-4967-4f5d-bcb7-4d766b2927a3 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:39.244564 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4a5ce-4967-4f5d-bcb7-4d766b2927a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.245070 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 801/1607] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:39 2022] PUT /identity/v3/projects/a69aab1543094ede91409a577afee072/users/5797a18d030644c29a946de8a7602d37/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:39.245070 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ee3b3-31eb-42c0-a773-0f25bb6a511b None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:39.245070 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ee3b3-31eb-42c0-a773-0f25bb6a511b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:39.245070 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ee3b3-31eb-42c0-a773-0f25bb6a511b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.245431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-abe4a5ce-4967-4f5d-bcb7-4d766b2927a3 None None] MFA Rules not processed for user `aa0ae66f776944d580e2331684c72523`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:39.245431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-abe4a5ce-4967-4f5d-bcb7-4d766b2927a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:39.267737 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-d75ee3b3-31eb-42c0-a773-0f25bb6a511b None None] MFA Rules not processed for user `65d210c95da44ee399c48322d4c919b3`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:39.270644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d75ee3b3-31eb-42c0-a773-0f25bb6a511b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:39.310658 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:39.364633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 807/1608] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:39.370258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 802/1609] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:39.370481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4a5ce-4967-4f5d-bcb7-4d766b2927a3 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:39.370592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ee3b3-31eb-42c0-a773-0f25bb6a511b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:39.460706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ee3b3-31eb-42c0-a773-0f25bb6a511b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:39.463729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4a5ce-4967-4f5d-bcb7-4d766b2927a3 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:39.465540 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89efed-028a-426c-9690-75286f0583a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:39.467050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89efed-028a-426c-9690-75286f0583a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:39.467425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89efed-028a-426c-9690-75286f0583a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:39.467634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89efed-028a-426c-9690-75286f0583a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.468430 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89efed-028a-426c-9690-75286f0583a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:39.468945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc8a23-1e59-47c9-b998-f4a9513b8848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:39.469617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc8a23-1e59-47c9-b998-f4a9513b8848 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:39.469959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc8a23-1e59-47c9-b998-f4a9513b8848 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:39.470366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc8a23-1e59-47c9-b998-f4a9513b8848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.470734 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89efed-028a-426c-9690-75286f0583a0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:39.481636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc8a23-1e59-47c9-b998-f4a9513b8848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:39.483497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc8a23-1e59-47c9-b998-f4a9513b8848 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:39.497655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 808/1610] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:39.499412 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ffdec-1502-4ed5-a3a1-6ae1d0c0d6d4 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:39.499815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ffdec-1502-4ed5-a3a1-6ae1d0c0d6d4 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:39.500191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ffdec-1502-4ed5-a3a1-6ae1d0c0d6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.507402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 803/1611] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:39 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:39.509116 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2a763-1dc3-43d3-96a5-75b96a54cab9 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:39.509521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2a763-1dc3-43d3-96a5-75b96a54cab9 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:39.509804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2a763-1dc3-43d3-96a5-75b96a54cab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.533425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-f0d2a763-1dc3-43d3-96a5-75b96a54cab9 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:39.534967 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f0d2a763-1dc3-43d3-96a5-75b96a54cab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:39.542349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-ff5ffdec-1502-4ed5-a3a1-6ae1d0c0d6d4 None None] MFA Rules not processed for user `08fef54ec9364ae7a420dea05613e4b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:39.543853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ff5ffdec-1502-4ed5-a3a1-6ae1d0c0d6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:39.619726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 804/1612] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:39.621467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9753ba-07ed-4345-8e69-320a18615691 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:39.622003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9753ba-07ed-4345-8e69-320a18615691 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:39.622550 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9753ba-07ed-4345-8e69-320a18615691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.631235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 809/1613] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:39.635482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ffdec-1502-4ed5-a3a1-6ae1d0c0d6d4 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:39.644920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ffdec-1502-4ed5-a3a1-6ae1d0c0d6d4 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:39.650534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277f2b0-2880-4b48-a661-5f96382b2339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:39.650840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277f2b0-2880-4b48-a661-5f96382b2339 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:39.651269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277f2b0-2880-4b48-a661-5f96382b2339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:39.651384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277f2b0-2880-4b48-a661-5f96382b2339 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.652110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277f2b0-2880-4b48-a661-5f96382b2339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:39.654783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277f2b0-2880-4b48-a661-5f96382b2339 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:39.656766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-6e9753ba-07ed-4345-8e69-320a18615691 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:39.659909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6e9753ba-07ed-4345-8e69-320a18615691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:39.672231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 805/1614] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:39.673990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1ef56-e885-42b6-a58f-e8c62db14942 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:39.674497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1ef56-e885-42b6-a58f-e8c62db14942 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:39.674868 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1ef56-e885-42b6-a58f-e8c62db14942 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.676821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 806/1615] 10.222.0.43 () {54 vars in 962 bytes} [Wed Jul 27 10:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:49:39.677810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1ef56-e885-42b6-a58f-e8c62db14942 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:39.697677 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:39.700105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 810/1616] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:39 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:39.701690 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277f2b0-2880-4b48-a661-5f96382b2339 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:39.707331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1ef56-e885-42b6-a58f-e8c62db14942 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:39.789550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:39.799421 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e87f8-4c77-45cf-8147-489af03442aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:39.800071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e87f8-4c77-45cf-8147-489af03442aa admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:39.800266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e87f8-4c77-45cf-8147-489af03442aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:39.801009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e87f8-4c77-45cf-8147-489af03442aa admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.801784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e87f8-4c77-45cf-8147-489af03442aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:39.803996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e87f8-4c77-45cf-8147-489af03442aa admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:39.817094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277f2b0-2880-4b48-a661-5f96382b2339 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:39.826838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71691b-778d-4eef-b4fe-81cba1e39dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:39.827828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71691b-778d-4eef-b4fe-81cba1e39dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:39.828669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71691b-778d-4eef-b4fe-81cba1e39dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:39.829619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71691b-778d-4eef-b4fe-81cba1e39dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.829925 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71691b-778d-4eef-b4fe-81cba1e39dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:39.843305 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71691b-778d-4eef-b4fe-81cba1e39dd2 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:39.860344 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 807/1617] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:39 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:39.863783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e87f8-4c77-45cf-8147-489af03442aa admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:39.874479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-566e87f8-4c77-45cf-8147-489af03442aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:39.916727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 811/1618] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:39 2022] POST /identity/v3/projects => generated 363 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:39.918559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6f81-7a12-4b51-a862-5952336c50f1 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:39.919443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6f81-7a12-4b51-a862-5952336c50f1 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:39.921161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6f81-7a12-4b51-a862-5952336c50f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:39.987401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-031b6f81-7a12-4b51-a862-5952336c50f1 None None] MFA Rules not processed for user `3bb16c9232464cc2aeee12b7fa918b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:39.988954 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-031b6f81-7a12-4b51-a862-5952336c50f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:40.019486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e87f8-4c77-45cf-8147-489af03442aa admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:40.117470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a6a9b-9716-45ac-8bb0-90b5a40abfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:40.119983 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a6a9b-9716-45ac-8bb0-90b5a40abfad service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:40.120808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a6a9b-9716-45ac-8bb0-90b5a40abfad service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:40.122682 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a6a9b-9716-45ac-8bb0-90b5a40abfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:40.143667 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 812/1619] 10.222.0.43 () {58 vars in 1059 bytes} [Wed Jul 27 10:49:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:40.155847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b6f81-7a12-4b51-a862-5952336c50f1 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:40.168100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b6f81-7a12-4b51-a862-5952336c50f1 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:40.173509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85db2e-d572-4478-87db-49c27518f5f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:40.174909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85db2e-d572-4478-87db-49c27518f5f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:40.175309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85db2e-d572-4478-87db-49c27518f5f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:40.175696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85db2e-d572-4478-87db-49c27518f5f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:40.250160 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a6a9b-9716-45ac-8bb0-90b5a40abfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:40.252946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a6a9b-9716-45ac-8bb0-90b5a40abfad service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:40.259560 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:40.268604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 808/1620] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:40.273438 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a6a9b-9716-45ac-8bb0-90b5a40abfad service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:40.291747 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a6a9b-9716-45ac-8bb0-90b5a40abfad service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:40.303298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85db2e-d572-4478-87db-49c27518f5f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:40.305220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85db2e-d572-4478-87db-49c27518f5f7 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:40.311418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579f63c-6eeb-40e6-9976-f6cf7739d41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:40.312128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579f63c-6eeb-40e6-9976-f6cf7739d41d admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:40.312417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579f63c-6eeb-40e6-9976-f6cf7739d41d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:40.312693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579f63c-6eeb-40e6-9976-f6cf7739d41d admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:40.313661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579f63c-6eeb-40e6-9976-f6cf7739d41d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:40.316642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579f63c-6eeb-40e6-9976-f6cf7739d41d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:40.342770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 813/1621] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:40.346224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85db2e-d572-4478-87db-49c27518f5f7 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:40.362506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 809/1622] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:40 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:40.364258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579f63c-6eeb-40e6-9976-f6cf7739d41d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:40.380789 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579f63c-6eeb-40e6-9976-f6cf7739d41d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:40.392073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5859e47-8762-4a92-b9d5-400f36e7bdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:40.393459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5859e47-8762-4a92-b9d5-400f36e7bdab admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:40.395979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5859e47-8762-4a92-b9d5-400f36e7bdab admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:40.396719 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5859e47-8762-4a92-b9d5-400f36e7bdab admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:40.398811 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85db2e-d572-4478-87db-49c27518f5f7 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:40.399728 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5859e47-8762-4a92-b9d5-400f36e7bdab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:40.407232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5859e47-8762-4a92-b9d5-400f36e7bdab admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:40.415452 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcf21e-c0c6-4932-ac04-aa85f24e0f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:40.416301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcf21e-c0c6-4932-ac04-aa85f24e0f16 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:40.416630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcf21e-c0c6-4932-ac04-aa85f24e0f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:40.416976 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcf21e-c0c6-4932-ac04-aa85f24e0f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:40.418629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcf21e-c0c6-4932-ac04-aa85f24e0f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:40.425606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcf21e-c0c6-4932-ac04-aa85f24e0f16 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:40.475876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 814/1623] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:40.475876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcf21e-c0c6-4932-ac04-aa85f24e0f16 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:40.476250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 810/1624] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:40 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:40.476250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5859e47-8762-4a92-b9d5-400f36e7bdab admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:40.532147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcf21e-c0c6-4932-ac04-aa85f24e0f16 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:40.540141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5859e47-8762-4a92-b9d5-400f36e7bdab admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:40.560633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad977bd-373b-4866-b945-ba093e5da04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:40.561682 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad977bd-373b-4866-b945-ba093e5da04e admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:40.562004 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad977bd-373b-4866-b945-ba093e5da04e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:40.562352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad977bd-373b-4866-b945-ba093e5da04e admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:40.564064 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8624a59-2610-42ba-888b-1301dd47d8f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:40.565020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8624a59-2610-42ba-888b-1301dd47d8f3 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:40.565604 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8624a59-2610-42ba-888b-1301dd47d8f3 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:40.566073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad977bd-373b-4866-b945-ba093e5da04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:40.566704 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8624a59-2610-42ba-888b-1301dd47d8f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:40.571878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad977bd-373b-4866-b945-ba093e5da04e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:40.627009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 811/1625] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:40.628168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad977bd-373b-4866-b945-ba093e5da04e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:40.667132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad977bd-373b-4866-b945-ba093e5da04e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:40.678854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:40.687852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bba30-a02f-44ce-8533-293cb73a0d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:40.689554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bba30-a02f-44ce-8533-293cb73a0d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:40.690251 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bba30-a02f-44ce-8533-293cb73a0d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:40.690650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bba30-a02f-44ce-8533-293cb73a0d54 admin admin] PATH_INFO: `/v3/projects/baaed2b4951f42adb13f9ccc1d08069a/users/51cccf11d27a461fa229d8c59b61e2a3/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:40.735514 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bba30-a02f-44ce-8533-293cb73a0d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baaed2b4951f42adb13f9ccc1d08069a, user_id=51cccf11d27a461fa229d8c59b61e2a3, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:40.738604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bba30-a02f-44ce-8533-293cb73a0d54 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:40.756996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8624a59-2610-42ba-888b-1301dd47d8f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:40.761427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8624a59-2610-42ba-888b-1301dd47d8f3 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:40.770138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 812/1626] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:40 2022] PUT /identity/v3/projects/baaed2b4951f42adb13f9ccc1d08069a/users/51cccf11d27a461fa229d8c59b61e2a3/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:40.771618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bba30-a02f-44ce-8533-293cb73a0d54 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:40.792729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 815/1627] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:40.794687 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8624a59-2610-42ba-888b-1301dd47d8f3 service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:40.824532 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8624a59-2610-42ba-888b-1301dd47d8f3 service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:40.930011 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bba30-a02f-44ce-8533-293cb73a0d54 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:40.948712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432baedc-7cab-456f-90e6-ae7f22ca80ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:40.949361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432baedc-7cab-456f-90e6-ae7f22ca80ec admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:40.949852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432baedc-7cab-456f-90e6-ae7f22ca80ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:40.950918 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432baedc-7cab-456f-90e6-ae7f22ca80ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:40.951762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432baedc-7cab-456f-90e6-ae7f22ca80ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:40.953550 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432baedc-7cab-456f-90e6-ae7f22ca80ec admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:40.973604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 813/1628] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:40.974829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432baedc-7cab-456f-90e6-ae7f22ca80ec admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:40.983372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99789e7f-1f7f-413f-a354-956f482c00e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:40.986129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99789e7f-1f7f-413f-a354-956f482c00e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:40.986428 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99789e7f-1f7f-413f-a354-956f482c00e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:40.986712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99789e7f-1f7f-413f-a354-956f482c00e5 admin admin] PATH_INFO: `/v3/projects/af0d5058bdd3461787c22b0a8160c62e/users/015f67640392412799618619fa01eb0f/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:41.002687 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432baedc-7cab-456f-90e6-ae7f22ca80ec admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:41.011796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7adc24-85eb-4283-b283-a5c1b57486b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:41.013014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7adc24-85eb-4283-b283-a5c1b57486b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:41.014030 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7adc24-85eb-4283-b283-a5c1b57486b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:41.014355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7adc24-85eb-4283-b283-a5c1b57486b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:41.015093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7adc24-85eb-4283-b283-a5c1b57486b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:41.016738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7adc24-85eb-4283-b283-a5c1b57486b0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:41.025917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99789e7f-1f7f-413f-a354-956f482c00e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0d5058bdd3461787c22b0a8160c62e, user_id=015f67640392412799618619fa01eb0f, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:41.033588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99789e7f-1f7f-413f-a354-956f482c00e5 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:41.043327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 814/1629] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:41.046270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7adc24-85eb-4283-b283-a5c1b57486b0 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:41.070838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 816/1630] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:40 2022] PUT /identity/v3/projects/af0d5058bdd3461787c22b0a8160c62e/users/015f67640392412799618619fa01eb0f/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:41.070838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99789e7f-1f7f-413f-a354-956f482c00e5 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:41.086687 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7adc24-85eb-4283-b283-a5c1b57486b0 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:41.209496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfae9c-8529-4669-8cde-faf4c51e0d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:41.210226 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfae9c-8529-4669-8cde-faf4c51e0d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:41.210506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfae9c-8529-4669-8cde-faf4c51e0d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:41.210728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99789e7f-1f7f-413f-a354-956f482c00e5 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:41.211187 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfae9c-8529-4669-8cde-faf4c51e0d37 admin admin] PATH_INFO: `/v3/projects/d1e54cec73a64b059b32c493d66cf7cf/users/ec1b55295a9a491780ab1b5ddb772de0/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:41.224076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d7e32-5492-4ee2-b9ad-8948f55a97f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:41.224788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d7e32-5492-4ee2-b9ad-8948f55a97f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:41.225069 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d7e32-5492-4ee2-b9ad-8948f55a97f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:41.225346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d7e32-5492-4ee2-b9ad-8948f55a97f8 admin admin] PATH_INFO: `/v3/projects/baaed2b4951f42adb13f9ccc1d08069a/users/51cccf11d27a461fa229d8c59b61e2a3/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:41.235697 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d7e32-5492-4ee2-b9ad-8948f55a97f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baaed2b4951f42adb13f9ccc1d08069a, user_id=51cccf11d27a461fa229d8c59b61e2a3, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:41.238741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d7e32-5492-4ee2-b9ad-8948f55a97f8 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:41.243399 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfae9c-8529-4669-8cde-faf4c51e0d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e54cec73a64b059b32c493d66cf7cf, user_id=ec1b55295a9a491780ab1b5ddb772de0, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:41.246116 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfae9c-8529-4669-8cde-faf4c51e0d37 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:41.275106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 817/1631] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:41 2022] PUT /identity/v3/projects/baaed2b4951f42adb13f9ccc1d08069a/users/51cccf11d27a461fa229d8c59b61e2a3/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:41.276696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d7e32-5492-4ee2-b9ad-8948f55a97f8 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:41.276901 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:41.285693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 815/1632] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:41 2022] PUT /identity/v3/projects/d1e54cec73a64b059b32c493d66cf7cf/users/ec1b55295a9a491780ab1b5ddb772de0/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:41.287040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56747116-6654-4879-9ae1-b4467cc63f55 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:41.287718 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56747116-6654-4879-9ae1-b4467cc63f55 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:41.288326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56747116-6654-4879-9ae1-b4467cc63f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:41.368687 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-56747116-6654-4879-9ae1-b4467cc63f55 None None] MFA Rules not processed for user `51cccf11d27a461fa229d8c59b61e2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:41.370601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-56747116-6654-4879-9ae1-b4467cc63f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:41.406090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:41.434501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d7e32-5492-4ee2-b9ad-8948f55a97f8 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:41.564274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be123078-e568-4d74-b979-222ca7368f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:41.564945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123078-e568-4d74-b979-222ca7368f2d admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:41.565236 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123078-e568-4d74-b979-222ca7368f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:41.578702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123078-e568-4d74-b979-222ca7368f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:41.579497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be123078-e568-4d74-b979-222ca7368f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:41.581151 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be123078-e568-4d74-b979-222ca7368f2d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:41.592733 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 816/1633] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:41.593713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56747116-6654-4879-9ae1-b4467cc63f55 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:41.600230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 818/1634] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:41.606028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be123078-e568-4d74-b979-222ca7368f2d admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:41.628549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be123078-e568-4d74-b979-222ca7368f2d admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:41.633473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7680-4887-44a7-be86-e826c5ae7b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:41.634208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7680-4887-44a7-be86-e826c5ae7b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:41.634515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7680-4887-44a7-be86-e826c5ae7b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:41.634638 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56747116-6654-4879-9ae1-b4467cc63f55 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:41.634815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7680-4887-44a7-be86-e826c5ae7b07 admin admin] PATH_INFO: `/v3/projects/af0d5058bdd3461787c22b0a8160c62e/users/015f67640392412799618619fa01eb0f/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:41.647351 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c7680-4887-44a7-be86-e826c5ae7b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0d5058bdd3461787c22b0a8160c62e, user_id=015f67640392412799618619fa01eb0f, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:41.647584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9f58c-abf5-4bbf-9645-7724bad0cba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:41.648184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9f58c-abf5-4bbf-9645-7724bad0cba0 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:41.648472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9f58c-abf5-4bbf-9645-7724bad0cba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:41.648928 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9f58c-abf5-4bbf-9645-7724bad0cba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:41.649653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9f58c-abf5-4bbf-9645-7724bad0cba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:41.650264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c7680-4887-44a7-be86-e826c5ae7b07 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:41.654552 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9f58c-abf5-4bbf-9645-7724bad0cba0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:41.682615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 817/1635] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:41.684107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9f58c-abf5-4bbf-9645-7724bad0cba0 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:41.696128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 819/1636] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:41 2022] PUT /identity/v3/projects/af0d5058bdd3461787c22b0a8160c62e/users/015f67640392412799618619fa01eb0f/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:41.697028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7680-4887-44a7-be86-e826c5ae7b07 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:41.878167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9f58c-abf5-4bbf-9645-7724bad0cba0 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:41.932859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7680-4887-44a7-be86-e826c5ae7b07 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:41.964022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecf1a5-993b-4fe2-a4c5-fddd037c7af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:41.964744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecf1a5-993b-4fe2-a4c5-fddd037c7af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:41.965025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecf1a5-993b-4fe2-a4c5-fddd037c7af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:41.965295 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecf1a5-993b-4fe2-a4c5-fddd037c7af6 admin admin] PATH_INFO: `/v3/projects/d1e54cec73a64b059b32c493d66cf7cf/users/ec1b55295a9a491780ab1b5ddb772de0/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:41.983436 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecf1a5-993b-4fe2-a4c5-fddd037c7af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e54cec73a64b059b32c493d66cf7cf, user_id=ec1b55295a9a491780ab1b5ddb772de0, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:41.992546 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecf1a5-993b-4fe2-a4c5-fddd037c7af6 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:42.029260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 820/1637] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:41 2022] PUT /identity/v3/projects/d1e54cec73a64b059b32c493d66cf7cf/users/ec1b55295a9a491780ab1b5ddb772de0/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:42.030625 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de4d6d-4a14-4f9a-818d-490675fff342 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:42.030921 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de4d6d-4a14-4f9a-818d-490675fff342 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:42.031201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de4d6d-4a14-4f9a-818d-490675fff342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:42.050303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d6c22-b221-471d-b041-044bd6413efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:42.051275 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d6c22-b221-471d-b041-044bd6413efe service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:42.051669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d6c22-b221-471d-b041-044bd6413efe service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:42.052354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d6c22-b221-471d-b041-044bd6413efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:42.134424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:42.144922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-30de4d6d-4a14-4f9a-818d-490675fff342 None None] MFA Rules not processed for user `015f67640392412799618619fa01eb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:42.149550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-30de4d6d-4a14-4f9a-818d-490675fff342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:42.162368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d6c22-b221-471d-b041-044bd6413efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:42.164557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d6c22-b221-471d-b041-044bd6413efe service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:42.201478 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 818/1638] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:42.205343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5c4e5-e17c-44c6-9c7d-2e3971d34caf None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:42.210576 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5c4e5-e17c-44c6-9c7d-2e3971d34caf None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:42.211168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5c4e5-e17c-44c6-9c7d-2e3971d34caf None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:42.219106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 819/1639] 10.222.0.43 () {54 vars in 962 bytes} [Wed Jul 27 10:49:42 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:49:42.223639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2cc19-a862-4d29-98b8-cc5ce148ef08 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:42.223639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2cc19-a862-4d29-98b8-cc5ce148ef08 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:42.230469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2cc19-a862-4d29-98b8-cc5ce148ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:42.329037 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-1af2cc19-a862-4d29-98b8-cc5ce148ef08 None None] MFA Rules not processed for user `ec1b55295a9a491780ab1b5ddb772de0`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:42.330070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:42.335086 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1af2cc19-a862-4d29-98b8-cc5ce148ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:42.336892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 821/1640] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:42.338602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9e037-22df-465c-a527-86302d6b4191 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:42.338813 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9e037-22df-465c-a527-86302d6b4191 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:42.339092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9e037-22df-465c-a527-86302d6b4191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:42.370907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-cfb9e037-22df-465c-a527-86302d6b4191 None None] MFA Rules not processed for user `3bb16c9232464cc2aeee12b7fa918b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:42.372446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-cfb9e037-22df-465c-a527-86302d6b4191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:42.468050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 822/1641] 10.222.0.43 () {58 vars in 1059 bytes} [Wed Jul 27 10:49:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:42.469157 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9e037-22df-465c-a527-86302d6b4191 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:42.582008 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9e037-22df-465c-a527-86302d6b4191 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:42.614215 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ca4be-4a0d-42f5-9ef6-dd2f4f1d2e07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:42.615051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ca4be-4a0d-42f5-9ef6-dd2f4f1d2e07 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:42.615339 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ca4be-4a0d-42f5-9ef6-dd2f4f1d2e07 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:42.615610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ca4be-4a0d-42f5-9ef6-dd2f4f1d2e07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:42.626645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 820/1642] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:42 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:42.626645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37134c1-22a9-4cac-8e41-34f2e431de0d None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:42.626645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37134c1-22a9-4cac-8e41-34f2e431de0d None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:42.626645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37134c1-22a9-4cac-8e41-34f2e431de0d None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:42.627142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 821/1643] 10.222.0.43 () {54 vars in 912 bytes} [Wed Jul 27 10:49:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:49:42.653317 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7e8fc-ec67-4350-ad78-5a72eae4c133 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:42.653890 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7e8fc-ec67-4350-ad78-5a72eae4c133 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:42.654500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7e8fc-ec67-4350-ad78-5a72eae4c133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:42.655612 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ca4be-4a0d-42f5-9ef6-dd2f4f1d2e07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:42.659947 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ca4be-4a0d-42f5-9ef6-dd2f4f1d2e07 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:42.688746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 823/1644] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:42.690063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ca4be-4a0d-42f5-9ef6-dd2f4f1d2e07 service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:42.699461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ca4be-4a0d-42f5-9ef6-dd2f4f1d2e07 service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:42.704274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5b577-c4eb-4a2d-b824-f7548ae5509b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:42.705220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5b577-c4eb-4a2d-b824-f7548ae5509b service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:42.706124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5b577-c4eb-4a2d-b824-f7548ae5509b service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:42.706633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5b577-c4eb-4a2d-b824-f7548ae5509b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:42.725239 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5b577-c4eb-4a2d-b824-f7548ae5509b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:42.728929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5b577-c4eb-4a2d-b824-f7548ae5509b service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:42.747477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-15f7e8fc-ec67-4350-ad78-5a72eae4c133 None None] MFA Rules not processed for user `3bb16c9232464cc2aeee12b7fa918b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:42.750084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-15f7e8fc-ec67-4350-ad78-5a72eae4c133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:42.753417 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 824/1645] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:42.783337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 822/1646] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 10:49:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:42.855457 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5b577-c4eb-4a2d-b824-f7548ae5509b service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:42.869294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5b577-c4eb-4a2d-b824-f7548ae5509b service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:42.876984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe238027-eee6-4915-8742-905202aeab02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:42.878702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe238027-eee6-4915-8742-905202aeab02 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:42.879349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe238027-eee6-4915-8742-905202aeab02 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:42.880001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe238027-eee6-4915-8742-905202aeab02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:42.909497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe238027-eee6-4915-8742-905202aeab02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:42.912924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe238027-eee6-4915-8742-905202aeab02 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:42.960837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 825/1647] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:43.053997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7e8fc-ec67-4350-ad78-5a72eae4c133 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:43.072171 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7e8fc-ec67-4350-ad78-5a72eae4c133 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:43.086129 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126318e6-799b-44ca-b08a-57aaff327268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:43.092490 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126318e6-799b-44ca-b08a-57aaff327268 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:43.093708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126318e6-799b-44ca-b08a-57aaff327268 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:43.094209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126318e6-799b-44ca-b08a-57aaff327268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:43.154590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905dd8c-68a6-435c-9cc3-40cef149b79e None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:43.155200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905dd8c-68a6-435c-9cc3-40cef149b79e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:43.156382 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905dd8c-68a6-435c-9cc3-40cef149b79e None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:43.158723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 826/1648] 10.222.0.43 () {54 vars in 912 bytes} [Wed Jul 27 10:49:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:49:43.164116 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d583839-58e1-4523-8293-6e21733ff914 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:43.164743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d583839-58e1-4523-8293-6e21733ff914 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:43.165196 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d583839-58e1-4523-8293-6e21733ff914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:43.211588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-1d583839-58e1-4523-8293-6e21733ff914 None None] MFA Rules not processed for user `3bb16c9232464cc2aeee12b7fa918b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:43.212854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1d583839-58e1-4523-8293-6e21733ff914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:43.286051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 827/1649] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 10:49:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:49:43.348852 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d583839-58e1-4523-8293-6e21733ff914 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:43.363267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d583839-58e1-4523-8293-6e21733ff914 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:43.373896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c5be7-f4d8-46e7-afd8-377f5b117f76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:43.374580 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c5be7-f4d8-46e7-afd8-377f5b117f76 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:43.374864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c5be7-f4d8-46e7-afd8-377f5b117f76 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:43.375143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c5be7-f4d8-46e7-afd8-377f5b117f76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:43.403840 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126318e6-799b-44ca-b08a-57aaff327268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:43.406426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126318e6-799b-44ca-b08a-57aaff327268 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:43.413962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c5be7-f4d8-46e7-afd8-377f5b117f76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:43.415695 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c5be7-f4d8-46e7-afd8-377f5b117f76 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:43.441690 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 823/1650] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:43.448141 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 828/1651] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:43.631882 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126318e6-799b-44ca-b08a-57aaff327268 service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:43.841942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:43.866160 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126318e6-799b-44ca-b08a-57aaff327268 service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:43.912556 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77335a8-6ccd-4f02-bba6-6d6f1c4c4e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:43.913403 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77335a8-6ccd-4f02-bba6-6d6f1c4c4e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:43.913762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77335a8-6ccd-4f02-bba6-6d6f1c4c4e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:43.914172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77335a8-6ccd-4f02-bba6-6d6f1c4c4e51 admin admin] PATH_INFO: `/v3/users/65d210c95da44ee399c48322d4c919b3` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:43.919619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77335a8-6ccd-4f02-bba6-6d6f1c4c4e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d210c95da44ee399c48322d4c919b3)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:43.929890 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77335a8-6ccd-4f02-bba6-6d6f1c4c4e51 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:44.062307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e77335a8-6ccd-4f02-bba6-6d6f1c4c4e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d210c95da44ee399c48322d4c919b3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:44.063183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e77335a8-6ccd-4f02-bba6-6d6f1c4c4e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d210c95da44ee399c48322d4c919b3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:44.083251 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e77335a8-6ccd-4f02-bba6-6d6f1c4c4e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d210c95da44ee399c48322d4c919b3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:44.084665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e77335a8-6ccd-4f02-bba6-6d6f1c4c4e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d210c95da44ee399c48322d4c919b3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:44.097097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e77335a8-6ccd-4f02-bba6-6d6f1c4c4e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d210c95da44ee399c48322d4c919b3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:44.143288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d71a-3e6e-4c2c-a2ad-fabcb0fed2c7 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:44.143837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d71a-3e6e-4c2c-a2ad-fabcb0fed2c7 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:44.145148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8d71a-3e6e-4c2c-a2ad-fabcb0fed2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:44.149159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 824/1652] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:49:43 2022] DELETE /identity/v3/users/65d210c95da44ee399c48322d4c919b3 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:44.190174 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-56f8d71a-3e6e-4c2c-a2ad-fabcb0fed2c7 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:44.192405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-56f8d71a-3e6e-4c2c-a2ad-fabcb0fed2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:44.316795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:44.360564 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 829/1653] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:44.376349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8d71a-3e6e-4c2c-a2ad-fabcb0fed2c7 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:44.376615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77335a8-6ccd-4f02-bba6-6d6f1c4c4e51 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:44.378843 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-56f8d71a-3e6e-4c2c-a2ad-fabcb0fed2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:44.379943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e77335a8-6ccd-4f02-bba6-6d6f1c4c4e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:44.399543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77335a8-6ccd-4f02-bba6-6d6f1c4c4e51 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:44.413682 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d417d94-27d9-4b60-afd5-257b02d2693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:44.416148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d417d94-27d9-4b60-afd5-257b02d2693f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:44.416459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d417d94-27d9-4b60-afd5-257b02d2693f admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:44.416745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d417d94-27d9-4b60-afd5-257b02d2693f admin admin] PATH_INFO: `/v3/users/e5928a48b85242bab39d847e239be14f` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:44.418391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d417d94-27d9-4b60-afd5-257b02d2693f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5928a48b85242bab39d847e239be14f)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:44.420645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d417d94-27d9-4b60-afd5-257b02d2693f admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:44.513011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8d71a-3e6e-4c2c-a2ad-fabcb0fed2c7 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:44.530841 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d1f08-d339-4b82-a566-55cddaa7d930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:44.532087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d1f08-d339-4b82-a566-55cddaa7d930 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:44.535284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d1f08-d339-4b82-a566-55cddaa7d930 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:44.535284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d1f08-d339-4b82-a566-55cddaa7d930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:44.554347 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5d417d94-27d9-4b60-afd5-257b02d2693f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5928a48b85242bab39d847e239be14f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:44.555492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5d417d94-27d9-4b60-afd5-257b02d2693f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5928a48b85242bab39d847e239be14f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:44.578616 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d1f08-d339-4b82-a566-55cddaa7d930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:44.581378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5d417d94-27d9-4b60-afd5-257b02d2693f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5928a48b85242bab39d847e239be14f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:44.582138 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d1f08-d339-4b82-a566-55cddaa7d930 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:44.583094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5d417d94-27d9-4b60-afd5-257b02d2693f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5928a48b85242bab39d847e239be14f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:44.598081 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5d417d94-27d9-4b60-afd5-257b02d2693f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5928a48b85242bab39d847e239be14f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:44.612134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 830/1654] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:49:44.655378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 825/1655] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:49:44 2022] DELETE /identity/v3/users/e5928a48b85242bab39d847e239be14f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:44.662591 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36a029-b1eb-4a80-b9a8-3508047deef2 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:44.662591 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36a029-b1eb-4a80-b9a8-3508047deef2 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:44.662591 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36a029-b1eb-4a80-b9a8-3508047deef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:44.672472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d417d94-27d9-4b60-afd5-257b02d2693f admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:44.678426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5d417d94-27d9-4b60-afd5-257b02d2693f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:44.717191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-0c36a029-b1eb-4a80-b9a8-3508047deef2 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:44.722671 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0c36a029-b1eb-4a80-b9a8-3508047deef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:44.827125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:44.868953 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d417d94-27d9-4b60-afd5-257b02d2693f admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:44.898334 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c84e6-9c77-4e31-b5ce-6086b888cbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:44.900090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c84e6-9c77-4e31-b5ce-6086b888cbcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:44.901124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c84e6-9c77-4e31-b5ce-6086b888cbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:44.901467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c84e6-9c77-4e31-b5ce-6086b888cbcb admin admin] PATH_INFO: `/v3/users/08fef54ec9364ae7a420dea05613e4b5` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:44.903023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 831/1656] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:44.903985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c84e6-9c77-4e31-b5ce-6086b888cbcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=08fef54ec9364ae7a420dea05613e4b5)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:44.906301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c84e6-9c77-4e31-b5ce-6086b888cbcb admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:44.935633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36a029-b1eb-4a80-b9a8-3508047deef2 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:44.938156 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0c36a029-b1eb-4a80-b9a8-3508047deef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:45.039184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-625c84e6-9c77-4e31-b5ce-6086b888cbcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08fef54ec9364ae7a420dea05613e4b5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:45.040937 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-625c84e6-9c77-4e31-b5ce-6086b888cbcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08fef54ec9364ae7a420dea05613e4b5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:45.061807 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-625c84e6-9c77-4e31-b5ce-6086b888cbcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08fef54ec9364ae7a420dea05613e4b5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:45.063449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-625c84e6-9c77-4e31-b5ce-6086b888cbcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08fef54ec9364ae7a420dea05613e4b5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:45.084398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-625c84e6-9c77-4e31-b5ce-6086b888cbcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08fef54ec9364ae7a420dea05613e4b5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:45.133553 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36a029-b1eb-4a80-b9a8-3508047deef2 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:45.140902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 826/1657] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:49:44 2022] DELETE /identity/v3/users/08fef54ec9364ae7a420dea05613e4b5 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:45.142393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa4c0b-f717-4bc5-89da-3ba44e06af40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:45.145253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30003ff-56d1-4167-bacd-a89eabdd9531 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:45.145649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30003ff-56d1-4167-bacd-a89eabdd9531 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:45.145938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30003ff-56d1-4167-bacd-a89eabdd9531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:45.147004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa4c0b-f717-4bc5-89da-3ba44e06af40 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:45.148463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa4c0b-f717-4bc5-89da-3ba44e06af40 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:45.148960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa4c0b-f717-4bc5-89da-3ba44e06af40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:45.155651 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-09fa4c0b-f717-4bc5-89da-3ba44e06af40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:45.184350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa4c0b-f717-4bc5-89da-3ba44e06af40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:45.186175 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa4c0b-f717-4bc5-89da-3ba44e06af40 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:45.207060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b30003ff-56d1-4167-bacd-a89eabdd9531 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:45.209227 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b30003ff-56d1-4167-bacd-a89eabdd9531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:45.216355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 832/1658] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:45.333653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 827/1659] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:45.413485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa4c0b-f717-4bc5-89da-3ba44e06af40 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:45.415314 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-09fa4c0b-f717-4bc5-89da-3ba44e06af40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:45.437333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa4c0b-f717-4bc5-89da-3ba44e06af40 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:45.563499 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:45.600072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53ba26-7104-408b-8d32-f970afeb3a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:45.600302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53ba26-7104-408b-8d32-f970afeb3a5e service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:45.600547 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53ba26-7104-408b-8d32-f970afeb3a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:45.600822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53ba26-7104-408b-8d32-f970afeb3a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:45.630793 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53ba26-7104-408b-8d32-f970afeb3a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:45.633391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53ba26-7104-408b-8d32-f970afeb3a5e service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:45.662956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 833/1660] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:49:46.800952 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b701b-c8bd-4142-a5da-fb3036c47f35 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:46.801582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b701b-c8bd-4142-a5da-fb3036c47f35 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:46.801582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b701b-c8bd-4142-a5da-fb3036c47f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:46.874945 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-993b701b-c8bd-4142-a5da-fb3036c47f35 None None] MFA Rules not processed for user `9c6c44ca3dc44632b7d064d19a9cf1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:46.876395 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-993b701b-c8bd-4142-a5da-fb3036c47f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:47.155604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:47.198385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 828/1661] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:47.213463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53ba26-7104-408b-8d32-f970afeb3a5e service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:47.220038 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ac53ba26-7104-408b-8d32-f970afeb3a5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:47.396416 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53ba26-7104-408b-8d32-f970afeb3a5e service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:47.414905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd03e2e-79c7-409e-8dc7-eff4993fe1f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:47.415867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd03e2e-79c7-409e-8dc7-eff4993fe1f6 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:47.416313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd03e2e-79c7-409e-8dc7-eff4993fe1f6 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:47.416741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd03e2e-79c7-409e-8dc7-eff4993fe1f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:47.440036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd03e2e-79c7-409e-8dc7-eff4993fe1f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:47.447432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd03e2e-79c7-409e-8dc7-eff4993fe1f6 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:47.483369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 834/1662] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:47.596080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b701b-c8bd-4142-a5da-fb3036c47f35 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:47.600109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-993b701b-c8bd-4142-a5da-fb3036c47f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:47.646963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b701b-c8bd-4142-a5da-fb3036c47f35 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:47.664406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:47.665525 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:47.666085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:47.667043 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] PATH_INFO: `/v3/projects/7cc98e6ea388454aa3d7f77e91268f2e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:47.670929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc98e6ea388454aa3d7f77e91268f2e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:47.674401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: WARNING py.warnings [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:49:47.674401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: warnings.warn(msg) Jul 27 10:49:47.674401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: Jul 27 10:49:47.678482 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:47.839490 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc98e6ea388454aa3d7f77e91268f2e', 'request_id': 'req-c343ebcc-9c0c-4478-860f-46ab7d19e502'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:47.884243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc98e6ea388454aa3d7f77e91268f2e', 'request_id': 'req-c343ebcc-9c0c-4478-860f-46ab7d19e502'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:47.914839 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc98e6ea388454aa3d7f77e91268f2e', 'request_id': 'req-c343ebcc-9c0c-4478-860f-46ab7d19e502'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:47.982033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] The token cache is being invalidate because project 7cc98e6ea388454aa3d7f77e91268f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:49:47.982363 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:47.988930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:47.997911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 829/1663] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:49:47 2022] DELETE /identity/v3/projects/7cc98e6ea388454aa3d7f77e91268f2e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:48.000026 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597d3a1-aa58-45be-9f1b-de6184f8f515 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:48.000827 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597d3a1-aa58-45be-9f1b-de6184f8f515 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:48.001386 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597d3a1-aa58-45be-9f1b-de6184f8f515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:48.073873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-7597d3a1-aa58-45be-9f1b-de6184f8f515 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:48.075521 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7597d3a1-aa58-45be-9f1b-de6184f8f515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:48.135166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:48.136881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:48.327557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 835/1664] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:48.343162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a338fd-6379-450c-8874-0a54cf118db1 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:48.343162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a338fd-6379-450c-8874-0a54cf118db1 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:48.343433 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a338fd-6379-450c-8874-0a54cf118db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:48.419759 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-49a338fd-6379-450c-8874-0a54cf118db1 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:48.426447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-49a338fd-6379-450c-8874-0a54cf118db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:48.446062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 836/1665] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:48.447405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a338fd-6379-450c-8874-0a54cf118db1 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:48.447541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343ebcc-9c0c-4478-860f-46ab7d19e502 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:48.467052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a338fd-6379-450c-8874-0a54cf118db1 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:48.469769 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:48.471043 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:48.471812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:48.472334 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] PATH_INFO: `/v3/projects/864691f7fd3c439985d9ba504482e8f6` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:48.474127 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=864691f7fd3c439985d9ba504482e8f6)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:48.476681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:48.484858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c136-b819-4f87-8868-f31ca1868ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:48.485238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c136-b819-4f87-8868-f31ca1868ecd admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:48.485719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c136-b819-4f87-8868-f31ca1868ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:48.486001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62c136-b819-4f87-8868-f31ca1868ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:48.489455 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62c136-b819-4f87-8868-f31ca1868ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:49:48.490220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62c136-b819-4f87-8868-f31ca1868ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:48.495367 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62c136-b819-4f87-8868-f31ca1868ecd admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:48.538020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 837/1666] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:49:48.540939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c136-b819-4f87-8868-f31ca1868ecd admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:48.572028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62c136-b819-4f87-8868-f31ca1868ecd admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:48.596084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d50e52-ad6b-4415-bd7f-e1a677280fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:48.598207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d50e52-ad6b-4415-bd7f-e1a677280fdd admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:48.599595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d50e52-ad6b-4415-bd7f-e1a677280fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:48.599893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d50e52-ad6b-4415-bd7f-e1a677280fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:48.602155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d50e52-ad6b-4415-bd7f-e1a677280fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:48.608861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d50e52-ad6b-4415-bd7f-e1a677280fdd admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:48.652075 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '864691f7fd3c439985d9ba504482e8f6', 'request_id': 'req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:48.673852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '864691f7fd3c439985d9ba504482e8f6', 'request_id': 'req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:48.689960 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '864691f7fd3c439985d9ba504482e8f6', 'request_id': 'req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:48.717738 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 838/1667] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:48 2022] POST /identity/v3/projects => generated 405 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:49:48.730354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] The token cache is being invalidate because project 864691f7fd3c439985d9ba504482e8f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:49:48.730913 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:48.733806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:48.734564 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d50e52-ad6b-4415-bd7f-e1a677280fdd admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:48.736448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 830/1668] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:49:48 2022] DELETE /identity/v3/projects/864691f7fd3c439985d9ba504482e8f6 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:49:48.741393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-28d50e52-ad6b-4415-bd7f-e1a677280fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:48.743807 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:48.745987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:48.801965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:48.813100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:48.916524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d50e52-ad6b-4415-bd7f-e1a677280fdd admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:48.948819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6129e88-bed4-4201-8eed-661fc3be21bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:48.954349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6129e88-bed4-4201-8eed-661fc3be21bf admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:48.955289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6129e88-bed4-4201-8eed-661fc3be21bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:48.955779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6129e88-bed4-4201-8eed-661fc3be21bf admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:48.958000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6129e88-bed4-4201-8eed-661fc3be21bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:48.964570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6129e88-bed4-4201-8eed-661fc3be21bf admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:49.000201 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc07c3-0de1-4d41-88c0-a5e8b87535d0 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:49.019976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed57502-ee10-4be2-ac18-364fe30e2c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:49.021058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed57502-ee10-4be2-ac18-364fe30e2c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:49.022525 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed57502-ee10-4be2-ac18-364fe30e2c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:49.023080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed57502-ee10-4be2-ac18-364fe30e2c02 admin admin] PATH_INFO: `/v3/users/51cccf11d27a461fa229d8c59b61e2a3` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:49.027542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 839/1669] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:48 2022] POST /identity/v3/users => generated 303 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:49.029417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed57502-ee10-4be2-ac18-364fe30e2c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51cccf11d27a461fa229d8c59b61e2a3)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:49.031754 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed57502-ee10-4be2-ac18-364fe30e2c02 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:49.034615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6129e88-bed4-4201-8eed-661fc3be21bf admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:49.080150 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6129e88-bed4-4201-8eed-661fc3be21bf admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:49.102447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f132a-a0c7-4d33-91d5-2d222f927096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:49.106963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f132a-a0c7-4d33-91d5-2d222f927096 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:49.107328 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f132a-a0c7-4d33-91d5-2d222f927096 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:49.107755 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f132a-a0c7-4d33-91d5-2d222f927096 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:49.108796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f132a-a0c7-4d33-91d5-2d222f927096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:49.118516 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f132a-a0c7-4d33-91d5-2d222f927096 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:49.158160 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 840/1670] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:49.159103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f132a-a0c7-4d33-91d5-2d222f927096 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:49.184030 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-8ed57502-ee10-4be2-ac18-364fe30e2c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51cccf11d27a461fa229d8c59b61e2a3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:49.185328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-8ed57502-ee10-4be2-ac18-364fe30e2c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51cccf11d27a461fa229d8c59b61e2a3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:49.187194 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f132a-a0c7-4d33-91d5-2d222f927096 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:49.196837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434da0a-0502-408d-a938-6caf8d64dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:49.197517 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434da0a-0502-408d-a938-6caf8d64dc56 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:49.197800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434da0a-0502-408d-a938-6caf8d64dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:49.198088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434da0a-0502-408d-a938-6caf8d64dc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:49.198862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434da0a-0502-408d-a938-6caf8d64dc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:49.201330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434da0a-0502-408d-a938-6caf8d64dc56 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:49.210118 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-8ed57502-ee10-4be2-ac18-364fe30e2c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51cccf11d27a461fa229d8c59b61e2a3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:49.210933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-8ed57502-ee10-4be2-ac18-364fe30e2c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51cccf11d27a461fa229d8c59b61e2a3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:49.224235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-8ed57502-ee10-4be2-ac18-364fe30e2c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51cccf11d27a461fa229d8c59b61e2a3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:49.232954 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 841/1671] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:49.233942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434da0a-0502-408d-a938-6caf8d64dc56 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:49.251922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8434da0a-0502-408d-a938-6caf8d64dc56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:49.268722 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 831/1672] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:49:48 2022] DELETE /identity/v3/users/51cccf11d27a461fa229d8c59b61e2a3 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:49.286849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434da0a-0502-408d-a938-6caf8d64dc56 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:49.455640 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c53827-e253-41ee-86b1-fdc9c5c8802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:49.456693 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c53827-e253-41ee-86b1-fdc9c5c8802b admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:49.457429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c53827-e253-41ee-86b1-fdc9c5c8802b admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:49.457429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c53827-e253-41ee-86b1-fdc9c5c8802b admin admin] PATH_INFO: `/v3/projects/9518f8f3b9b34c9abc51abfdd008adc0/users/662d83c8418641c5819f9283d6ad138f/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:49.501837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c53827-e253-41ee-86b1-fdc9c5c8802b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9518f8f3b9b34c9abc51abfdd008adc0, user_id=662d83c8418641c5819f9283d6ad138f, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:49.506405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c53827-e253-41ee-86b1-fdc9c5c8802b admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:49.570527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 842/1673] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:49 2022] PUT /identity/v3/projects/9518f8f3b9b34c9abc51abfdd008adc0/users/662d83c8418641c5819f9283d6ad138f/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:49.576721 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc7c2-4604-472f-b34a-9030716aa366 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:49.577074 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc7c2-4604-472f-b34a-9030716aa366 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:49.578123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc7c2-4604-472f-b34a-9030716aa366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:49.645956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-610bc7c2-4604-472f-b34a-9030716aa366 None None] MFA Rules not processed for user `662d83c8418641c5819f9283d6ad138f`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:49.647987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-610bc7c2-4604-472f-b34a-9030716aa366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:49.861681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 832/1674] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:49:49.865984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c53827-e253-41ee-86b1-fdc9c5c8802b admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:49.957240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bc7c2-4604-472f-b34a-9030716aa366 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:49.960019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-610bc7c2-4604-472f-b34a-9030716aa366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:50.040755 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:50.073948 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c53827-e253-41ee-86b1-fdc9c5c8802b admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:50.087538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c29a1-f191-47bb-a632-1414e626539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:50.088450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c29a1-f191-47bb-a632-1414e626539b admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:50.088962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c29a1-f191-47bb-a632-1414e626539b admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:50.089582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c29a1-f191-47bb-a632-1414e626539b admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:50.091515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c29a1-f191-47bb-a632-1414e626539b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:50.098910 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c29a1-f191-47bb-a632-1414e626539b admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:50.164293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:50.179507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 843/1675] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:49 2022] POST /identity/v3/projects => generated 405 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:50.187052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c29a1-f191-47bb-a632-1414e626539b admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:50.223640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bc7c2-4604-472f-b34a-9030716aa366 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:50.434757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c29a1-f191-47bb-a632-1414e626539b admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:50.459269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860791e7-3142-4aa1-9d52-16f199fb61b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:50.460536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860791e7-3142-4aa1-9d52-16f199fb61b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:50.460761 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860791e7-3142-4aa1-9d52-16f199fb61b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:50.461250 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860791e7-3142-4aa1-9d52-16f199fb61b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:50.462566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860791e7-3142-4aa1-9d52-16f199fb61b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:50.468864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860791e7-3142-4aa1-9d52-16f199fb61b1 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:50.481733 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:50.483150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:50.483642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:50.484123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] PATH_INFO: `/v3/projects/0d68a5cdbdfc4377b8611ac9b4a8713d` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:50.489371 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d68a5cdbdfc4377b8611ac9b4a8713d)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:50.491397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:50.548821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 844/1676] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:50 2022] POST /identity/v3/users => generated 309 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:50.550713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860791e7-3142-4aa1-9d52-16f199fb61b1 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:50.600382 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860791e7-3142-4aa1-9d52-16f199fb61b1 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:50.610702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d68a5cdbdfc4377b8611ac9b4a8713d', 'request_id': 'req-d79bb0e8-75f5-4353-900f-33c999a46fc7'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:50.626949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d68a5cdbdfc4377b8611ac9b4a8713d', 'request_id': 'req-d79bb0e8-75f5-4353-900f-33c999a46fc7'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:50.640354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d68a5cdbdfc4377b8611ac9b4a8713d', 'request_id': 'req-d79bb0e8-75f5-4353-900f-33c999a46fc7'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:50.667857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] The token cache is being invalidate because project 0d68a5cdbdfc4377b8611ac9b4a8713d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:49:50.667857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:50.668596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:50.670995 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 833/1677] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:49:49 2022] DELETE /identity/v3/projects/0d68a5cdbdfc4377b8611ac9b4a8713d => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:50.677000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:50.678720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:50.820971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:50.832791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bb0e8-75f5-4353-900f-33c999a46fc7 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:50.848995 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d08fb9-403e-43c0-834e-62a05e20ed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:50.849974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08fb9-403e-43c0-834e-62a05e20ed7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:50.850463 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08fb9-403e-43c0-834e-62a05e20ed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:50.851158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08fb9-403e-43c0-834e-62a05e20ed7d admin admin] PATH_INFO: `/v3/users/ec1b55295a9a491780ab1b5ddb772de0` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:50.854849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d08fb9-403e-43c0-834e-62a05e20ed7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1b55295a9a491780ab1b5ddb772de0)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:50.857957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d08fb9-403e-43c0-834e-62a05e20ed7d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:50.873813 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171153e-766f-48db-adfd-73e64e508174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:50.875211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171153e-766f-48db-adfd-73e64e508174 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:50.875819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171153e-766f-48db-adfd-73e64e508174 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:50.876380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171153e-766f-48db-adfd-73e64e508174 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:50.878795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171153e-766f-48db-adfd-73e64e508174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:50.883688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171153e-766f-48db-adfd-73e64e508174 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:50.944690 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 845/1678] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:50.952360 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171153e-766f-48db-adfd-73e64e508174 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:50.958854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f171153e-766f-48db-adfd-73e64e508174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:50.998922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171153e-766f-48db-adfd-73e64e508174 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:51.016311 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b51cf-0294-45fa-8e7c-4824663f1404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:51.017847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b51cf-0294-45fa-8e7c-4824663f1404 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:51.017847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b51cf-0294-45fa-8e7c-4824663f1404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:51.017847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b51cf-0294-45fa-8e7c-4824663f1404 admin admin] PATH_INFO: `/v3/projects/89c6abdeaa904941b06180753c522c93/users/4572ef61b6594de9ab27fcdad5d15b77/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:51.036489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-81d08fb9-403e-43c0-834e-62a05e20ed7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1b55295a9a491780ab1b5ddb772de0'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:51.038683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-81d08fb9-403e-43c0-834e-62a05e20ed7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1b55295a9a491780ab1b5ddb772de0'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:51.060171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b51cf-0294-45fa-8e7c-4824663f1404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c6abdeaa904941b06180753c522c93, user_id=4572ef61b6594de9ab27fcdad5d15b77, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:51.066404 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b51cf-0294-45fa-8e7c-4824663f1404 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:51.069947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-81d08fb9-403e-43c0-834e-62a05e20ed7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1b55295a9a491780ab1b5ddb772de0'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:51.071726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-81d08fb9-403e-43c0-834e-62a05e20ed7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1b55295a9a491780ab1b5ddb772de0'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:51.103319 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 846/1679] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:50 2022] PUT /identity/v3/projects/89c6abdeaa904941b06180753c522c93/users/4572ef61b6594de9ab27fcdad5d15b77/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:49:51.105421 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b51cf-0294-45fa-8e7c-4824663f1404 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:51.108893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-275b51cf-0294-45fa-8e7c-4824663f1404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:51.115114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-81d08fb9-403e-43c0-834e-62a05e20ed7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1b55295a9a491780ab1b5ddb772de0'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:51.147952 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 834/1680] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:49:50 2022] DELETE /identity/v3/users/ec1b55295a9a491780ab1b5ddb772de0 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:51.412924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b51cf-0294-45fa-8e7c-4824663f1404 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:51.428047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:51.689686 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece2c4e-910a-48f5-8a5d-bc52686a7028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:51.690443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece2c4e-910a-48f5-8a5d-bc52686a7028 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:51.691885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece2c4e-910a-48f5-8a5d-bc52686a7028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:51.692163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece2c4e-910a-48f5-8a5d-bc52686a7028 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:51.692925 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece2c4e-910a-48f5-8a5d-bc52686a7028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:51.694723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece2c4e-910a-48f5-8a5d-bc52686a7028 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:51.737474 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 847/1681] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 633 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:51.739049 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d08fb9-403e-43c0-834e-62a05e20ed7d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:51.753839 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d08fb9-403e-43c0-834e-62a05e20ed7d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:51.771921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d626e5a-e4a2-47b7-990f-0cc45eed80d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:51.773174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626e5a-e4a2-47b7-990f-0cc45eed80d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:51.773676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626e5a-e4a2-47b7-990f-0cc45eed80d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:51.774148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626e5a-e4a2-47b7-990f-0cc45eed80d8 admin admin] PATH_INFO: `/v3/projects/89c6abdeaa904941b06180753c522c93/users/4572ef61b6594de9ab27fcdad5d15b77/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:51.778848 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d626e5a-e4a2-47b7-990f-0cc45eed80d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c6abdeaa904941b06180753c522c93, user_id=4572ef61b6594de9ab27fcdad5d15b77, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:51.782210 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d626e5a-e4a2-47b7-990f-0cc45eed80d8 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:51.820647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 835/1682] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:51 2022] PUT /identity/v3/projects/89c6abdeaa904941b06180753c522c93/users/4572ef61b6594de9ab27fcdad5d15b77/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:51.832432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603836-a41d-4b4d-9623-6e9f94a5ba42 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:51.832771 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603836-a41d-4b4d-9623-6e9f94a5ba42 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:51.832993 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603836-a41d-4b4d-9623-6e9f94a5ba42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:51.920213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-9f603836-a41d-4b4d-9623-6e9f94a5ba42 None None] MFA Rules not processed for user `4572ef61b6594de9ab27fcdad5d15b77`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:51.926132 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9f603836-a41d-4b4d-9623-6e9f94a5ba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:52.154969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 848/1683] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:51 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:52.190090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d626e5a-e4a2-47b7-990f-0cc45eed80d8 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:52.195359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-2d626e5a-e4a2-47b7-990f-0cc45eed80d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:52.415567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d626e5a-e4a2-47b7-990f-0cc45eed80d8 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:52.427233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd91625-5fcc-4f2b-8b28-dbc5f9b35b63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:52.428063 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd91625-5fcc-4f2b-8b28-dbc5f9b35b63 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:52.428619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd91625-5fcc-4f2b-8b28-dbc5f9b35b63 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:52.429133 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd91625-5fcc-4f2b-8b28-dbc5f9b35b63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:52.482650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd91625-5fcc-4f2b-8b28-dbc5f9b35b63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:52.485132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd91625-5fcc-4f2b-8b28-dbc5f9b35b63 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:52.533756 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 836/1684] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:52 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:52.578918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f603836-a41d-4b4d-9623-6e9f94a5ba42 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:52.580812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9f603836-a41d-4b4d-9623-6e9f94a5ba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:52.828468 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f603836-a41d-4b4d-9623-6e9f94a5ba42 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:52.849363 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf7191-dbcc-4849-99fb-ee2d656b988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:52.850051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf7191-dbcc-4849-99fb-ee2d656b988c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:52.850367 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf7191-dbcc-4849-99fb-ee2d656b988c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:52.850652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf7191-dbcc-4849-99fb-ee2d656b988c admin admin] PATH_INFO: `/v3/projects/baaed2b4951f42adb13f9ccc1d08069a` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:52.854987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf7191-dbcc-4849-99fb-ee2d656b988c admin admin] RBAC: Authorizing `identity:delete_project(project_id=baaed2b4951f42adb13f9ccc1d08069a)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:52.857866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf7191-dbcc-4849-99fb-ee2d656b988c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:52.908055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd91625-5fcc-4f2b-8b28-dbc5f9b35b63 service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:52.923745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd91625-5fcc-4f2b-8b28-dbc5f9b35b63 service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:52.931547 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ef6be-3e1a-4c7f-b09f-34e19fa5808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:52.933273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ef6be-3e1a-4c7f-b09f-34e19fa5808a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:52.934608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ef6be-3e1a-4c7f-b09f-34e19fa5808a admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:52.935066 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ef6be-3e1a-4c7f-b09f-34e19fa5808a admin admin] PATH_INFO: `/v3/users/662d83c8418641c5819f9283d6ad138f` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:52.936997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ef6be-3e1a-4c7f-b09f-34e19fa5808a admin admin] RBAC: Authorizing `identity:delete_user(user_id=662d83c8418641c5819f9283d6ad138f)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:52.940738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ef6be-3e1a-4c7f-b09f-34e19fa5808a admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:52.963045 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:52.994699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fcaf7191-dbcc-4849-99fb-ee2d656b988c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baaed2b4951f42adb13f9ccc1d08069a', 'request_id': 'req-fcaf7191-dbcc-4849-99fb-ee2d656b988c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:53.014033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fcaf7191-dbcc-4849-99fb-ee2d656b988c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baaed2b4951f42adb13f9ccc1d08069a', 'request_id': 'req-fcaf7191-dbcc-4849-99fb-ee2d656b988c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:53.032771 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fcaf7191-dbcc-4849-99fb-ee2d656b988c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baaed2b4951f42adb13f9ccc1d08069a', 'request_id': 'req-fcaf7191-dbcc-4849-99fb-ee2d656b988c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:53.076368 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fcaf7191-dbcc-4849-99fb-ee2d656b988c admin admin] The token cache is being invalidate because project baaed2b4951f42adb13f9ccc1d08069a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:49:53.076600 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fcaf7191-dbcc-4849-99fb-ee2d656b988c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:53.078580 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fcaf7191-dbcc-4849-99fb-ee2d656b988c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:53.084376 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 849/1685] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:49:52 2022] DELETE /identity/v3/projects/baaed2b4951f42adb13f9ccc1d08069a => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:49:53.089830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740003d-1b69-400d-8021-72c83ea197b8 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:53.090711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740003d-1b69-400d-8021-72c83ea197b8 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:53.091066 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740003d-1b69-400d-8021-72c83ea197b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:53.109892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-943ef6be-3e1a-4c7f-b09f-34e19fa5808a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662d83c8418641c5819f9283d6ad138f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:53.110988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-943ef6be-3e1a-4c7f-b09f-34e19fa5808a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662d83c8418641c5819f9283d6ad138f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:53.134270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-943ef6be-3e1a-4c7f-b09f-34e19fa5808a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662d83c8418641c5819f9283d6ad138f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:53.138712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-943ef6be-3e1a-4c7f-b09f-34e19fa5808a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662d83c8418641c5819f9283d6ad138f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:53.144413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-2740003d-1b69-400d-8021-72c83ea197b8 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:53.146523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2740003d-1b69-400d-8021-72c83ea197b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:53.148934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:53.160677 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-943ef6be-3e1a-4c7f-b09f-34e19fa5808a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662d83c8418641c5819f9283d6ad138f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:53.219074 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 837/1686] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:49:52 2022] DELETE /identity/v3/users/662d83c8418641c5819f9283d6ad138f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:49:53.220951 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce2564-eccf-4ca1-8c06-3ef60b606c67 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:53.222399 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce2564-eccf-4ca1-8c06-3ef60b606c67 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:53.223023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce2564-eccf-4ca1-8c06-3ef60b606c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:53.275046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-d5ce2564-eccf-4ca1-8c06-3ef60b606c67 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:53.279867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d5ce2564-eccf-4ca1-8c06-3ef60b606c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:53.331065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 850/1687] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:53.342801 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55d1a7-8757-4ec4-93f4-2998936ced65 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:53.343185 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55d1a7-8757-4ec4-93f4-2998936ced65 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:53.343372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55d1a7-8757-4ec4-93f4-2998936ced65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:53.388964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-1f55d1a7-8757-4ec4-93f4-2998936ced65 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:53.396187 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1f55d1a7-8757-4ec4-93f4-2998936ced65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:53.448859 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 838/1688] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:53.517033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce2564-eccf-4ca1-8c06-3ef60b606c67 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:53.518943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d5ce2564-eccf-4ca1-8c06-3ef60b606c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:53.554241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 851/1689] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:53.570975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55d1a7-8757-4ec4-93f4-2998936ced65 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:53.583778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55d1a7-8757-4ec4-93f4-2998936ced65 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:53.601039 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e06db-5dfe-40bd-8c9b-5eb01d725685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:53.601748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e06db-5dfe-40bd-8c9b-5eb01d725685 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:53.602056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e06db-5dfe-40bd-8c9b-5eb01d725685 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:53.602401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e06db-5dfe-40bd-8c9b-5eb01d725685 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:53.603319 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e06db-5dfe-40bd-8c9b-5eb01d725685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:49:53.603630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e06db-5dfe-40bd-8c9b-5eb01d725685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:53.606665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e06db-5dfe-40bd-8c9b-5eb01d725685 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:53.642881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 852/1690] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:49:53.648403 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e06db-5dfe-40bd-8c9b-5eb01d725685 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:53.656235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce2564-eccf-4ca1-8c06-3ef60b606c67 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:53.667561 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e06db-5dfe-40bd-8c9b-5eb01d725685 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:53.678114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841ff86-0571-4af4-9ac0-0f2dc209d2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:53.678925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841ff86-0571-4af4-9ac0-0f2dc209d2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:53.679273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841ff86-0571-4af4-9ac0-0f2dc209d2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:53.679781 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841ff86-0571-4af4-9ac0-0f2dc209d2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:53.686959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b0079-de06-4aee-97f9-dd6d9caafeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:53.687620 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0079-de06-4aee-97f9-dd6d9caafeeb admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:53.688036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0079-de06-4aee-97f9-dd6d9caafeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:53.688327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0079-de06-4aee-97f9-dd6d9caafeeb admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:53.689752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b0079-de06-4aee-97f9-dd6d9caafeeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:53.692120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b0079-de06-4aee-97f9-dd6d9caafeeb admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:53.711570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841ff86-0571-4af4-9ac0-0f2dc209d2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:53.713398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841ff86-0571-4af4-9ac0-0f2dc209d2f0 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:53.745646 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 839/1691] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:53.758998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 853/1692] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:53 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:49:53.765307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841ff86-0571-4af4-9ac0-0f2dc209d2f0 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:53.783539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841ff86-0571-4af4-9ac0-0f2dc209d2f0 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:54.007977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a33e6-6b21-4e10-aec0-9b04dc85607e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:54.010124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a33e6-6b21-4e10-aec0-9b04dc85607e admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:54.010740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a33e6-6b21-4e10-aec0-9b04dc85607e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:54.011222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a33e6-6b21-4e10-aec0-9b04dc85607e admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:54.014579 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a33e6-6b21-4e10-aec0-9b04dc85607e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:54.017412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a33e6-6b21-4e10-aec0-9b04dc85607e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:54.101693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 840/1693] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:53 2022] POST /identity/v3/users => generated 285 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:54.102071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b0079-de06-4aee-97f9-dd6d9caafeeb admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:54.112636 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a33e6-6b21-4e10-aec0-9b04dc85607e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:54.115738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b14a33e6-6b21-4e10-aec0-9b04dc85607e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:54.128184 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b0079-de06-4aee-97f9-dd6d9caafeeb admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:54.145081 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a33e6-6b21-4e10-aec0-9b04dc85607e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:54.158832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756bb93-1422-4666-b1a2-e77a799bd2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:54.160614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756bb93-1422-4666-b1a2-e77a799bd2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:54.163576 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756bb93-1422-4666-b1a2-e77a799bd2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:54.163893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756bb93-1422-4666-b1a2-e77a799bd2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:54.164961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756bb93-1422-4666-b1a2-e77a799bd2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:54.166410 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756bb93-1422-4666-b1a2-e77a799bd2b3 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:54.166884 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e9c28-67d4-4108-acf3-c5bd33eecf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:54.170018 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9c28-67d4-4108-acf3-c5bd33eecf31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:54.174088 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9c28-67d4-4108-acf3-c5bd33eecf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:54.180180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e9c28-67d4-4108-acf3-c5bd33eecf31 admin admin] PATH_INFO: `/v3/projects/d1e54cec73a64b059b32c493d66cf7cf` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:54.184471 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e9c28-67d4-4108-acf3-c5bd33eecf31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e54cec73a64b059b32c493d66cf7cf)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:54.188928 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e9c28-67d4-4108-acf3-c5bd33eecf31 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:54.198103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 854/1694] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:49:54.200582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756bb93-1422-4666-b1a2-e77a799bd2b3 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:54.205414 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:54.233594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756bb93-1422-4666-b1a2-e77a799bd2b3 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:54.249897 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b16c0-a1d3-4e90-9d70-b3d55153049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:54.250596 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b16c0-a1d3-4e90-9d70-b3d55153049c admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:54.250882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b16c0-a1d3-4e90-9d70-b3d55153049c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:54.251218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b16c0-a1d3-4e90-9d70-b3d55153049c admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:54.252338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b16c0-a1d3-4e90-9d70-b3d55153049c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:54.258934 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b16c0-a1d3-4e90-9d70-b3d55153049c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:54.295826 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 855/1695] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:54.297330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b16c0-a1d3-4e90-9d70-b3d55153049c admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:54.317457 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:54.351301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b16c0-a1d3-4e90-9d70-b3d55153049c admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:54.390537 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d76e9c28-67d4-4108-acf3-c5bd33eecf31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e54cec73a64b059b32c493d66cf7cf', 'request_id': 'req-d76e9c28-67d4-4108-acf3-c5bd33eecf31'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:54.401042 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d76e9c28-67d4-4108-acf3-c5bd33eecf31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e54cec73a64b059b32c493d66cf7cf', 'request_id': 'req-d76e9c28-67d4-4108-acf3-c5bd33eecf31'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:54.416306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d76e9c28-67d4-4108-acf3-c5bd33eecf31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e54cec73a64b059b32c493d66cf7cf', 'request_id': 'req-d76e9c28-67d4-4108-acf3-c5bd33eecf31'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:54.446608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d76e9c28-67d4-4108-acf3-c5bd33eecf31 admin admin] The token cache is being invalidate because project d1e54cec73a64b059b32c493d66cf7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:49:54.447194 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d76e9c28-67d4-4108-acf3-c5bd33eecf31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:54.448375 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d76e9c28-67d4-4108-acf3-c5bd33eecf31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:54.454829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 841/1696] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:49:54 2022] DELETE /identity/v3/projects/d1e54cec73a64b059b32c493d66cf7cf => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:54.461065 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b94aa-530c-4de8-9075-4aff1c519eaa None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:54.461363 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b94aa-530c-4de8-9075-4aff1c519eaa None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:54.461645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b94aa-530c-4de8-9075-4aff1c519eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:54.523523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-eb2b94aa-530c-4de8-9075-4aff1c519eaa None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:54.526855 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-eb2b94aa-530c-4de8-9075-4aff1c519eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:54.592457 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cdd66-c6ea-4f04-970e-c0a71f2abd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:54.593827 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cdd66-c6ea-4f04-970e-c0a71f2abd70 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:54.594893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cdd66-c6ea-4f04-970e-c0a71f2abd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:54.596461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cdd66-c6ea-4f04-970e-c0a71f2abd70 admin admin] PATH_INFO: `/v3/projects/e4268e3f72db40d58abb8acba771d872/users/3a4c208e73eb488589fb5aabd27c9b46/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:54.660295 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cdd66-c6ea-4f04-970e-c0a71f2abd70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4268e3f72db40d58abb8acba771d872, user_id=3a4c208e73eb488589fb5aabd27c9b46, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:54.668844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cdd66-c6ea-4f04-970e-c0a71f2abd70 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:54.720618 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 856/1697] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:54 2022] PUT /identity/v3/projects/e4268e3f72db40d58abb8acba771d872/users/3a4c208e73eb488589fb5aabd27c9b46/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:54.736180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576f47-f4ca-4955-ac70-1153bb3e3cb4 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:54.736611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576f47-f4ca-4955-ac70-1153bb3e3cb4 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:54.736905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576f47-f4ca-4955-ac70-1153bb3e3cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:54.795815 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 842/1698] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:54.804105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc7906-b38c-41c0-988a-fd17b8829cdc None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:54.804105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc7906-b38c-41c0-988a-fd17b8829cdc None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:54.804105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc7906-b38c-41c0-988a-fd17b8829cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:54.809897 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-2c576f47-f4ca-4955-ac70-1153bb3e3cb4 None None] MFA Rules not processed for user `3a4c208e73eb488589fb5aabd27c9b46`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:54.811735 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2c576f47-f4ca-4955-ac70-1153bb3e3cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:54.874921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-08dc7906-b38c-41c0-988a-fd17b8829cdc None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:54.878207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-08dc7906-b38c-41c0-988a-fd17b8829cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:55.059557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 857/1699] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:49:55.067268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c576f47-f4ca-4955-ac70-1153bb3e3cb4 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:55.069653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2c576f47-f4ca-4955-ac70-1153bb3e3cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:55.071495 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 843/1700] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:49:55.076447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc7906-b38c-41c0-988a-fd17b8829cdc None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:55.098396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc7906-b38c-41c0-988a-fd17b8829cdc None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:55.114598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c26b1-97db-4f1f-9d28-5b8453bb1ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:55.115257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c26b1-97db-4f1f-9d28-5b8453bb1ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:55.115544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c26b1-97db-4f1f-9d28-5b8453bb1ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:55.115985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c26b1-97db-4f1f-9d28-5b8453bb1ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:55.116708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c26b1-97db-4f1f-9d28-5b8453bb1ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:49:55.117021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c26b1-97db-4f1f-9d28-5b8453bb1ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:55.118736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c26b1-97db-4f1f-9d28-5b8453bb1ee8 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:55.119108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c576f47-f4ca-4955-ac70-1153bb3e3cb4 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:55.127889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053dff3-9ee7-4505-a5fd-637db77cf507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:55.128526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053dff3-9ee7-4505-a5fd-637db77cf507 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:55.128809 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053dff3-9ee7-4505-a5fd-637db77cf507 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:55.129083 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053dff3-9ee7-4505-a5fd-637db77cf507 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:55.129771 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053dff3-9ee7-4505-a5fd-637db77cf507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:55.137461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053dff3-9ee7-4505-a5fd-637db77cf507 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:55.151800 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 844/1701] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:49:55.158608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c26b1-97db-4f1f-9d28-5b8453bb1ee8 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:55.188968 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c26b1-97db-4f1f-9d28-5b8453bb1ee8 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:55.205316 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ee00-55d7-4607-b4b1-61c2a480c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:55.206123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ee00-55d7-4607-b4b1-61c2a480c56e admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:55.206574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ee00-55d7-4607-b4b1-61c2a480c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:55.206880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806ee00-55d7-4607-b4b1-61c2a480c56e admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:55.207683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806ee00-55d7-4607-b4b1-61c2a480c56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:55.212704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806ee00-55d7-4607-b4b1-61c2a480c56e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:55.254548 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 858/1702] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:55 2022] POST /identity/v3/projects => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:55.256296 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053dff3-9ee7-4505-a5fd-637db77cf507 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:55.275538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:55.292435 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 845/1703] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:55 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:55.294069 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ee00-55d7-4607-b4b1-61c2a480c56e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:55.453165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806ee00-55d7-4607-b4b1-61c2a480c56e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:55.461849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad07d39-b4e4-4be3-8f25-9ed812d15298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:55.462480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07d39-b4e4-4be3-8f25-9ed812d15298 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:55.462770 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07d39-b4e4-4be3-8f25-9ed812d15298 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:55.463052 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07d39-b4e4-4be3-8f25-9ed812d15298 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:55.463932 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad07d39-b4e4-4be3-8f25-9ed812d15298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:55.466103 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad07d39-b4e4-4be3-8f25-9ed812d15298 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:55.472815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:55.504977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053dff3-9ee7-4505-a5fd-637db77cf507 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:55.517519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cec7fd-2077-4b9c-816c-c10f2255e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:55.518993 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cec7fd-2077-4b9c-816c-c10f2255e799 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:55.519718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cec7fd-2077-4b9c-816c-c10f2255e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:55.520725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cec7fd-2077-4b9c-816c-c10f2255e799 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:55.523248 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cec7fd-2077-4b9c-816c-c10f2255e799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:55.529534 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 846/1704] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:55 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:55.531849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad07d39-b4e4-4be3-8f25-9ed812d15298 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:55.534103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cec7fd-2077-4b9c-816c-c10f2255e799 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:55.564331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad07d39-b4e4-4be3-8f25-9ed812d15298 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:55.585888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 859/1705] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:55 2022] POST /identity/v3/users => generated 290 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:49:55.586990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e390a49-5649-4e32-9e81-fefcff57b71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:55.587709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e390a49-5649-4e32-9e81-fefcff57b71c admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:55.588652 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e390a49-5649-4e32-9e81-fefcff57b71c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:55.588652 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e390a49-5649-4e32-9e81-fefcff57b71c admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:55.589127 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e390a49-5649-4e32-9e81-fefcff57b71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:55.589753 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cec7fd-2077-4b9c-816c-c10f2255e799 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:55.591098 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e390a49-5649-4e32-9e81-fefcff57b71c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:55.610432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 847/1706] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:55.615943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e390a49-5649-4e32-9e81-fefcff57b71c admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:55.618541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cec7fd-2077-4b9c-816c-c10f2255e799 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:55.634050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcc276-0cbe-453f-b459-0c26007ba925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:55.635199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcc276-0cbe-453f-b459-0c26007ba925 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:55.635666 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcc276-0cbe-453f-b459-0c26007ba925 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:55.636296 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcc276-0cbe-453f-b459-0c26007ba925 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:55.639292 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcc276-0cbe-453f-b459-0c26007ba925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:55.643737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcc276-0cbe-453f-b459-0c26007ba925 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:55.658852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e390a49-5649-4e32-9e81-fefcff57b71c admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:55.676738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d60e4-816a-471d-8e95-c69820e4946d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:55.677773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 860/1707] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:55.678622 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d60e4-816a-471d-8e95-c69820e4946d admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:55.680008 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d60e4-816a-471d-8e95-c69820e4946d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:55.680450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d60e4-816a-471d-8e95-c69820e4946d admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:55.681586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d60e4-816a-471d-8e95-c69820e4946d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:55.683174 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcc276-0cbe-453f-b459-0c26007ba925 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:55.694176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d60e4-816a-471d-8e95-c69820e4946d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:55.716888 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 848/1708] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:49:55.720515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d60e4-816a-471d-8e95-c69820e4946d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:55.722938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcc276-0cbe-453f-b459-0c26007ba925 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:55.732299 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62f856-f181-4c74-9002-0e279c9b2d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:55.733010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62f856-f181-4c74-9002-0e279c9b2d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:55.733293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62f856-f181-4c74-9002-0e279c9b2d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:55.733574 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62f856-f181-4c74-9002-0e279c9b2d62 admin admin] PATH_INFO: `/v3/projects/bc26fa9b7093412dbfbdfbf83d874e4a/users/7ec368de5e4444f1b6f4958a29016ef8/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:55.737599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d60e4-816a-471d-8e95-c69820e4946d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:55.750245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aeab13-b9b8-4837-98e9-86f56a1d5e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:55.751632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeab13-b9b8-4837-98e9-86f56a1d5e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:55.754173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeab13-b9b8-4837-98e9-86f56a1d5e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:55.754741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeab13-b9b8-4837-98e9-86f56a1d5e10 admin admin] PATH_INFO: `/v3/projects/d4eb4d9359334e459a9393097b16e742/users/9e83ec23bc7c4bf388a57d877ccbdbea/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:55.757129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62f856-f181-4c74-9002-0e279c9b2d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc26fa9b7093412dbfbdfbf83d874e4a, user_id=7ec368de5e4444f1b6f4958a29016ef8, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:55.760720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62f856-f181-4c74-9002-0e279c9b2d62 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:55.790607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aeab13-b9b8-4837-98e9-86f56a1d5e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4eb4d9359334e459a9393097b16e742, user_id=9e83ec23bc7c4bf388a57d877ccbdbea, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:55.793590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aeab13-b9b8-4837-98e9-86f56a1d5e10 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:55.794295 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 861/1709] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:55 2022] PUT /identity/v3/projects/bc26fa9b7093412dbfbdfbf83d874e4a/users/7ec368de5e4444f1b6f4958a29016ef8/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:55.798505 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62f856-f181-4c74-9002-0e279c9b2d62 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:55.865385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 849/1710] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:55 2022] PUT /identity/v3/projects/d4eb4d9359334e459a9393097b16e742/users/9e83ec23bc7c4bf388a57d877ccbdbea/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:55.871313 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88feb4-3aaa-4439-8824-c5d5593a741c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:55.871720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88feb4-3aaa-4439-8824-c5d5593a741c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:55.872069 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88feb4-3aaa-4439-8824-c5d5593a741c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:55.968410 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-6d88feb4-3aaa-4439-8824-c5d5593a741c None None] MFA Rules not processed for user `9e83ec23bc7c4bf388a57d877ccbdbea`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:55.970097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6d88feb4-3aaa-4439-8824-c5d5593a741c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:56.020664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62f856-f181-4c74-9002-0e279c9b2d62 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:56.221854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625b71-b628-40bc-bdbc-d9f2bfdd26a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:56.222557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625b71-b628-40bc-bdbc-d9f2bfdd26a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:56.222821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625b71-b628-40bc-bdbc-d9f2bfdd26a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:56.223105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625b71-b628-40bc-bdbc-d9f2bfdd26a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:56.223823 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96625b71-b628-40bc-bdbc-d9f2bfdd26a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:56.225487 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96625b71-b628-40bc-bdbc-d9f2bfdd26a4 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:56.256779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 862/1711] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:49:56.256964 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 850/1712] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:56.259590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625b71-b628-40bc-bdbc-d9f2bfdd26a4 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:56.259918 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88feb4-3aaa-4439-8824-c5d5593a741c None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:56.286007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625b71-b628-40bc-bdbc-d9f2bfdd26a4 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:56.299083 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0ebc5-ae2f-43ae-9a20-7511eac02472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:56.300760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0ebc5-ae2f-43ae-9a20-7511eac02472 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:56.301581 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0ebc5-ae2f-43ae-9a20-7511eac02472 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:56.302741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0ebc5-ae2f-43ae-9a20-7511eac02472 admin admin] PATH_INFO: `/v3/projects/bc26fa9b7093412dbfbdfbf83d874e4a/users/7ec368de5e4444f1b6f4958a29016ef8/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:56.304182 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88feb4-3aaa-4439-8824-c5d5593a741c None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:56.310471 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0ebc5-ae2f-43ae-9a20-7511eac02472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc26fa9b7093412dbfbdfbf83d874e4a, user_id=7ec368de5e4444f1b6f4958a29016ef8, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:56.319767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0ebc5-ae2f-43ae-9a20-7511eac02472 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:56.324907 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15646323-d7b3-4f7b-a6ca-b38e5ddbc79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:56.325720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15646323-d7b3-4f7b-a6ca-b38e5ddbc79c admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:56.326107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15646323-d7b3-4f7b-a6ca-b38e5ddbc79c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:56.334065 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15646323-d7b3-4f7b-a6ca-b38e5ddbc79c admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:56.335104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15646323-d7b3-4f7b-a6ca-b38e5ddbc79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:56.350793 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15646323-d7b3-4f7b-a6ca-b38e5ddbc79c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:56.354394 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 863/1713] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:56 2022] PUT /identity/v3/projects/bc26fa9b7093412dbfbdfbf83d874e4a/users/7ec368de5e4444f1b6f4958a29016ef8/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:56.365643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2c8f9-ce5d-40ec-ba45-348bea0162d8 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:56.366272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2c8f9-ce5d-40ec-ba45-348bea0162d8 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:56.367305 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2c8f9-ce5d-40ec-ba45-348bea0162d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:56.430759 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-c2b2c8f9-ce5d-40ec-ba45-348bea0162d8 None None] MFA Rules not processed for user `7ec368de5e4444f1b6f4958a29016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:56.432835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c2b2c8f9-ce5d-40ec-ba45-348bea0162d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:56.448778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 851/1714] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:56 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:56.451299 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15646323-d7b3-4f7b-a6ca-b38e5ddbc79c admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:56.500770 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:56.506743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:56.630713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 864/1715] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:49:56.633445 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b5a4d-2f55-4e9e-84c4-0dd630d57cab None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:56.633738 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b5a4d-2f55-4e9e-84c4-0dd630d57cab None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:56.634269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b5a4d-2f55-4e9e-84c4-0dd630d57cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:56.677318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15646323-d7b3-4f7b-a6ca-b38e5ddbc79c admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:56.699741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d621080-0628-4588-aaa6-7e639443d744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:56.700778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d621080-0628-4588-aaa6-7e639443d744 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:56.701195 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d621080-0628-4588-aaa6-7e639443d744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:56.701914 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d621080-0628-4588-aaa6-7e639443d744 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:56.702859 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d621080-0628-4588-aaa6-7e639443d744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:56.704449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-868b5a4d-2f55-4e9e-84c4-0dd630d57cab None None] MFA Rules not processed for user `71fcdfd05fb146e88f43fb29c4b0232c`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:56.706750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-868b5a4d-2f55-4e9e-84c4-0dd630d57cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:56.711604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d621080-0628-4588-aaa6-7e639443d744 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:56.787278 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 852/1716] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:56 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:56.791925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a47cf-4ebd-4aed-8988-7648bb92ff9f None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:56.792291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a47cf-4ebd-4aed-8988-7648bb92ff9f None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:56.792668 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a47cf-4ebd-4aed-8988-7648bb92ff9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:56.851425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-970a47cf-4ebd-4aed-8988-7648bb92ff9f None None] MFA Rules not processed for user `9c6c44ca3dc44632b7d064d19a9cf1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:56.855115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-970a47cf-4ebd-4aed-8988-7648bb92ff9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:56.948356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 865/1717] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:56.968680 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b5a4d-2f55-4e9e-84c4-0dd630d57cab None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:56.971486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-868b5a4d-2f55-4e9e-84c4-0dd630d57cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:57.017286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 853/1718] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:57.019587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a47cf-4ebd-4aed-8988-7648bb92ff9f None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:57.085211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a47cf-4ebd-4aed-8988-7648bb92ff9f None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:57.113944 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23489b-805a-4274-89f9-bfc0da07e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:57.115286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23489b-805a-4274-89f9-bfc0da07e24d admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:57.125026 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23489b-805a-4274-89f9-bfc0da07e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:57.125703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23489b-805a-4274-89f9-bfc0da07e24d admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:57.129776 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23489b-805a-4274-89f9-bfc0da07e24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:57.136196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23489b-805a-4274-89f9-bfc0da07e24d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:57.204176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 854/1719] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:57.206601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23489b-805a-4274-89f9-bfc0da07e24d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:57.218103 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3c23489b-805a-4274-89f9-bfc0da07e24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:57.290388 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b5a4d-2f55-4e9e-84c4-0dd630d57cab None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:57.315944 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23489b-805a-4274-89f9-bfc0da07e24d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:57.317554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c744edd-3719-4151-a42c-7106ec005e4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:57.319508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c744edd-3719-4151-a42c-7106ec005e4d service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:57.319983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c744edd-3719-4151-a42c-7106ec005e4d service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:57.320448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c744edd-3719-4151-a42c-7106ec005e4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:57.348569 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:57.349929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:57.350639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:57.352114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] PATH_INFO: `/v3/projects/9518f8f3b9b34c9abc51abfdd008adc0` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:57.362416 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9518f8f3b9b34c9abc51abfdd008adc0)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:57.370474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:57.559389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c744edd-3719-4151-a42c-7106ec005e4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:57.561644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c744edd-3719-4151-a42c-7106ec005e4d service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:57.592817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 866/1720] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:57.593968 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9518f8f3b9b34c9abc51abfdd008adc0', 'request_id': 'req-42190cc0-ee0f-40b6-a90f-3ad2e459a996'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:57.598132 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c6a13-1373-49aa-9cc6-b68410f42fea None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:57.604569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c6a13-1373-49aa-9cc6-b68410f42fea None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:57.605578 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c6a13-1373-49aa-9cc6-b68410f42fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:57.621211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9518f8f3b9b34c9abc51abfdd008adc0', 'request_id': 'req-42190cc0-ee0f-40b6-a90f-3ad2e459a996'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:57.628645 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:57.648098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-020c6a13-1373-49aa-9cc6-b68410f42fea None None] MFA Rules not processed for user `71fcdfd05fb146e88f43fb29c4b0232c`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:57.649739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-020c6a13-1373-49aa-9cc6-b68410f42fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:57.659631 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9518f8f3b9b34c9abc51abfdd008adc0', 'request_id': 'req-42190cc0-ee0f-40b6-a90f-3ad2e459a996'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:57.686821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] The token cache is being invalidate because project 9518f8f3b9b34c9abc51abfdd008adc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:49:57.687141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:57.690668 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:57.693658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 855/1721] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:49:57 2022] DELETE /identity/v3/projects/9518f8f3b9b34c9abc51abfdd008adc0 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:57.697532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:57.711212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:57.770232 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 867/1722] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:57.771670 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c6a13-1373-49aa-9cc6-b68410f42fea None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:57.773624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-020c6a13-1373-49aa-9cc6-b68410f42fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:57.783032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:57.958333 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42190cc0-ee0f-40b6-a90f-3ad2e459a996 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:57.987801 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2e1ba-a807-440b-a2c4-9e46b0134793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:57.988454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2e1ba-a807-440b-a2c4-9e46b0134793 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:57.988744 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2e1ba-a807-440b-a2c4-9e46b0134793 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:57.989023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2e1ba-a807-440b-a2c4-9e46b0134793 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:57.989753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2e1ba-a807-440b-a2c4-9e46b0134793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:57.991481 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2e1ba-a807-440b-a2c4-9e46b0134793 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:58.022155 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 856/1723] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:58.026993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2e1ba-a807-440b-a2c4-9e46b0134793 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:58.029310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c6a13-1373-49aa-9cc6-b68410f42fea None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:58.035452 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-7ac2e1ba-a807-440b-a2c4-9e46b0134793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:58.066423 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:58.067664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:58.071193 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:58.071685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] PATH_INFO: `/v3/users/4572ef61b6594de9ab27fcdad5d15b77` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:58.084575 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4572ef61b6594de9ab27fcdad5d15b77)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:58.093936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: WARNING py.warnings [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 10:49:58.093936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: warnings.warn(msg) Jul 27 10:49:58.093936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: Jul 27 10:49:58.099697 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:58.273517 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2e1ba-a807-440b-a2c4-9e46b0134793 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:58.317221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22996b32-2dfd-4e8c-a00b-d4b24ffb1a0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:58.320194 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22996b32-2dfd-4e8c-a00b-d4b24ffb1a0a service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:58.320653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22996b32-2dfd-4e8c-a00b-d4b24ffb1a0a service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:58.321111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22996b32-2dfd-4e8c-a00b-d4b24ffb1a0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:58.340832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-22996b32-2dfd-4e8c-a00b-d4b24ffb1a0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:58.370752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22996b32-2dfd-4e8c-a00b-d4b24ffb1a0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:58.373891 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22996b32-2dfd-4e8c-a00b-d4b24ffb1a0a service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:58.392861 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 857/1724] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:49:58.393890 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22996b32-2dfd-4e8c-a00b-d4b24ffb1a0a service nova] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:58.408771 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4572ef61b6594de9ab27fcdad5d15b77'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:58.410154 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22996b32-2dfd-4e8c-a00b-d4b24ffb1a0a service nova] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:58.410668 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4572ef61b6594de9ab27fcdad5d15b77'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:58.416310 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a780ed-f98a-46cd-a164-0cb20e17f522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:58.417188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a780ed-f98a-46cd-a164-0cb20e17f522 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:58.417607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a780ed-f98a-46cd-a164-0cb20e17f522 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:58.418097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a780ed-f98a-46cd-a164-0cb20e17f522 admin admin] PATH_INFO: `/v3/projects/eefe6fbc57b64971aab1faf6c5d68c56/users/c06f6bee92f841d893c99c6dac0078fa/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:58.439452 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4572ef61b6594de9ab27fcdad5d15b77'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:58.457404 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a780ed-f98a-46cd-a164-0cb20e17f522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eefe6fbc57b64971aab1faf6c5d68c56, user_id=c06f6bee92f841d893c99c6dac0078fa, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:58.462479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a780ed-f98a-46cd-a164-0cb20e17f522 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:58.482906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4572ef61b6594de9ab27fcdad5d15b77'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:58.489373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4572ef61b6594de9ab27fcdad5d15b77'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:49:58.493676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 858/1725] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:58 2022] PUT /identity/v3/projects/eefe6fbc57b64971aab1faf6c5d68c56/users/c06f6bee92f841d893c99c6dac0078fa/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:58.505018 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84142d68-b39a-4524-83cb-5a976f60e266 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:58.505554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84142d68-b39a-4524-83cb-5a976f60e266 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:58.506178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84142d68-b39a-4524-83cb-5a976f60e266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:58.611269 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-84142d68-b39a-4524-83cb-5a976f60e266 None None] MFA Rules not processed for user `c06f6bee92f841d893c99c6dac0078fa`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:58.616712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 868/1726] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:49:57 2022] DELETE /identity/v3/users/4572ef61b6594de9ab27fcdad5d15b77 => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:58.618875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-84142d68-b39a-4524-83cb-5a976f60e266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:58.785328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 859/1727] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:49:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:58.787100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:58.789167 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:58.833248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801f04d-a12a-4785-a20f-e86d33200b40 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:58.833872 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801f04d-a12a-4785-a20f-e86d33200b40 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:58.834425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801f04d-a12a-4785-a20f-e86d33200b40 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:58.836915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 860/1728] 10.222.0.43 () {54 vars in 912 bytes} [Wed Jul 27 10:49:58 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:49:58.847395 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfaf0a-916e-4794-8ca1-c0d1ebc72491 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:58.847872 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfaf0a-916e-4794-8ca1-c0d1ebc72491 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:58.848325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfaf0a-916e-4794-8ca1-c0d1ebc72491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:58.858646 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:58.910204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:49:58.981181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-05bfaf0a-916e-4794-8ca1-c0d1ebc72491 None None] MFA Rules not processed for user `6b33631df63d4657a8e2ad108ca9f670`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:49:58.984270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-05bfaf0a-916e-4794-8ca1-c0d1ebc72491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:59.041284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881ebe4-44dc-43ab-aca6-00a4da750c49 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:59.053321 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb973d0-3f6b-44dd-920e-eece9d0ab182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:59.054091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb973d0-3f6b-44dd-920e-eece9d0ab182 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:59.054536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb973d0-3f6b-44dd-920e-eece9d0ab182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:59.054824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb973d0-3f6b-44dd-920e-eece9d0ab182 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:59.057028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb973d0-3f6b-44dd-920e-eece9d0ab182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:59.059947 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb973d0-3f6b-44dd-920e-eece9d0ab182 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:59.130744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 869/1729] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:49:58 2022] POST /identity/v3/projects => generated 387 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:49:59.136728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb973d0-3f6b-44dd-920e-eece9d0ab182 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:59.166073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 861/1730] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 10:49:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:49:59.283343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb973d0-3f6b-44dd-920e-eece9d0ab182 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:59.293638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42850d63-ff20-4bb6-a715-b442b94b83f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:59.304496 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42850d63-ff20-4bb6-a715-b442b94b83f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:59.305992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42850d63-ff20-4bb6-a715-b442b94b83f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:59.307158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42850d63-ff20-4bb6-a715-b442b94b83f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:59.309475 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42850d63-ff20-4bb6-a715-b442b94b83f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:59.315378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42850d63-ff20-4bb6-a715-b442b94b83f2 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:59.368219 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 870/1731] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:49:59 2022] POST /identity/v3/users => generated 300 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:49:59.373454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfaf0a-916e-4794-8ca1-c0d1ebc72491 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:59.392524 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfaf0a-916e-4794-8ca1-c0d1ebc72491 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:59.411549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27951c59-8898-4fed-a6c8-e17056c771b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:59.414971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27951c59-8898-4fed-a6c8-e17056c771b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:59.415429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27951c59-8898-4fed-a6c8-e17056c771b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:59.416662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27951c59-8898-4fed-a6c8-e17056c771b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:59.417592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27951c59-8898-4fed-a6c8-e17056c771b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:59.422288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27951c59-8898-4fed-a6c8-e17056c771b9 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:59.450047 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 862/1732] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:49:59.455843 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42850d63-ff20-4bb6-a715-b442b94b83f2 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:59.468687 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42850d63-ff20-4bb6-a715-b442b94b83f2 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:59.476099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b0136-57ae-43e5-a951-377f814931d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:59.477030 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b0136-57ae-43e5-a951-377f814931d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:59.477508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b0136-57ae-43e5-a951-377f814931d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:59.477917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b0136-57ae-43e5-a951-377f814931d7 admin admin] PATH_INFO: `/v3/projects/725209dd77784e0f8e106eb41a187da1/users/48317468eb2e40b0a9630db979e06bb9/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:59.500597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b0136-57ae-43e5-a951-377f814931d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=725209dd77784e0f8e106eb41a187da1, user_id=48317468eb2e40b0a9630db979e06bb9, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:59.503831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b0136-57ae-43e5-a951-377f814931d7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:59.563366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 871/1733] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:59 2022] PUT /identity/v3/projects/725209dd77784e0f8e106eb41a187da1/users/48317468eb2e40b0a9630db979e06bb9/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:49:59.568330 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27951c59-8898-4fed-a6c8-e17056c771b9 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:59.606792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27951c59-8898-4fed-a6c8-e17056c771b9 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:59.637698 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b0136-57ae-43e5-a951-377f814931d7 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:59.639820 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ba4b0136-57ae-43e5-a951-377f814931d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:49:59.823366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b0136-57ae-43e5-a951-377f814931d7 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:49:59.836535 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a87d02-36fd-4f8b-b33c-6de3ef6dbcd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:59.837234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a87d02-36fd-4f8b-b33c-6de3ef6dbcd2 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:59.838658 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a87d02-36fd-4f8b-b33c-6de3ef6dbcd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:59.838953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a87d02-36fd-4f8b-b33c-6de3ef6dbcd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:59.869645 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a87d02-36fd-4f8b-b33c-6de3ef6dbcd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:59.876508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a87d02-36fd-4f8b-b33c-6de3ef6dbcd2 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:59.886938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b773e40-ab20-4145-a6a5-a72a4199e006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:49:59.887727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b773e40-ab20-4145-a6a5-a72a4199e006 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:59.897136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 872/1734] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:49:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:49:59.915072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b773e40-ab20-4145-a6a5-a72a4199e006 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:59.915398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b773e40-ab20-4145-a6a5-a72a4199e006 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:59.916726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b773e40-ab20-4145-a6a5-a72a4199e006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:49:59.919488 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4f71d-bdd1-4572-bf60-e1e119f18bf4 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:59.919488 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4f71d-bdd1-4572-bf60-e1e119f18bf4 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:59.919912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b773e40-ab20-4145-a6a5-a72a4199e006 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:49:59.920833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4f71d-bdd1-4572-bf60-e1e119f18bf4 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:59.926698 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 873/1735] 10.222.0.43 () {54 vars in 912 bytes} [Wed Jul 27 10:49:59 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:49:59.937128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef27e71-5fc0-43e9-9250-80645d5e9049 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:49:59.937421 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef27e71-5fc0-43e9-9250-80645d5e9049 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:49:59.937701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef27e71-5fc0-43e9-9250-80645d5e9049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:49:59.938477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 863/1736] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:49:59.943420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b773e40-ab20-4145-a6a5-a72a4199e006 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:49:59.976208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b773e40-ab20-4145-a6a5-a72a4199e006 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:00.011345 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294d82e-1787-4463-99c7-53bcf5dd2f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:00.024957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294d82e-1787-4463-99c7-53bcf5dd2f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:00.025178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294d82e-1787-4463-99c7-53bcf5dd2f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:00.025404 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294d82e-1787-4463-99c7-53bcf5dd2f02 admin admin] PATH_INFO: `/v3/projects/725209dd77784e0f8e106eb41a187da1/users/48317468eb2e40b0a9630db979e06bb9/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:00.029081 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294d82e-1787-4463-99c7-53bcf5dd2f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=725209dd77784e0f8e106eb41a187da1, user_id=48317468eb2e40b0a9630db979e06bb9, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:00.035287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0294d82e-1787-4463-99c7-53bcf5dd2f02 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:00.055309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-0ef27e71-5fc0-43e9-9250-80645d5e9049 None None] MFA Rules not processed for user `6b33631df63d4657a8e2ad108ca9f670`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:00.056946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0ef27e71-5fc0-43e9-9250-80645d5e9049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:00.077628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 874/1737] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 10:49:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:00.116570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef27e71-5fc0-43e9-9250-80645d5e9049 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:00.127116 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 864/1738] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:49:59 2022] PUT /identity/v3/projects/725209dd77784e0f8e106eb41a187da1/users/48317468eb2e40b0a9630db979e06bb9/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:00.140650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef27e71-5fc0-43e9-9250-80645d5e9049 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:00.140910 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb4afc-5e32-478c-9ed1-ece78e32bc81 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:00.141376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb4afc-5e32-478c-9ed1-ece78e32bc81 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:00.141965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb4afc-5e32-478c-9ed1-ece78e32bc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:00.153480 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:00.255543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-0efb4afc-5e32-478c-9ed1-ece78e32bc81 None None] MFA Rules not processed for user `48317468eb2e40b0a9630db979e06bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:00.256724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0efb4afc-5e32-478c-9ed1-ece78e32bc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:00.276599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff70d4-18e7-4e86-b43e-a04045da03ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:00.277913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff70d4-18e7-4e86-b43e-a04045da03ad service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:00.278550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff70d4-18e7-4e86-b43e-a04045da03ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:00.279108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff70d4-18e7-4e86-b43e-a04045da03ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:00.304843 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff70d4-18e7-4e86-b43e-a04045da03ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:00.313342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff70d4-18e7-4e86-b43e-a04045da03ad service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:00.340145 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 875/1739] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:00.460168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:00.488194 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 865/1740] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:00.494822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff70d4-18e7-4e86-b43e-a04045da03ad service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:00.497678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f0ff70d4-18e7-4e86-b43e-a04045da03ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:00.503061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb4afc-5e32-478c-9ed1-ece78e32bc81 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:00.507140 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0efb4afc-5e32-478c-9ed1-ece78e32bc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:00.700352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb4afc-5e32-478c-9ed1-ece78e32bc81 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:00.705086 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f323d0-0d05-4796-bdad-87d7eef88fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:00.706120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f323d0-0d05-4796-bdad-87d7eef88fbc service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:00.706486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f323d0-0d05-4796-bdad-87d7eef88fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:00.706860 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f323d0-0d05-4796-bdad-87d7eef88fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:00.736211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f323d0-0d05-4796-bdad-87d7eef88fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:00.737889 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f323d0-0d05-4796-bdad-87d7eef88fbc service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:00.739468 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff70d4-18e7-4e86-b43e-a04045da03ad service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:00.751518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de2721-39d9-4822-9ca6-05273bbf5e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:00.753127 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de2721-39d9-4822-9ca6-05273bbf5e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:00.754739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de2721-39d9-4822-9ca6-05273bbf5e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:00.755707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de2721-39d9-4822-9ca6-05273bbf5e8e admin admin] PATH_INFO: `/v3/projects/89c6abdeaa904941b06180753c522c93` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:00.760022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de2721-39d9-4822-9ca6-05273bbf5e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c6abdeaa904941b06180753c522c93)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:00.764065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de2721-39d9-4822-9ca6-05273bbf5e8e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:00.766210 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 866/1741] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:00.994263 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-40de2721-39d9-4822-9ca6-05273bbf5e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c6abdeaa904941b06180753c522c93', 'request_id': 'req-40de2721-39d9-4822-9ca6-05273bbf5e8e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:01.025634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-40de2721-39d9-4822-9ca6-05273bbf5e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c6abdeaa904941b06180753c522c93', 'request_id': 'req-40de2721-39d9-4822-9ca6-05273bbf5e8e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:01.059370 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-40de2721-39d9-4822-9ca6-05273bbf5e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c6abdeaa904941b06180753c522c93', 'request_id': 'req-40de2721-39d9-4822-9ca6-05273bbf5e8e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:01.138755 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-40de2721-39d9-4822-9ca6-05273bbf5e8e admin admin] The token cache is being invalidate because project 89c6abdeaa904941b06180753c522c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:01.141245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-40de2721-39d9-4822-9ca6-05273bbf5e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:01.145100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-40de2721-39d9-4822-9ca6-05273bbf5e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:01.156090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 876/1742] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:00 2022] DELETE /identity/v3/projects/89c6abdeaa904941b06180753c522c93 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:01.162442 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc31c-00a4-407a-b0d8-1dd7e8b39f57 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:01.162967 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc31c-00a4-407a-b0d8-1dd7e8b39f57 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:01.163428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc31c-00a4-407a-b0d8-1dd7e8b39f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:01.224562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-ce3cc31c-00a4-407a-b0d8-1dd7e8b39f57 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:01.224818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ce3cc31c-00a4-407a-b0d8-1dd7e8b39f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:01.375996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2070ea2-b1ff-445d-86ee-813a5f27a154 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:01.376346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2070ea2-b1ff-445d-86ee-813a5f27a154 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:01.376596 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2070ea2-b1ff-445d-86ee-813a5f27a154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:01.387050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 867/1743] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:01.438495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-c2070ea2-b1ff-445d-86ee-813a5f27a154 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:01.440432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c2070ea2-b1ff-445d-86ee-813a5f27a154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:01.487898 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 877/1744] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:01.494948 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cc31c-00a4-407a-b0d8-1dd7e8b39f57 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:01.522789 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cc31c-00a4-407a-b0d8-1dd7e8b39f57 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:01.556885 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055e0f8-a934-4d6b-9781-1230b2a759c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:01.557600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055e0f8-a934-4d6b-9781-1230b2a759c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:01.558048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055e0f8-a934-4d6b-9781-1230b2a759c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:01.558923 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055e0f8-a934-4d6b-9781-1230b2a759c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:01.559852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055e0f8-a934-4d6b-9781-1230b2a759c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:01.560183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055e0f8-a934-4d6b-9781-1230b2a759c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:01.572377 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055e0f8-a934-4d6b-9781-1230b2a759c3 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:01.669488 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2070ea2-b1ff-445d-86ee-813a5f27a154 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:01.684234 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 868/1745] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:01.685908 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2070ea2-b1ff-445d-86ee-813a5f27a154 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:01.698864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f5fdb-4c86-4c93-b693-70001cd7be77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:01.699783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f5fdb-4c86-4c93-b693-70001cd7be77 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:01.700065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f5fdb-4c86-4c93-b693-70001cd7be77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:01.700332 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f5fdb-4c86-4c93-b693-70001cd7be77 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:01.701031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f5fdb-4c86-4c93-b693-70001cd7be77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:01.704691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f5fdb-4c86-4c93-b693-70001cd7be77 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:01.740050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0ed77-346f-436c-83e7-ac484c6a5ab8 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:01.740050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0ed77-346f-436c-83e7-ac484c6a5ab8 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:01.740050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0ed77-346f-436c-83e7-ac484c6a5ab8 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:01.740050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 869/1746] 10.222.0.43 () {54 vars in 961 bytes} [Wed Jul 27 10:50:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:50:01.754322 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf7bf3-9d0b-46ff-85cc-d1a0f1b53612 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:01.754902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf7bf3-9d0b-46ff-85cc-d1a0f1b53612 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:01.755584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf7bf3-9d0b-46ff-85cc-d1a0f1b53612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:01.824704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-3baf7bf3-9d0b-46ff-85cc-d1a0f1b53612 None None] MFA Rules not processed for user `39830a354dee41b5b210d80807886299`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:01.844269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 878/1747] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:01 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:01.845258 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f5fdb-4c86-4c93-b693-70001cd7be77 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:01.848146 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3baf7bf3-9d0b-46ff-85cc-d1a0f1b53612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:01.967236 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:02.191794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f5fdb-4c86-4c93-b693-70001cd7be77 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:02.209216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbb462-590e-4c9d-9bfc-7cab80aa9f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:02.210227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbb462-590e-4c9d-9bfc-7cab80aa9f37 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:02.210735 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbb462-590e-4c9d-9bfc-7cab80aa9f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:02.211276 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbb462-590e-4c9d-9bfc-7cab80aa9f37 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:02.212389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbb462-590e-4c9d-9bfc-7cab80aa9f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:02.218125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 870/1748] 10.222.0.43 () {58 vars in 1058 bytes} [Wed Jul 27 10:50:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:02.219994 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc5085-fa71-4960-a370-08ae068e788c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:02.220178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc5085-fa71-4960-a370-08ae068e788c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:02.220720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc5085-fa71-4960-a370-08ae068e788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:02.228797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbb462-590e-4c9d-9bfc-7cab80aa9f37 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:02.279776 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-5ffc5085-fa71-4960-a370-08ae068e788c None None] MFA Rules not processed for user `71fcdfd05fb146e88f43fb29c4b0232c`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:02.281386 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5ffc5085-fa71-4960-a370-08ae068e788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:02.286140 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 879/1749] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:01 2022] POST /identity/v3/users => generated 283 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:02.287094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbb462-590e-4c9d-9bfc-7cab80aa9f37 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:02.289302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-32dbb462-590e-4c9d-9bfc-7cab80aa9f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:02.339283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbb462-590e-4c9d-9bfc-7cab80aa9f37 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:02.343085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:02.353149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a3e4c-b8f7-4ef4-a7e3-8be922cc0f52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:02.354459 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a3e4c-b8f7-4ef4-a7e3-8be922cc0f52 service placement] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:02.354799 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a3e4c-b8f7-4ef4-a7e3-8be922cc0f52 service placement] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:02.355078 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a3e4c-b8f7-4ef4-a7e3-8be922cc0f52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:02.363771 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-361a3e4c-b8f7-4ef4-a7e3-8be922cc0f52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:02.415134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a3e4c-b8f7-4ef4-a7e3-8be922cc0f52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:02.416811 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a3e4c-b8f7-4ef4-a7e3-8be922cc0f52 service placement] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:02.457546 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 880/1750] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:02.458493 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a3e4c-b8f7-4ef4-a7e3-8be922cc0f52 service placement] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:02.465417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 871/1751] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:02.465417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc5085-fa71-4960-a370-08ae068e788c None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:02.488876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc5085-fa71-4960-a370-08ae068e788c None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:02.505907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a3e4c-b8f7-4ef4-a7e3-8be922cc0f52 service placement] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:02.526751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120d109-3f46-4d29-90f4-366f52c6097c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:02.528012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120d109-3f46-4d29-90f4-366f52c6097c admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:02.528414 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120d109-3f46-4d29-90f4-366f52c6097c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:02.528706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120d109-3f46-4d29-90f4-366f52c6097c admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:02.529568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120d109-3f46-4d29-90f4-366f52c6097c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:02.531329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120d109-3f46-4d29-90f4-366f52c6097c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:02.543740 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6da46-52c3-4904-85f1-01f223852f17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:02.544405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6da46-52c3-4904-85f1-01f223852f17 service placement] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:02.544716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6da46-52c3-4904-85f1-01f223852f17 service placement] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:02.544993 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6da46-52c3-4904-85f1-01f223852f17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:02.611589 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6da46-52c3-4904-85f1-01f223852f17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:02.613332 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda6da46-52c3-4904-85f1-01f223852f17 service placement] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:02.627506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 872/1752] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:02.629185 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120d109-3f46-4d29-90f4-366f52c6097c admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:02.663854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 881/1753] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:02.679819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120d109-3f46-4d29-90f4-366f52c6097c admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:02.702733 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b700a6f-fb75-45ac-9faa-b35b55a2907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:02.703137 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b700a6f-fb75-45ac-9faa-b35b55a2907f admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:02.703453 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b700a6f-fb75-45ac-9faa-b35b55a2907f admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:02.703702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b700a6f-fb75-45ac-9faa-b35b55a2907f admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:02.704429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b700a6f-fb75-45ac-9faa-b35b55a2907f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:02.706105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b700a6f-fb75-45ac-9faa-b35b55a2907f admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:02.766402 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6da46-52c3-4904-85f1-01f223852f17 service placement] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:02.782048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 873/1754] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:02.782598 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6da46-52c3-4904-85f1-01f223852f17 service placement] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:02.817912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4c59d-7002-4015-8e1f-c27e4a658d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:02.818676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4c59d-7002-4015-8e1f-c27e4a658d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:02.818969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4c59d-7002-4015-8e1f-c27e4a658d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:02.819264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4c59d-7002-4015-8e1f-c27e4a658d84 admin admin] PATH_INFO: `/v3/projects/f909dce1f38a46ebbcc06b054e124b18/users/daf27631ff7048808bb8f60903c10d90/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:02.888569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4c59d-7002-4015-8e1f-c27e4a658d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f909dce1f38a46ebbcc06b054e124b18, user_id=daf27631ff7048808bb8f60903c10d90, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:02.916067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4c59d-7002-4015-8e1f-c27e4a658d84 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:02.974451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 882/1755] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:02 2022] PUT /identity/v3/projects/f909dce1f38a46ebbcc06b054e124b18/users/daf27631ff7048808bb8f60903c10d90/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:02.987104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e84e6-f7e4-44a5-a2f5-effbaf4ddca0 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:02.987463 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e84e6-f7e4-44a5-a2f5-effbaf4ddca0 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:02.987759 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e84e6-f7e4-44a5-a2f5-effbaf4ddca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:03.037020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4c59d-7002-4015-8e1f-c27e4a658d84 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:03.039259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-37d4c59d-7002-4015-8e1f-c27e4a658d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:03.078696 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-263e84e6-f7e4-44a5-a2f5-effbaf4ddca0 None None] MFA Rules not processed for user `daf27631ff7048808bb8f60903c10d90`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:03.080509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-263e84e6-f7e4-44a5-a2f5-effbaf4ddca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:03.338758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4c59d-7002-4015-8e1f-c27e4a658d84 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:03.357129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83966248-b9e7-497e-815b-92e94620f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:03.358116 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83966248-b9e7-497e-815b-92e94620f5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:03.358715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83966248-b9e7-497e-815b-92e94620f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:03.359428 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83966248-b9e7-497e-815b-92e94620f5a7 admin admin] PATH_INFO: `/v3/users/3a4c208e73eb488589fb5aabd27c9b46` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:03.364910 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83966248-b9e7-497e-815b-92e94620f5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4c208e73eb488589fb5aabd27c9b46)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:03.367981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83966248-b9e7-497e-815b-92e94620f5a7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:03.412340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 874/1756] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:03.418176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e84e6-f7e4-44a5-a2f5-effbaf4ddca0 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:03.485936 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e84e6-f7e4-44a5-a2f5-effbaf4ddca0 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:03.491734 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa360b-cabd-47f5-ae48-7b50f53873d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:03.492844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa360b-cabd-47f5-ae48-7b50f53873d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:03.493350 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa360b-cabd-47f5-ae48-7b50f53873d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:03.493843 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa360b-cabd-47f5-ae48-7b50f53873d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:03.494727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa360b-cabd-47f5-ae48-7b50f53873d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:03.497014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa360b-cabd-47f5-ae48-7b50f53873d2 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:03.516943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-83966248-b9e7-497e-815b-92e94620f5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4c208e73eb488589fb5aabd27c9b46'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:03.521464 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-83966248-b9e7-497e-815b-92e94620f5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4c208e73eb488589fb5aabd27c9b46'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:03.545090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-83966248-b9e7-497e-815b-92e94620f5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4c208e73eb488589fb5aabd27c9b46'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:03.566919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:03.577197 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-83966248-b9e7-497e-815b-92e94620f5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4c208e73eb488589fb5aabd27c9b46'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:03.579598 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-83966248-b9e7-497e-815b-92e94620f5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4c208e73eb488589fb5aabd27c9b46'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:03.619173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 875/1757] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:03 2022] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:03.619173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa360b-cabd-47f5-ae48-7b50f53873d2 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:03.630663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 883/1758] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:03 2022] DELETE /identity/v3/users/3a4c208e73eb488589fb5aabd27c9b46 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:03.642756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83966248-b9e7-497e-815b-92e94620f5a7 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:03.643164 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-eeaa360b-cabd-47f5-ae48-7b50f53873d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:03.656809 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-83966248-b9e7-497e-815b-92e94620f5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:03.756347 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa360b-cabd-47f5-ae48-7b50f53873d2 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:03.791107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:03.828827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35a50e-a79f-4bd6-b1f1-beb4a612e779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:03.831449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35a50e-a79f-4bd6-b1f1-beb4a612e779 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:03.831726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35a50e-a79f-4bd6-b1f1-beb4a612e779 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:03.833297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35a50e-a79f-4bd6-b1f1-beb4a612e779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:03.837360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5c35a50e-a79f-4bd6-b1f1-beb4a612e779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:03.931791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83966248-b9e7-497e-815b-92e94620f5a7 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:03.962633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7994883-e207-40db-8c31-f30028a33d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:03.963296 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7994883-e207-40db-8c31-f30028a33d5b admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:03.963579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7994883-e207-40db-8c31-f30028a33d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:03.963858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7994883-e207-40db-8c31-f30028a33d5b admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:03.964648 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7994883-e207-40db-8c31-f30028a33d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:03.976352 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7994883-e207-40db-8c31-f30028a33d5b admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:04.012935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35a50e-a79f-4bd6-b1f1-beb4a612e779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:04.035596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35a50e-a79f-4bd6-b1f1-beb4a612e779 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:04.043780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 884/1759] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:03 2022] POST /identity/v3/users => generated 289 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:04.043780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d4de-068a-4649-8e3b-86bd893b32c1 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:04.043780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d4de-068a-4649-8e3b-86bd893b32c1 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:04.043780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d4de-068a-4649-8e3b-86bd893b32c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:04.095247 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-2d41d4de-068a-4649-8e3b-86bd893b32c1 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:04.097427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2d41d4de-068a-4649-8e3b-86bd893b32c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:04.098293 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 876/1760] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:04.121854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35a50e-a79f-4bd6-b1f1-beb4a612e779 service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:04.127818 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 885/1761] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:04.177137 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35a50e-a79f-4bd6-b1f1-beb4a612e779 service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:04.219766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02232e0b-d0f5-4eb2-ad8b-f4909a85dd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:04.219766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232e0b-d0f5-4eb2-ad8b-f4909a85dd89 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:04.220066 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232e0b-d0f5-4eb2-ad8b-f4909a85dd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:04.220434 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232e0b-d0f5-4eb2-ad8b-f4909a85dd89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:04.232796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02232e0b-d0f5-4eb2-ad8b-f4909a85dd89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:04.234031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41d4de-068a-4649-8e3b-86bd893b32c1 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:04.235726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2d41d4de-068a-4649-8e3b-86bd893b32c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:04.254215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02232e0b-d0f5-4eb2-ad8b-f4909a85dd89 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:04.330046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 877/1762] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:04.335423 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b106e4-9f71-41ce-b426-ef5d35e217cd None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:04.337077 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b106e4-9f71-41ce-b426-ef5d35e217cd None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:04.339058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b106e4-9f71-41ce-b426-ef5d35e217cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:04.437804 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41d4de-068a-4649-8e3b-86bd893b32c1 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:04.456878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76360220-81ff-423e-ac22-9073f48478b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:04.457598 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76360220-81ff-423e-ac22-9073f48478b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:04.457889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76360220-81ff-423e-ac22-9073f48478b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:04.458165 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76360220-81ff-423e-ac22-9073f48478b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:04.486758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76360220-81ff-423e-ac22-9073f48478b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:04.488700 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76360220-81ff-423e-ac22-9073f48478b1 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:04.536318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 886/1763] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:50:04.536896 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-a7b106e4-9f71-41ce-b426-ef5d35e217cd None None] MFA Rules not processed for user `00e8fb23313f4e168eb2f690039379ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:04.541928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c89a4c-5e91-43e3-b284-8da5ac3aa95a None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:04.544267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c89a4c-5e91-43e3-b284-8da5ac3aa95a None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:04.545961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a7b106e4-9f71-41ce-b426-ef5d35e217cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:04.549195 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c89a4c-5e91-43e3-b284-8da5ac3aa95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:04.666529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-d7c89a4c-5e91-43e3-b284-8da5ac3aa95a None None] MFA Rules not processed for user `5797a18d030644c29a946de8a7602d37`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:04.667386 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-d7c89a4c-5e91-43e3-b284-8da5ac3aa95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:04.846440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 878/1764] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:04.848085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b106e4-9f71-41ce-b426-ef5d35e217cd None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:04.887703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:04.942623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b106e4-9f71-41ce-b426-ef5d35e217cd None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:04.978603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 887/1765] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:04.993381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1448a-52c4-4d6d-b2ca-02453ade800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:04.995844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1448a-52c4-4d6d-b2ca-02453ade800a admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:04.996727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6addb4-1310-46a6-8869-65bb7a76a172 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:04.997185 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6addb4-1310-46a6-8869-65bb7a76a172 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:04.998694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6addb4-1310-46a6-8869-65bb7a76a172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:05.003875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1448a-52c4-4d6d-b2ca-02453ade800a admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:05.004618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1448a-52c4-4d6d-b2ca-02453ade800a admin admin] PATH_INFO: `/v3/projects/c8bb6a59a44b4ee082d509594a21aa35/users/64454005068c433f973463d2a0b2eb23/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:05.099505 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1448a-52c4-4d6d-b2ca-02453ade800a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bb6a59a44b4ee082d509594a21aa35, user_id=64454005068c433f973463d2a0b2eb23, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:05.125891 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1448a-52c4-4d6d-b2ca-02453ade800a admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:05.179241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6d6addb4-1310-46a6-8869-65bb7a76a172 None None] MFA Rules not processed for user `5797a18d030644c29a946de8a7602d37`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:05.184754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6d6addb4-1310-46a6-8869-65bb7a76a172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:05.189522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 879/1766] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:04 2022] PUT /identity/v3/projects/c8bb6a59a44b4ee082d509594a21aa35/users/64454005068c433f973463d2a0b2eb23/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:05.193549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1448a-52c4-4d6d-b2ca-02453ade800a admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:05.204473 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-aae1448a-52c4-4d6d-b2ca-02453ade800a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:05.450483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:05.455900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 888/1767] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:05.458482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6addb4-1310-46a6-8869-65bb7a76a172 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:05.579377 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1448a-52c4-4d6d-b2ca-02453ade800a admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:05.601005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6ff6d-a11a-4107-8b6d-09739a8d913b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:05.604055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6ff6d-a11a-4107-8b6d-09739a8d913b service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:05.604273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6ff6d-a11a-4107-8b6d-09739a8d913b service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:05.604558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6ff6d-a11a-4107-8b6d-09739a8d913b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:05.680781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6addb4-1310-46a6-8869-65bb7a76a172 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:05.697365 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c761f77-79de-4ae4-ac60-730e58de7cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:05.700515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c761f77-79de-4ae4-ac60-730e58de7cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:05.702056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c761f77-79de-4ae4-ac60-730e58de7cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:05.702911 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c761f77-79de-4ae4-ac60-730e58de7cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:05.711961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c761f77-79de-4ae4-ac60-730e58de7cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:05.714527 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6ff6d-a11a-4107-8b6d-09739a8d913b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:05.717644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6ff6d-a11a-4107-8b6d-09739a8d913b service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:05.724270 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c761f77-79de-4ae4-ac60-730e58de7cc9 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:05.732631 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 880/1768] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:05.733745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6ff6d-a11a-4107-8b6d-09739a8d913b service nova] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:05.736096 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0bf6ff6d-a11a-4107-8b6d-09739a8d913b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:05.761193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6ff6d-a11a-4107-8b6d-09739a8d913b service nova] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:05.767603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 889/1769] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:05.772128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c761f77-79de-4ae4-ac60-730e58de7cc9 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:05.774569 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dc51d-d41c-49d4-8cc5-dbd073af6c9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:05.775491 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dc51d-d41c-49d4-8cc5-dbd073af6c9f service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:05.776143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dc51d-d41c-49d4-8cc5-dbd073af6c9f service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:05.776496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dc51d-d41c-49d4-8cc5-dbd073af6c9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:05.790062 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dc51d-d41c-49d4-8cc5-dbd073af6c9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:05.794376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dc51d-d41c-49d4-8cc5-dbd073af6c9f service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:05.807459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 881/1770] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:05.809017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dc51d-d41c-49d4-8cc5-dbd073af6c9f service nova] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:05.810836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a45dc51d-d41c-49d4-8cc5-dbd073af6c9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:05.814605 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c761f77-79de-4ae4-ac60-730e58de7cc9 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:05.826558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dc51d-d41c-49d4-8cc5-dbd073af6c9f service nova] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:05.826865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb207fdf-f8e8-4094-af4e-a00ef0bfca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:05.829395 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb207fdf-f8e8-4094-af4e-a00ef0bfca43 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:05.831226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb207fdf-f8e8-4094-af4e-a00ef0bfca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:05.832078 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb207fdf-f8e8-4094-af4e-a00ef0bfca43 admin admin] PATH_INFO: `/v3/projects/c8bb6a59a44b4ee082d509594a21aa35/users/64454005068c433f973463d2a0b2eb23/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:05.838863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb207fdf-f8e8-4094-af4e-a00ef0bfca43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bb6a59a44b4ee082d509594a21aa35, user_id=64454005068c433f973463d2a0b2eb23, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:05.847322 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:05.847630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb207fdf-f8e8-4094-af4e-a00ef0bfca43 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:05.848202 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:05.848514 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:05.848871 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] PATH_INFO: `/v3/projects/e4268e3f72db40d58abb8acba771d872` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:05.851603 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4268e3f72db40d58abb8acba771d872)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:05.858014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:05.900556 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 890/1771] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:05 2022] PUT /identity/v3/projects/c8bb6a59a44b4ee082d509594a21aa35/users/64454005068c433f973463d2a0b2eb23/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:05.913084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc27c6-7f0e-4ade-9796-ef6d26fba450 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:05.913525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc27c6-7f0e-4ade-9796-ef6d26fba450 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:05.914205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc27c6-7f0e-4ade-9796-ef6d26fba450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:05.995061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4268e3f72db40d58abb8acba771d872', 'request_id': 'req-0da92daf-f987-4a15-b906-e189803658fc'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:06.014979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4268e3f72db40d58abb8acba771d872', 'request_id': 'req-0da92daf-f987-4a15-b906-e189803658fc'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:06.039967 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4268e3f72db40d58abb8acba771d872', 'request_id': 'req-0da92daf-f987-4a15-b906-e189803658fc'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:06.081464 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] The token cache is being invalidate because project e4268e3f72db40d58abb8acba771d872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:06.081836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:06.082864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:06.087530 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 882/1772] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:05 2022] DELETE /identity/v3/projects/e4268e3f72db40d58abb8acba771d872 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:06.091635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:06.095041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:06.147695 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-b6cc27c6-7f0e-4ade-9796-ef6d26fba450 None None] MFA Rules not processed for user `64454005068c433f973463d2a0b2eb23`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:06.154873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b6cc27c6-7f0e-4ade-9796-ef6d26fba450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:06.277965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:06.379792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da92daf-f987-4a15-b906-e189803658fc admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:06.399384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dd1a2-62c5-4ded-8d85-7e018a90b0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:06.407110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dd1a2-62c5-4ded-8d85-7e018a90b0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:06.407905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dd1a2-62c5-4ded-8d85-7e018a90b0be admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:06.408371 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dd1a2-62c5-4ded-8d85-7e018a90b0be admin admin] PATH_INFO: `/v3/users/7ec368de5e4444f1b6f4958a29016ef8` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:06.412412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dd1a2-62c5-4ded-8d85-7e018a90b0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec368de5e4444f1b6f4958a29016ef8)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:06.418685 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dd1a2-62c5-4ded-8d85-7e018a90b0be admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:06.585745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f58dd1a2-62c5-4ded-8d85-7e018a90b0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec368de5e4444f1b6f4958a29016ef8'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:06.588660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f58dd1a2-62c5-4ded-8d85-7e018a90b0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec368de5e4444f1b6f4958a29016ef8'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:06.598103 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f58dd1a2-62c5-4ded-8d85-7e018a90b0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec368de5e4444f1b6f4958a29016ef8'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:06.599033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f58dd1a2-62c5-4ded-8d85-7e018a90b0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec368de5e4444f1b6f4958a29016ef8'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:06.619825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f58dd1a2-62c5-4ded-8d85-7e018a90b0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec368de5e4444f1b6f4958a29016ef8'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:06.676967 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 883/1773] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:06 2022] DELETE /identity/v3/users/7ec368de5e4444f1b6f4958a29016ef8 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:06.688696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 891/1774] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 778 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:06.796871 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dd1a2-62c5-4ded-8d85-7e018a90b0be admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:06.799557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f58dd1a2-62c5-4ded-8d85-7e018a90b0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:07.104190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dd1a2-62c5-4ded-8d85-7e018a90b0be admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:07.131672 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56791bcd-cb18-4e8a-b70a-8ae7f5be0993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:07.136744 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56791bcd-cb18-4e8a-b70a-8ae7f5be0993 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:07.139937 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56791bcd-cb18-4e8a-b70a-8ae7f5be0993 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:07.140289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56791bcd-cb18-4e8a-b70a-8ae7f5be0993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:07.400218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56791bcd-cb18-4e8a-b70a-8ae7f5be0993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:07.406461 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56791bcd-cb18-4e8a-b70a-8ae7f5be0993 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:07.485041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 884/1775] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:07.777985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc27c6-7f0e-4ade-9796-ef6d26fba450 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:07.785810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:07.995632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc27c6-7f0e-4ade-9796-ef6d26fba450 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:08.016940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a811e-abce-4aaf-8a80-381c78b6f341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:08.018015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a811e-abce-4aaf-8a80-381c78b6f341 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:08.018331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a811e-abce-4aaf-8a80-381c78b6f341 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:08.018612 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a811e-abce-4aaf-8a80-381c78b6f341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:08.027304 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c26a811e-abce-4aaf-8a80-381c78b6f341 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:08.385241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a811e-abce-4aaf-8a80-381c78b6f341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:08.386957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56791bcd-cb18-4e8a-b70a-8ae7f5be0993 service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:08.389107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-56791bcd-cb18-4e8a-b70a-8ae7f5be0993 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:08.409627 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a811e-abce-4aaf-8a80-381c78b6f341 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:08.473573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:08.483868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 892/1776] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:08.685413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56791bcd-cb18-4e8a-b70a-8ae7f5be0993 service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:08.702694 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4f353-1a8f-404f-b1d7-a826497351f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:08.703411 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f353-1a8f-404f-b1d7-a826497351f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:08.703701 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f353-1a8f-404f-b1d7-a826497351f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:08.704037 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f353-1a8f-404f-b1d7-a826497351f2 admin admin] PATH_INFO: `/v3/projects/bc26fa9b7093412dbfbdfbf83d874e4a` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:08.708759 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f353-1a8f-404f-b1d7-a826497351f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc26fa9b7093412dbfbdfbf83d874e4a)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:08.716522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f353-1a8f-404f-b1d7-a826497351f2 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:08.961598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-63d4f353-1a8f-404f-b1d7-a826497351f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc26fa9b7093412dbfbdfbf83d874e4a', 'request_id': 'req-63d4f353-1a8f-404f-b1d7-a826497351f2'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:08.989229 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-63d4f353-1a8f-404f-b1d7-a826497351f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc26fa9b7093412dbfbdfbf83d874e4a', 'request_id': 'req-63d4f353-1a8f-404f-b1d7-a826497351f2'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:09.005204 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-63d4f353-1a8f-404f-b1d7-a826497351f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc26fa9b7093412dbfbdfbf83d874e4a', 'request_id': 'req-63d4f353-1a8f-404f-b1d7-a826497351f2'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:09.064591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-63d4f353-1a8f-404f-b1d7-a826497351f2 admin admin] The token cache is being invalidate because project bc26fa9b7093412dbfbdfbf83d874e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:09.066325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-63d4f353-1a8f-404f-b1d7-a826497351f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:09.068490 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-63d4f353-1a8f-404f-b1d7-a826497351f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:09.070672 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 885/1777] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:08 2022] DELETE /identity/v3/projects/bc26fa9b7093412dbfbdfbf83d874e4a => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:09.076525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ad597-7753-4423-abb1-b4154514c18c None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:09.077264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ad597-7753-4423-abb1-b4154514c18c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:09.077264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ad597-7753-4423-abb1-b4154514c18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:09.174279 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-aa6ad597-7753-4423-abb1-b4154514c18c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:09.183516 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-aa6ad597-7753-4423-abb1-b4154514c18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:09.299316 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e11ece-2642-4f97-a9be-91ec08e13681 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:09.300852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e11ece-2642-4f97-a9be-91ec08e13681 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:09.301390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e11ece-2642-4f97-a9be-91ec08e13681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:09.495226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 893/1778] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:09.515039 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63ca18-c7ba-41a3-a4ca-6de15c7e6615 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:09.516311 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63ca18-c7ba-41a3-a4ca-6de15c7e6615 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:09.517154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63ca18-c7ba-41a3-a4ca-6de15c7e6615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:09.632835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-ce63ca18-c7ba-41a3-a4ca-6de15c7e6615 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:09.644172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ce63ca18-c7ba-41a3-a4ca-6de15c7e6615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:09.669300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-06e11ece-2642-4f97-a9be-91ec08e13681 None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:09.675739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-06e11ece-2642-4f97-a9be-91ec08e13681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:09.689153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 894/1779] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:09.695292 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63ca18-c7ba-41a3-a4ca-6de15c7e6615 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:09.733933 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63ca18-c7ba-41a3-a4ca-6de15c7e6615 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:09.751676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e1d15-b777-4645-a35d-cad5809d20fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:09.752499 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e1d15-b777-4645-a35d-cad5809d20fd admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:09.752499 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e1d15-b777-4645-a35d-cad5809d20fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:09.755091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e1d15-b777-4645-a35d-cad5809d20fd admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:09.755091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e1d15-b777-4645-a35d-cad5809d20fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:09.755091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e1d15-b777-4645-a35d-cad5809d20fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:09.776209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e1d15-b777-4645-a35d-cad5809d20fd admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:09.856637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 895/1780] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:09.859978 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e1d15-b777-4645-a35d-cad5809d20fd admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:09.930297 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e1d15-b777-4645-a35d-cad5809d20fd admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:09.956245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c1e12-c2b2-4a30-9e41-f508a1a67d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:09.961360 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c1e12-c2b2-4a30-9e41-f508a1a67d78 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:09.966684 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c1e12-c2b2-4a30-9e41-f508a1a67d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:09.968513 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c1e12-c2b2-4a30-9e41-f508a1a67d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:09.969955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c1e12-c2b2-4a30-9e41-f508a1a67d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:09.982337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c1e12-c2b2-4a30-9e41-f508a1a67d78 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:10.005935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 886/1781] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 10:50:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 708 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:10.110327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 896/1782] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:09 2022] POST /identity/v3/projects => generated 385 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:10.111450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e11ece-2642-4f97-a9be-91ec08e13681 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:10.140210 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e11ece-2642-4f97-a9be-91ec08e13681 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:10.210428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:10.362963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c1e12-c2b2-4a30-9e41-f508a1a67d78 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:10.366118 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b27c1e12-c2b2-4a30-9e41-f508a1a67d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:10.418528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3c565-b058-4f13-94ed-fdebbc84dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:10.419511 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3c565-b058-4f13-94ed-fdebbc84dbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:10.419962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3c565-b058-4f13-94ed-fdebbc84dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:10.420564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3c565-b058-4f13-94ed-fdebbc84dbb3 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:10.421410 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3c565-b058-4f13-94ed-fdebbc84dbb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:10.425389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3c565-b058-4f13-94ed-fdebbc84dbb3 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:10.471259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:10.483648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 887/1783] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:10 2022] POST /identity/v3/users => generated 293 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:10.489225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3c565-b058-4f13-94ed-fdebbc84dbb3 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:10.522057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3c565-b058-4f13-94ed-fdebbc84dbb3 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:10.537174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1e0a9-7e2c-40ef-8f7b-59a842c20d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:10.538049 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1e0a9-7e2c-40ef-8f7b-59a842c20d65 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:10.540179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1e0a9-7e2c-40ef-8f7b-59a842c20d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:10.540666 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1e0a9-7e2c-40ef-8f7b-59a842c20d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:10.543330 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1e0a9-7e2c-40ef-8f7b-59a842c20d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:10.555142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1e0a9-7e2c-40ef-8f7b-59a842c20d65 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:10.601989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 888/1784] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:10.607250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1e0a9-7e2c-40ef-8f7b-59a842c20d65 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:10.631485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1e0a9-7e2c-40ef-8f7b-59a842c20d65 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:10.656835 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260a3b0-09ab-4cb3-b132-854dfdef1cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:10.657418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260a3b0-09ab-4cb3-b132-854dfdef1cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:10.658044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260a3b0-09ab-4cb3-b132-854dfdef1cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:10.658044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260a3b0-09ab-4cb3-b132-854dfdef1cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:10.658623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260a3b0-09ab-4cb3-b132-854dfdef1cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:10.660635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260a3b0-09ab-4cb3-b132-854dfdef1cc9 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:10.696117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 889/1785] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:10.697187 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260a3b0-09ab-4cb3-b132-854dfdef1cc9 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:10.731017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260a3b0-09ab-4cb3-b132-854dfdef1cc9 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:10.736255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc91e7-34d1-46a6-a235-5e2eccb84807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:10.736956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc91e7-34d1-46a6-a235-5e2eccb84807 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:10.737244 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc91e7-34d1-46a6-a235-5e2eccb84807 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:10.737529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc91e7-34d1-46a6-a235-5e2eccb84807 admin admin] PATH_INFO: `/v3/projects/d1a4e078e63a404bb77a43883e72104f/users/1ef7d242538d445780f2ef9acd4d1a26/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:10.760654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc91e7-34d1-46a6-a235-5e2eccb84807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a4e078e63a404bb77a43883e72104f, user_id=1ef7d242538d445780f2ef9acd4d1a26, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:10.764698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc91e7-34d1-46a6-a235-5e2eccb84807 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:10.790796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 890/1786] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:10 2022] PUT /identity/v3/projects/d1a4e078e63a404bb77a43883e72104f/users/1ef7d242538d445780f2ef9acd4d1a26/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:10.794781 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8717d-06ae-40cb-83c8-8d8074a1a8fe None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:10.795125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8717d-06ae-40cb-83c8-8d8074a1a8fe None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:10.795413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8717d-06ae-40cb-83c8-8d8074a1a8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:10.827257 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c1e12-c2b2-4a30-9e41-f508a1a67d78 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:10.894163 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-0ed8717d-06ae-40cb-83c8-8d8074a1a8fe None None] MFA Rules not processed for user `1ef7d242538d445780f2ef9acd4d1a26`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:10.897192 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0ed8717d-06ae-40cb-83c8-8d8074a1a8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:11.023454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 891/1787] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:11.029248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8717d-06ae-40cb-83c8-8d8074a1a8fe None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:11.045391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084ed42-286a-4557-b942-980a946565e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:11.049120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084ed42-286a-4557-b942-980a946565e7 service swift] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:11.055727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084ed42-286a-4557-b942-980a946565e7 service swift] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:11.057100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084ed42-286a-4557-b942-980a946565e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:11.224741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:11.280683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8717d-06ae-40cb-83c8-8d8074a1a8fe None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:11.283508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084ed42-286a-4557-b942-980a946565e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:11.289130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084ed42-286a-4557-b942-980a946565e7 service swift] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:11.295714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b9d06-8e15-45e3-9419-1fb95f57b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:11.300611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b9d06-8e15-45e3-9419-1fb95f57b9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:11.300611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b9d06-8e15-45e3-9419-1fb95f57b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:11.300611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b9d06-8e15-45e3-9419-1fb95f57b9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:11.301334 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b9d06-8e15-45e3-9419-1fb95f57b9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:11.307888 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b9d06-8e15-45e3-9419-1fb95f57b9b6 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:11.323014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 897/1788] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 10:50:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 961 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 10:50:11.419490 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 892/1789] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:11 2022] POST /identity/v3/projects => generated 387 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:11.421423 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084ed42-286a-4557-b942-980a946565e7 service swift] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:11.446844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084ed42-286a-4557-b942-980a946565e7 service swift] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:11.580424 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:11.632481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b12448-64c2-4479-ace4-d02fa35a542d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:11.634245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b12448-64c2-4479-ace4-d02fa35a542d admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:11.634623 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b12448-64c2-4479-ace4-d02fa35a542d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:11.634924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b12448-64c2-4479-ace4-d02fa35a542d admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:11.635711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b12448-64c2-4479-ace4-d02fa35a542d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:11.638198 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b12448-64c2-4479-ace4-d02fa35a542d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:11.706635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 898/1790] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:11 2022] POST /identity/v3/users => generated 300 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:11.708674 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b9d06-8e15-45e3-9419-1fb95f57b9b6 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:11.732658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b9d06-8e15-45e3-9419-1fb95f57b9b6 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:11.759549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194e5a4-c090-499c-9ee9-8449089e27e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:11.760268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194e5a4-c090-499c-9ee9-8449089e27e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:11.760551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194e5a4-c090-499c-9ee9-8449089e27e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:11.760830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194e5a4-c090-499c-9ee9-8449089e27e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:11.761603 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194e5a4-c090-499c-9ee9-8449089e27e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:11.780639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194e5a4-c090-499c-9ee9-8449089e27e9 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:11.848319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 893/1791] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:11.849753 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b12448-64c2-4479-ace4-d02fa35a542d admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:11.887476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b12448-64c2-4479-ace4-d02fa35a542d admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:11.920209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194e5a4-c090-499c-9ee9-8449089e27e9 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:11.922072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-9194e5a4-c090-499c-9ee9-8449089e27e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:11.933788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1344d-60b5-480c-a078-7a21f959bb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:11.944965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1344d-60b5-480c-a078-7a21f959bb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:11.957818 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1344d-60b5-480c-a078-7a21f959bb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:11.962244 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1344d-60b5-480c-a078-7a21f959bb9e admin admin] PATH_INFO: `/v3/projects/fd734c217d654bf1b7f1070374a9705d/users/fb0d057fdd7c4c0d8330c803bb35e386/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:11.970662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194e5a4-c090-499c-9ee9-8449089e27e9 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:12.000460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ed06b-3adf-4704-aa61-bc3b5a57b446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:12.002789 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ed06b-3adf-4704-aa61-bc3b5a57b446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:12.008810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ed06b-3adf-4704-aa61-bc3b5a57b446 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:12.009360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ed06b-3adf-4704-aa61-bc3b5a57b446 admin admin] PATH_INFO: `/v3/users/daf27631ff7048808bb8f60903c10d90` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:12.017779 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ed06b-3adf-4704-aa61-bc3b5a57b446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf27631ff7048808bb8f60903c10d90)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:12.020266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ed06b-3adf-4704-aa61-bc3b5a57b446 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:12.070625 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1344d-60b5-480c-a078-7a21f959bb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd734c217d654bf1b7f1070374a9705d, user_id=fb0d057fdd7c4c0d8330c803bb35e386, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:12.114004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1344d-60b5-480c-a078-7a21f959bb9e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:12.177657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 899/1792] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:11 2022] PUT /identity/v3/projects/fd734c217d654bf1b7f1070374a9705d/users/fb0d057fdd7c4c0d8330c803bb35e386/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:12.184890 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1344d-60b5-480c-a078-7a21f959bb9e admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:12.190004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8bc1344d-60b5-480c-a078-7a21f959bb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:12.235493 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e91ed06b-3adf-4704-aa61-bc3b5a57b446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf27631ff7048808bb8f60903c10d90'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:12.236716 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e91ed06b-3adf-4704-aa61-bc3b5a57b446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf27631ff7048808bb8f60903c10d90'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:12.271427 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e91ed06b-3adf-4704-aa61-bc3b5a57b446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf27631ff7048808bb8f60903c10d90'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:12.277759 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e91ed06b-3adf-4704-aa61-bc3b5a57b446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf27631ff7048808bb8f60903c10d90'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:12.290482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1344d-60b5-480c-a078-7a21f959bb9e admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:12.300462 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0dd7a5-20d8-454a-920a-f9de9de61f81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:12.301960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dd7a5-20d8-454a-920a-f9de9de61f81 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:12.302884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dd7a5-20d8-454a-920a-f9de9de61f81 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:12.303693 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dd7a5-20d8-454a-920a-f9de9de61f81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:12.305710 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e91ed06b-3adf-4704-aa61-bc3b5a57b446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf27631ff7048808bb8f60903c10d90'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:12.307045 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-db0dd7a5-20d8-454a-920a-f9de9de61f81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:12.393809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 894/1793] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:11 2022] DELETE /identity/v3/users/daf27631ff7048808bb8f60903c10d90 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:12.395410 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ed06b-3adf-4704-aa61-bc3b5a57b446 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:12.398250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e91ed06b-3adf-4704-aa61-bc3b5a57b446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:12.535085 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dd7a5-20d8-454a-920a-f9de9de61f81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:12.539682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0dd7a5-20d8-454a-920a-f9de9de61f81 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:12.577740 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 900/1794] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:12.585842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4093dc-89f9-472d-8006-9e971c7cc9ee None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:12.586337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4093dc-89f9-472d-8006-9e971c7cc9ee None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:12.586832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4093dc-89f9-472d-8006-9e971c7cc9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:12.587818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ed06b-3adf-4704-aa61-bc3b5a57b446 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:12.599900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88c986-3a5a-4dc2-af5a-83744f46fb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:12.601336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c986-3a5a-4dc2-af5a-83744f46fb28 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:12.601861 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c986-3a5a-4dc2-af5a-83744f46fb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:12.602414 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88c986-3a5a-4dc2-af5a-83744f46fb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:12.603814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88c986-3a5a-4dc2-af5a-83744f46fb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:12.609622 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88c986-3a5a-4dc2-af5a-83744f46fb28 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:12.635720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 895/1795] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:12.640825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88c986-3a5a-4dc2-af5a-83744f46fb28 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:12.669605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88c986-3a5a-4dc2-af5a-83744f46fb28 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:12.670943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-da4093dc-89f9-472d-8006-9e971c7cc9ee None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:12.672400 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-da4093dc-89f9-472d-8006-9e971c7cc9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:12.695726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de193db-1ae5-4ea6-8162-a00abcefa0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:12.695969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de193db-1ae5-4ea6-8162-a00abcefa0db admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:12.696204 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de193db-1ae5-4ea6-8162-a00abcefa0db admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:12.696487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de193db-1ae5-4ea6-8162-a00abcefa0db admin admin] PATH_INFO: `/v3/projects/fd734c217d654bf1b7f1070374a9705d/users/fb0d057fdd7c4c0d8330c803bb35e386/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:12.712319 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 901/1796] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:12.716853 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de193db-1ae5-4ea6-8162-a00abcefa0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd734c217d654bf1b7f1070374a9705d, user_id=fb0d057fdd7c4c0d8330c803bb35e386, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:12.719960 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de193db-1ae5-4ea6-8162-a00abcefa0db admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:12.742998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4093dc-89f9-472d-8006-9e971c7cc9ee None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:12.744492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-da4093dc-89f9-472d-8006-9e971c7cc9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:12.789497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 896/1797] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:12 2022] PUT /identity/v3/projects/fd734c217d654bf1b7f1070374a9705d/users/fb0d057fdd7c4c0d8330c803bb35e386/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:12.810991 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1ba1a-77f3-48c3-a8e2-e8efde2568c6 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:12.811525 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1ba1a-77f3-48c3-a8e2-e8efde2568c6 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:12.812104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1ba1a-77f3-48c3-a8e2-e8efde2568c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:13.024975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-0ed1ba1a-77f3-48c3-a8e2-e8efde2568c6 None None] MFA Rules not processed for user `fb0d057fdd7c4c0d8330c803bb35e386`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:13.027128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0ed1ba1a-77f3-48c3-a8e2-e8efde2568c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:13.057667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:13.082597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4093dc-89f9-472d-8006-9e971c7cc9ee None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:13.118972 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:13.334024 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a617fd-3672-4102-a0b1-ad1337d88e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:13.335018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a617fd-3672-4102-a0b1-ad1337d88e8a service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:13.335018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a617fd-3672-4102-a0b1-ad1337d88e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:13.335264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a617fd-3672-4102-a0b1-ad1337d88e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:13.462652 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 897/1798] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 656 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:13.482365 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1ba1a-77f3-48c3-a8e2-e8efde2568c6 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:13.484322 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0ed1ba1a-77f3-48c3-a8e2-e8efde2568c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:13.541678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a617fd-3672-4102-a0b1-ad1337d88e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:13.544944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a617fd-3672-4102-a0b1-ad1337d88e8a service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:13.560262 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 902/1799] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 818 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:50:13.657975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1ba1a-77f3-48c3-a8e2-e8efde2568c6 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:13.672969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d237dc-4e3c-43b3-accc-acc95fb45f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:13.673554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d237dc-4e3c-43b3-accc-acc95fb45f7d service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:13.673837 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d237dc-4e3c-43b3-accc-acc95fb45f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:13.674113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d237dc-4e3c-43b3-accc-acc95fb45f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:13.705961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d237dc-4e3c-43b3-accc-acc95fb45f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:13.707813 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d237dc-4e3c-43b3-accc-acc95fb45f7d service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:13.726365 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 898/1800] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:50:13.790568 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a617fd-3672-4102-a0b1-ad1337d88e8a service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:13.811837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a617fd-3672-4102-a0b1-ad1337d88e8a service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:13.824724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec4ca9-0d58-4ff6-bac3-a7402cd4f441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:13.826773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec4ca9-0d58-4ff6-bac3-a7402cd4f441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:13.827983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec4ca9-0d58-4ff6-bac3-a7402cd4f441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:13.828633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec4ca9-0d58-4ff6-bac3-a7402cd4f441 admin admin] PATH_INFO: `/v3/users/1ef7d242538d445780f2ef9acd4d1a26` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:13.833067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec4ca9-0d58-4ff6-bac3-a7402cd4f441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef7d242538d445780f2ef9acd4d1a26)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:13.838250 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec4ca9-0d58-4ff6-bac3-a7402cd4f441 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:13.993807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-acec4ca9-0d58-4ff6-bac3-a7402cd4f441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef7d242538d445780f2ef9acd4d1a26'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:13.999575 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-acec4ca9-0d58-4ff6-bac3-a7402cd4f441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef7d242538d445780f2ef9acd4d1a26'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:14.024756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-acec4ca9-0d58-4ff6-bac3-a7402cd4f441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef7d242538d445780f2ef9acd4d1a26'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:14.051001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-acec4ca9-0d58-4ff6-bac3-a7402cd4f441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef7d242538d445780f2ef9acd4d1a26'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:14.051924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-acec4ca9-0d58-4ff6-bac3-a7402cd4f441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef7d242538d445780f2ef9acd4d1a26'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:14.113534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 903/1801] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:13 2022] DELETE /identity/v3/users/1ef7d242538d445780f2ef9acd4d1a26 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:14.127106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863a665-b57f-413d-bb33-a7efc4b664fc None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:14.127558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863a665-b57f-413d-bb33-a7efc4b664fc None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:14.128276 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863a665-b57f-413d-bb33-a7efc4b664fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:14.225961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-a863a665-b57f-413d-bb33-a7efc4b664fc None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:14.238098 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a863a665-b57f-413d-bb33-a7efc4b664fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:14.548638 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 899/1802] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:14.848506 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec4ca9-0d58-4ff6-bac3-a7402cd4f441 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:14.851214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-acec4ca9-0d58-4ff6-bac3-a7402cd4f441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:15.077966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:15.144400 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec4ca9-0d58-4ff6-bac3-a7402cd4f441 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:15.168963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4119e7-2f8b-4795-8a78-aa04c79beca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:15.170244 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4119e7-2f8b-4795-8a78-aa04c79beca6 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:15.170515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4119e7-2f8b-4795-8a78-aa04c79beca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:15.170860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4119e7-2f8b-4795-8a78-aa04c79beca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:15.182803 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4119e7-2f8b-4795-8a78-aa04c79beca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:15.184684 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4119e7-2f8b-4795-8a78-aa04c79beca6 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:15.212834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 904/1803] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:50:16.291975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a265e9-8b28-4134-9ea1-52fb24ab9301 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:16.297859 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a265e9-8b28-4134-9ea1-52fb24ab9301 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:16.298585 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a265e9-8b28-4134-9ea1-52fb24ab9301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:16.405092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-65a265e9-8b28-4134-9ea1-52fb24ab9301 None None] MFA Rules not processed for user `6b33631df63d4657a8e2ad108ca9f670`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:16.409324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-65a265e9-8b28-4134-9ea1-52fb24ab9301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:16.425055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 900/1804] 10.222.0.82 () {58 vars in 1015 bytes} [Wed Jul 27 10:50:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:16.484919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4119e7-2f8b-4795-8a78-aa04c79beca6 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:16.512685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4119e7-2f8b-4795-8a78-aa04c79beca6 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:16.525345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392586b4-ad59-4574-a93a-8f40a50c606a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:16.527050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392586b4-ad59-4574-a93a-8f40a50c606a service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:16.527964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392586b4-ad59-4574-a93a-8f40a50c606a service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:16.530552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392586b4-ad59-4574-a93a-8f40a50c606a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:16.563356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392586b4-ad59-4574-a93a-8f40a50c606a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:16.567769 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392586b4-ad59-4574-a93a-8f40a50c606a service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:16.585052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 905/1805] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:17.420846 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a265e9-8b28-4134-9ea1-52fb24ab9301 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:17.422925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-65a265e9-8b28-4134-9ea1-52fb24ab9301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:17.506473 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a265e9-8b28-4134-9ea1-52fb24ab9301 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:17.530225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65ef94-75ab-4fd7-bb6a-4a23c0582049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:17.532523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65ef94-75ab-4fd7-bb6a-4a23c0582049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:17.533821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65ef94-75ab-4fd7-bb6a-4a23c0582049 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:17.536391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65ef94-75ab-4fd7-bb6a-4a23c0582049 admin admin] PATH_INFO: `/v3/users/9e83ec23bc7c4bf388a57d877ccbdbea` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:17.540500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65ef94-75ab-4fd7-bb6a-4a23c0582049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e83ec23bc7c4bf388a57d877ccbdbea)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:17.553248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65ef94-75ab-4fd7-bb6a-4a23c0582049 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:17.693772 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:17.722587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-2a65ef94-75ab-4fd7-bb6a-4a23c0582049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e83ec23bc7c4bf388a57d877ccbdbea'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:17.723377 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-2a65ef94-75ab-4fd7-bb6a-4a23c0582049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e83ec23bc7c4bf388a57d877ccbdbea'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:17.748660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-2a65ef94-75ab-4fd7-bb6a-4a23c0582049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e83ec23bc7c4bf388a57d877ccbdbea'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:17.752746 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-2a65ef94-75ab-4fd7-bb6a-4a23c0582049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e83ec23bc7c4bf388a57d877ccbdbea'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:17.781746 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-2a65ef94-75ab-4fd7-bb6a-4a23c0582049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e83ec23bc7c4bf388a57d877ccbdbea'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:17.900305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 901/1806] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:17 2022] DELETE /identity/v3/users/9e83ec23bc7c4bf388a57d877ccbdbea => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:17.910971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01219a7-b62c-4edc-98b1-cde2342eac19 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:17.911468 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01219a7-b62c-4edc-98b1-cde2342eac19 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:17.911585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01219a7-b62c-4edc-98b1-cde2342eac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:17.968034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-d01219a7-b62c-4edc-98b1-cde2342eac19 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:17.970716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-d01219a7-b62c-4edc-98b1-cde2342eac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:18.123860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 906/1807] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:18.391089 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65ef94-75ab-4fd7-bb6a-4a23c0582049 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:18.393274 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-2a65ef94-75ab-4fd7-bb6a-4a23c0582049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:18.562152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65ef94-75ab-4fd7-bb6a-4a23c0582049 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:18.591246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04b375-015b-4b7f-b41b-31a16f7c41f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:18.592791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04b375-015b-4b7f-b41b-31a16f7c41f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:18.593416 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04b375-015b-4b7f-b41b-31a16f7c41f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:18.594054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04b375-015b-4b7f-b41b-31a16f7c41f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:18.632535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04b375-015b-4b7f-b41b-31a16f7c41f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:18.644759 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04b375-015b-4b7f-b41b-31a16f7c41f9 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:18.709867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 902/1808] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:50:19.474365 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505042e-1123-457e-a71a-5e0b5b7f37b7 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:19.475422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505042e-1123-457e-a71a-5e0b5b7f37b7 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:19.475918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505042e-1123-457e-a71a-5e0b5b7f37b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:19.513722 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6505042e-1123-457e-a71a-5e0b5b7f37b7 None None] MFA Rules not processed for user `00e8fb23313f4e168eb2f690039379ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:19.515549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6505042e-1123-457e-a71a-5e0b5b7f37b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:19.645059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 907/1809] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:20.225874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab40cc5-bcbc-43b4-b150-9ce7b27524bb None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:20.226560 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab40cc5-bcbc-43b4-b150-9ce7b27524bb None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:20.226560 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab40cc5-bcbc-43b4-b150-9ce7b27524bb None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:20.228189 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 903/1810] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jul 27 10:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:50:20.259245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cb149-faa9-4469-9161-d5334564e476 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:20.259735 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cb149-faa9-4469-9161-d5334564e476 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:20.260358 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cb149-faa9-4469-9161-d5334564e476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:20.413052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-610cb149-faa9-4469-9161-d5334564e476 None None] MFA Rules not processed for user `3bb16c9232464cc2aeee12b7fa918b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:20.419049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-610cb149-faa9-4469-9161-d5334564e476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:20.605257 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:20.678546 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 908/1811] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jul 27 10:50:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:20.680099 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab40cc5-bcbc-43b4-b150-9ce7b27524bb None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:20.683409 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-7ab40cc5-bcbc-43b4-b150-9ce7b27524bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:20.736102 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab40cc5-bcbc-43b4-b150-9ce7b27524bb None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:20.754017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:20.754648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:20.755166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:20.755881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] PATH_INFO: `/v3/projects/d1a4e078e63a404bb77a43883e72104f` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:20.758721 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1a4e078e63a404bb77a43883e72104f)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:20.761862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:20.955862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1a4e078e63a404bb77a43883e72104f', 'request_id': 'req-51b33cc8-6caa-4550-9e31-010023291617'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:20.977235 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1a4e078e63a404bb77a43883e72104f', 'request_id': 'req-51b33cc8-6caa-4550-9e31-010023291617'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:20.998646 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cb149-faa9-4469-9161-d5334564e476 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:21.001450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-610cb149-faa9-4469-9161-d5334564e476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:21.021415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1a4e078e63a404bb77a43883e72104f', 'request_id': 'req-51b33cc8-6caa-4550-9e31-010023291617'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.067297 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cb149-faa9-4469-9161-d5334564e476 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:21.106820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] The token cache is being invalidate because project d1a4e078e63a404bb77a43883e72104f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:21.108180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.110750 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.117224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 904/1812] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:20 2022] DELETE /identity/v3/projects/d1a4e078e63a404bb77a43883e72104f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:21.125226 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:21.129915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:21.240461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:21.241344 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:21.241874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:21.241874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:21.242248 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] PATH_INFO: `/v3/projects/f909dce1f38a46ebbcc06b054e124b18` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:21.244224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f909dce1f38a46ebbcc06b054e124b18)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:21.246922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:21.318772 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33cc8-6caa-4550-9e31-010023291617 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:21.343745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f909dce1f38a46ebbcc06b054e124b18', 'request_id': 'req-f884c1dc-4f15-47af-8a27-a372a43c63e7'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.361652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f909dce1f38a46ebbcc06b054e124b18', 'request_id': 'req-f884c1dc-4f15-47af-8a27-a372a43c63e7'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.379120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f909dce1f38a46ebbcc06b054e124b18', 'request_id': 'req-f884c1dc-4f15-47af-8a27-a372a43c63e7'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.412555 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] The token cache is being invalidate because project f909dce1f38a46ebbcc06b054e124b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:21.412927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.414248 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.423524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 909/1813] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:20 2022] DELETE /identity/v3/projects/f909dce1f38a46ebbcc06b054e124b18 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:21.425199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:21.427788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:21.549238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e5e99-0775-4e04-9034-9c8d95725747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:21.552520 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e5e99-0775-4e04-9034-9c8d95725747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:21.553050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e5e99-0775-4e04-9034-9c8d95725747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:21.553562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e5e99-0775-4e04-9034-9c8d95725747 admin admin] PATH_INFO: `/v3/users/fb0d057fdd7c4c0d8330c803bb35e386` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:21.559597 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e5e99-0775-4e04-9034-9c8d95725747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0d057fdd7c4c0d8330c803bb35e386)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:21.566755 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e5e99-0775-4e04-9034-9c8d95725747 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:21.685374 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884c1dc-4f15-47af-8a27-a372a43c63e7 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:21.695169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0d7e5e99-0775-4e04-9034-9c8d95725747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0d057fdd7c4c0d8330c803bb35e386'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.697104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0d7e5e99-0775-4e04-9034-9c8d95725747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0d057fdd7c4c0d8330c803bb35e386'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.699136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bcfa4-4c9a-43f6-9e85-5d666ea55ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:21.699928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bcfa4-4c9a-43f6-9e85-5d666ea55ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:21.701466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bcfa4-4c9a-43f6-9e85-5d666ea55ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:21.701763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bcfa4-4c9a-43f6-9e85-5d666ea55ef3 admin admin] PATH_INFO: `/v3/users/64454005068c433f973463d2a0b2eb23` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:21.718401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bcfa4-4c9a-43f6-9e85-5d666ea55ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64454005068c433f973463d2a0b2eb23)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:21.718401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bcfa4-4c9a-43f6-9e85-5d666ea55ef3 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:21.719354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0d7e5e99-0775-4e04-9034-9c8d95725747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0d057fdd7c4c0d8330c803bb35e386'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.719354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0d7e5e99-0775-4e04-9034-9c8d95725747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0d057fdd7c4c0d8330c803bb35e386'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.736588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0d7e5e99-0775-4e04-9034-9c8d95725747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0d057fdd7c4c0d8330c803bb35e386'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.760929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 905/1814] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:21 2022] DELETE /identity/v3/users/fb0d057fdd7c4c0d8330c803bb35e386 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:21.761909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e5e99-0775-4e04-9034-9c8d95725747 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:21.763427 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0d7e5e99-0775-4e04-9034-9c8d95725747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:21.811824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:21.852272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-891bcfa4-4c9a-43f6-9e85-5d666ea55ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64454005068c433f973463d2a0b2eb23'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.855253 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-891bcfa4-4c9a-43f6-9e85-5d666ea55ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64454005068c433f973463d2a0b2eb23'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.874075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-891bcfa4-4c9a-43f6-9e85-5d666ea55ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64454005068c433f973463d2a0b2eb23'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.881191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e5e99-0775-4e04-9034-9c8d95725747 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:21.887419 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:21.888247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:21.888668 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:21.895169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-891bcfa4-4c9a-43f6-9e85-5d666ea55ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64454005068c433f973463d2a0b2eb23'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.895169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-891bcfa4-4c9a-43f6-9e85-5d666ea55ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64454005068c433f973463d2a0b2eb23'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:21.898803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] PATH_INFO: `/v3/projects/d4eb4d9359334e459a9393097b16e742` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:21.902048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4eb4d9359334e459a9393097b16e742)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:21.912262 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:21.923171 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:21.944038 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 910/1815] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:21 2022] DELETE /identity/v3/users/64454005068c433f973463d2a0b2eb23 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:21.946974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bcfa4-4c9a-43f6-9e85-5d666ea55ef3 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:21.952883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-891bcfa4-4c9a-43f6-9e85-5d666ea55ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:22.039045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4eb4d9359334e459a9393097b16e742', 'request_id': 'req-90764dd2-a85e-4705-af22-605d68197d92'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:22.062065 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4eb4d9359334e459a9393097b16e742', 'request_id': 'req-90764dd2-a85e-4705-af22-605d68197d92'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:22.086917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4eb4d9359334e459a9393097b16e742', 'request_id': 'req-90764dd2-a85e-4705-af22-605d68197d92'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:22.171584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] The token cache is being invalidate because project d4eb4d9359334e459a9393097b16e742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:22.172426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:22.174486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:22.179359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 906/1816] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:21 2022] DELETE /identity/v3/projects/d4eb4d9359334e459a9393097b16e742 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:22.188013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:22.212244 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:22.286966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bcfa4-4c9a-43f6-9e85-5d666ea55ef3 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:22.489301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90764dd2-a85e-4705-af22-605d68197d92 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:22.502698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec411bf-f262-4fef-a626-9bf332fcfc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:22.504087 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec411bf-f262-4fef-a626-9bf332fcfc6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:22.504703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec411bf-f262-4fef-a626-9bf332fcfc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:22.505166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec411bf-f262-4fef-a626-9bf332fcfc6c admin admin] PATH_INFO: `/v3/users/c06f6bee92f841d893c99c6dac0078fa` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:22.507223 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec411bf-f262-4fef-a626-9bf332fcfc6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c06f6bee92f841d893c99c6dac0078fa)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:22.511035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec411bf-f262-4fef-a626-9bf332fcfc6c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:22.587239 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e61ce-9a7d-4b08-ae95-bca1dff5e729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:22.589222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e61ce-9a7d-4b08-ae95-bca1dff5e729 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:22.589896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e61ce-9a7d-4b08-ae95-bca1dff5e729 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:22.597195 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e61ce-9a7d-4b08-ae95-bca1dff5e729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:22.612361 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2b1e61ce-9a7d-4b08-ae95-bca1dff5e729 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:22.671835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e61ce-9a7d-4b08-ae95-bca1dff5e729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:22.675158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e61ce-9a7d-4b08-ae95-bca1dff5e729 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:22.709765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5ec411bf-f262-4fef-a626-9bf332fcfc6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06f6bee92f841d893c99c6dac0078fa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:22.714709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5ec411bf-f262-4fef-a626-9bf332fcfc6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06f6bee92f841d893c99c6dac0078fa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:22.730525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 911/1817] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 786 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:22.733498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b763c15-e9c0-44ce-828e-3142cf8f8c5a None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:22.734106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b763c15-e9c0-44ce-828e-3142cf8f8c5a None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:22.734815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b763c15-e9c0-44ce-828e-3142cf8f8c5a None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:22.737272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 912/1818] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jul 27 10:50:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:50:22.765969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5ec411bf-f262-4fef-a626-9bf332fcfc6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06f6bee92f841d893c99c6dac0078fa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:22.767310 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5ec411bf-f262-4fef-a626-9bf332fcfc6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06f6bee92f841d893c99c6dac0078fa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:22.783554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5ec411bf-f262-4fef-a626-9bf332fcfc6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06f6bee92f841d893c99c6dac0078fa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:22.860126 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 907/1819] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:22 2022] DELETE /identity/v3/users/c06f6bee92f841d893c99c6dac0078fa => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:23.160558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de294906-7da1-4538-918d-8a4af41568f7 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:23.161285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de294906-7da1-4538-918d-8a4af41568f7 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:23.161773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de294906-7da1-4538-918d-8a4af41568f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:23.218812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-de294906-7da1-4538-918d-8a4af41568f7 None None] MFA Rules not processed for user `3bb16c9232464cc2aeee12b7fa918b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:23.231261 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-de294906-7da1-4538-918d-8a4af41568f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:23.329038 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:23.420610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 913/1820] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jul 27 10:50:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:24.221837 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec411bf-f262-4fef-a626-9bf332fcfc6c admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:24.223683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5ec411bf-f262-4fef-a626-9bf332fcfc6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:24.243072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec411bf-f262-4fef-a626-9bf332fcfc6c admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:24.297266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e0362-ea66-4672-a725-d79544ada140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:24.300616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e0362-ea66-4672-a725-d79544ada140 service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:24.301162 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e0362-ea66-4672-a725-d79544ada140 service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:24.306126 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e0362-ea66-4672-a725-d79544ada140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:24.360473 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e0362-ea66-4672-a725-d79544ada140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:24.366885 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e0362-ea66-4672-a725-d79544ada140 service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:24.383295 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:24.396433 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 908/1821] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:24.568904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de294906-7da1-4538-918d-8a4af41568f7 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:24.571332 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-de294906-7da1-4538-918d-8a4af41568f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:24.898737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de294906-7da1-4538-918d-8a4af41568f7 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:24.906720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3470c-73d6-4c41-ae87-10aa2539dc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:24.908116 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3470c-73d6-4c41-ae87-10aa2539dc51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:24.908788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3470c-73d6-4c41-ae87-10aa2539dc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:24.909914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3470c-73d6-4c41-ae87-10aa2539dc51 admin admin] PATH_INFO: `/v3/projects/fd734c217d654bf1b7f1070374a9705d` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:24.913163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3470c-73d6-4c41-ae87-10aa2539dc51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd734c217d654bf1b7f1070374a9705d)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:24.917069 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3470c-73d6-4c41-ae87-10aa2539dc51 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:25.052756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b4e3470c-73d6-4c41-ae87-10aa2539dc51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd734c217d654bf1b7f1070374a9705d', 'request_id': 'req-b4e3470c-73d6-4c41-ae87-10aa2539dc51'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:25.064305 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b4e3470c-73d6-4c41-ae87-10aa2539dc51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd734c217d654bf1b7f1070374a9705d', 'request_id': 'req-b4e3470c-73d6-4c41-ae87-10aa2539dc51'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:25.072738 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b4e3470c-73d6-4c41-ae87-10aa2539dc51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd734c217d654bf1b7f1070374a9705d', 'request_id': 'req-b4e3470c-73d6-4c41-ae87-10aa2539dc51'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:25.113004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b4e3470c-73d6-4c41-ae87-10aa2539dc51 admin admin] The token cache is being invalidate because project fd734c217d654bf1b7f1070374a9705d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:25.113543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b4e3470c-73d6-4c41-ae87-10aa2539dc51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:25.114780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b4e3470c-73d6-4c41-ae87-10aa2539dc51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:25.142268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 914/1822] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:24 2022] DELETE /identity/v3/projects/fd734c217d654bf1b7f1070374a9705d => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:25.147515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199223f-9199-45c4-bcd6-72eb32f41c7e None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:25.147817 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199223f-9199-45c4-bcd6-72eb32f41c7e None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:25.148395 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199223f-9199-45c4-bcd6-72eb32f41c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:25.223109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-2199223f-9199-45c4-bcd6-72eb32f41c7e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:25.237681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-2199223f-9199-45c4-bcd6-72eb32f41c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:25.398113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 909/1823] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:25.407766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7209-d146-4070-8036-04f375440b85 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:25.408842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7209-d146-4070-8036-04f375440b85 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:25.409736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7209-d146-4070-8036-04f375440b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:25.511483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-d19a7209-d146-4070-8036-04f375440b85 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:25.514326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-d19a7209-d146-4070-8036-04f375440b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:25.551459 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 915/1824] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:25.558039 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199223f-9199-45c4-bcd6-72eb32f41c7e None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:25.582178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199223f-9199-45c4-bcd6-72eb32f41c7e None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:25.634516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9be96-34d1-4fda-813f-a5cdce7e561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:25.635640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9be96-34d1-4fda-813f-a5cdce7e561c admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:25.636175 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9be96-34d1-4fda-813f-a5cdce7e561c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:25.639508 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9be96-34d1-4fda-813f-a5cdce7e561c admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:25.644494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9be96-34d1-4fda-813f-a5cdce7e561c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:25.647974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9be96-34d1-4fda-813f-a5cdce7e561c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:25.652829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9be96-34d1-4fda-813f-a5cdce7e561c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:25.721125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a7209-d146-4070-8036-04f375440b85 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:25.728995 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 910/1825] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:25.732791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9be96-34d1-4fda-813f-a5cdce7e561c admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:25.737542 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e3b9be96-34d1-4fda-813f-a5cdce7e561c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:25.749306 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a7209-d146-4070-8036-04f375440b85 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:25.757047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2bd65-e2e3-4527-89b5-9c32ee522dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:25.757982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2bd65-e2e3-4527-89b5-9c32ee522dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:25.758466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2bd65-e2e3-4527-89b5-9c32ee522dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:25.758899 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2bd65-e2e3-4527-89b5-9c32ee522dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:25.760101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2bd65-e2e3-4527-89b5-9c32ee522dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:25.771147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2bd65-e2e3-4527-89b5-9c32ee522dc5 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:25.774951 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9be96-34d1-4fda-813f-a5cdce7e561c admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:25.785056 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6156de8-9f58-4d97-a399-bb88fbdfb929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:25.785963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6156de8-9f58-4d97-a399-bb88fbdfb929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:25.786830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6156de8-9f58-4d97-a399-bb88fbdfb929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:25.787546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6156de8-9f58-4d97-a399-bb88fbdfb929 admin admin] PATH_INFO: `/v3/projects/c8bb6a59a44b4ee082d509594a21aa35` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:25.789595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6156de8-9f58-4d97-a399-bb88fbdfb929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8bb6a59a44b4ee082d509594a21aa35)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:25.793110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6156de8-9f58-4d97-a399-bb88fbdfb929 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:25.846731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 916/1826] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:25 2022] POST /identity/v3/projects => generated 393 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:25.848913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2bd65-e2e3-4527-89b5-9c32ee522dc5 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:25.943804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e6156de8-9f58-4d97-a399-bb88fbdfb929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8bb6a59a44b4ee082d509594a21aa35', 'request_id': 'req-e6156de8-9f58-4d97-a399-bb88fbdfb929'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:25.945257 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:25.977884 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e6156de8-9f58-4d97-a399-bb88fbdfb929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8bb6a59a44b4ee082d509594a21aa35', 'request_id': 'req-e6156de8-9f58-4d97-a399-bb88fbdfb929'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:25.995711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e6156de8-9f58-4d97-a399-bb88fbdfb929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8bb6a59a44b4ee082d509594a21aa35', 'request_id': 'req-e6156de8-9f58-4d97-a399-bb88fbdfb929'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:26.027676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e6156de8-9f58-4d97-a399-bb88fbdfb929 admin admin] The token cache is being invalidate because project c8bb6a59a44b4ee082d509594a21aa35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:26.027676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e6156de8-9f58-4d97-a399-bb88fbdfb929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:26.030804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e6156de8-9f58-4d97-a399-bb88fbdfb929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:26.034796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2bd65-e2e3-4527-89b5-9c32ee522dc5 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:26.042835 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 911/1827] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:25 2022] DELETE /identity/v3/projects/c8bb6a59a44b4ee082d509594a21aa35 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:26.056659 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a8442-990b-4107-8b77-f6b1033513bb None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:26.057011 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a8442-990b-4107-8b77-f6b1033513bb None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:26.057398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a8442-990b-4107-8b77-f6b1033513bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:26.147498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-a69a8442-990b-4107-8b77-f6b1033513bb None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:26.149046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a69a8442-990b-4107-8b77-f6b1033513bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:26.260068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20588a67-0e9b-49d6-baa6-b9298e4cd2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:26.265341 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20588a67-0e9b-49d6-baa6-b9298e4cd2df admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:26.266739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20588a67-0e9b-49d6-baa6-b9298e4cd2df admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:26.267293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20588a67-0e9b-49d6-baa6-b9298e4cd2df admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:26.272327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20588a67-0e9b-49d6-baa6-b9298e4cd2df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:26.280793 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20588a67-0e9b-49d6-baa6-b9298e4cd2df admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:26.371143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 912/1828] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:26.382891 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bc63d-9bdf-4d1e-b900-830409ec121f None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:26.383683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bc63d-9bdf-4d1e-b900-830409ec121f None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:26.384367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bc63d-9bdf-4d1e-b900-830409ec121f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:26.417310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 917/1829] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:25 2022] POST /identity/v3/users => generated 297 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:26.420206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20588a67-0e9b-49d6-baa6-b9298e4cd2df admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:26.429068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-20588a67-0e9b-49d6-baa6-b9298e4cd2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:26.463168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-9d9bc63d-9bdf-4d1e-b900-830409ec121f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:26.470850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-9d9bc63d-9bdf-4d1e-b900-830409ec121f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:26.501906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20588a67-0e9b-49d6-baa6-b9298e4cd2df admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:26.518999 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 913/1830] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:26.520476 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bc63d-9bdf-4d1e-b900-830409ec121f None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:26.529285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff731c-eb40-44f3-875f-d2342c7e567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:26.530482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff731c-eb40-44f3-875f-d2342c7e567f admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:26.531075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff731c-eb40-44f3-875f-d2342c7e567f admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:26.531569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff731c-eb40-44f3-875f-d2342c7e567f admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:26.532962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff731c-eb40-44f3-875f-d2342c7e567f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:26.541770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff731c-eb40-44f3-875f-d2342c7e567f admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:26.543854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:26.561433 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bc63d-9bdf-4d1e-b900-830409ec121f None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:26.577536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cea9d8-2878-43b6-9942-db365e6b4abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:26.578624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cea9d8-2878-43b6-9942-db365e6b4abd admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:26.579130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cea9d8-2878-43b6-9942-db365e6b4abd admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:26.579585 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cea9d8-2878-43b6-9942-db365e6b4abd admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:26.580676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cea9d8-2878-43b6-9942-db365e6b4abd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:26.580993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cea9d8-2878-43b6-9942-db365e6b4abd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:26.588101 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cea9d8-2878-43b6-9942-db365e6b4abd admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:26.612463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 918/1831] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:26.616810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff731c-eb40-44f3-875f-d2342c7e567f admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:26.620998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 914/1832] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:26.627443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cea9d8-2878-43b6-9942-db365e6b4abd admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:26.648919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff731c-eb40-44f3-875f-d2342c7e567f admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:26.659394 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c7009-b1ae-48f7-9b91-42649674fbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:26.660172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c7009-b1ae-48f7-9b91-42649674fbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:26.660463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c7009-b1ae-48f7-9b91-42649674fbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:26.660737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c7009-b1ae-48f7-9b91-42649674fbc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:26.661952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c7009-b1ae-48f7-9b91-42649674fbc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:26.664225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c7009-b1ae-48f7-9b91-42649674fbc8 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:26.673305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cea9d8-2878-43b6-9942-db365e6b4abd admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:26.693799 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 919/1833] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:26.694022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac25e7-0033-4140-9b0a-1b7cc63bc4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:26.694474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac25e7-0033-4140-9b0a-1b7cc63bc4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:26.694768 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac25e7-0033-4140-9b0a-1b7cc63bc4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:26.695044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac25e7-0033-4140-9b0a-1b7cc63bc4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:26.695729 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac25e7-0033-4140-9b0a-1b7cc63bc4e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:26.698271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac25e7-0033-4140-9b0a-1b7cc63bc4e1 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:26.698489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c7009-b1ae-48f7-9b91-42649674fbc8 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:26.731630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c7009-b1ae-48f7-9b91-42649674fbc8 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:26.749207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8b1b1-41c4-45a8-9310-713b539d721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:26.750145 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b1b1-41c4-45a8-9310-713b539d721d admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:26.750609 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b1b1-41c4-45a8-9310-713b539d721d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:26.751034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b1b1-41c4-45a8-9310-713b539d721d admin admin] PATH_INFO: `/v3/projects/06fabaa510594f9192e35cf11ada9de5/users/c29a3635e5da444c81921aeac6e86bda/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:26.787001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 915/1834] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:26 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:26.789454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac25e7-0033-4140-9b0a-1b7cc63bc4e1 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:26.820175 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8b1b1-41c4-45a8-9310-713b539d721d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06fabaa510594f9192e35cf11ada9de5, user_id=c29a3635e5da444c81921aeac6e86bda, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:26.827480 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8b1b1-41c4-45a8-9310-713b539d721d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:26.877473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 920/1835] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:26 2022] PUT /identity/v3/projects/06fabaa510594f9192e35cf11ada9de5/users/c29a3635e5da444c81921aeac6e86bda/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:26.889098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2635ec-4a80-4cbc-bdd2-6a0f4ef58a98 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:26.889481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2635ec-4a80-4cbc-bdd2-6a0f4ef58a98 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:26.895991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2635ec-4a80-4cbc-bdd2-6a0f4ef58a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:26.936739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-0a2635ec-4a80-4cbc-bdd2-6a0f4ef58a98 None None] MFA Rules not processed for user `c29a3635e5da444c81921aeac6e86bda`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:26.939200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0a2635ec-4a80-4cbc-bdd2-6a0f4ef58a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:27.001121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac25e7-0033-4140-9b0a-1b7cc63bc4e1 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:27.088063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 921/1836] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:27.095263 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2635ec-4a80-4cbc-bdd2-6a0f4ef58a98 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:27.115193 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:27.152911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d83f20-9d33-4038-928d-cacebfe37a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:27.154838 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d83f20-9d33-4038-928d-cacebfe37a54 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:27.155558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d83f20-9d33-4038-928d-cacebfe37a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:27.156224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d83f20-9d33-4038-928d-cacebfe37a54 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:27.157616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d83f20-9d33-4038-928d-cacebfe37a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:27.160632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d83f20-9d33-4038-928d-cacebfe37a54 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:27.222039 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 916/1837] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:26 2022] POST /identity/v3/users => generated 291 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:27.222039 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d83f20-9d33-4038-928d-cacebfe37a54 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:27.225337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-75d83f20-9d33-4038-928d-cacebfe37a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:27.251474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d83f20-9d33-4038-928d-cacebfe37a54 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:27.264367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:27.265447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:27.265930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:27.266450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] PATH_INFO: `/v3/projects/eefe6fbc57b64971aab1faf6c5d68c56` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:27.275596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eefe6fbc57b64971aab1faf6c5d68c56)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:27.280508 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:27.293498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2635ec-4a80-4cbc-bdd2-6a0f4ef58a98 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:27.331847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aac526-4dd6-4ede-9953-69408d8993e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:27.332662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aac526-4dd6-4ede-9953-69408d8993e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:27.333111 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aac526-4dd6-4ede-9953-69408d8993e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:27.333498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aac526-4dd6-4ede-9953-69408d8993e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:27.334399 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aac526-4dd6-4ede-9953-69408d8993e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:27.336524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aac526-4dd6-4ede-9953-69408d8993e2 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:27.410812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 922/1838] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:27 2022] POST /identity/v3/projects => generated 393 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:27.411945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aac526-4dd6-4ede-9953-69408d8993e2 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:27.427876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eefe6fbc57b64971aab1faf6c5d68c56', 'request_id': 'req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:27.448751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eefe6fbc57b64971aab1faf6c5d68c56', 'request_id': 'req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:27.468021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eefe6fbc57b64971aab1faf6c5d68c56', 'request_id': 'req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:27.475268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:27.511361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] The token cache is being invalidate because project eefe6fbc57b64971aab1faf6c5d68c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:27.511653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:27.512295 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:27.514241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 917/1839] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:27 2022] DELETE /identity/v3/projects/eefe6fbc57b64971aab1faf6c5d68c56 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:27.517894 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:27.519085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:27.539460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aac526-4dd6-4ede-9953-69408d8993e2 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:27.545831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62e174-a732-4fca-880d-dae917cfe4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:27.546639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62e174-a732-4fca-880d-dae917cfe4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:27.546918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62e174-a732-4fca-880d-dae917cfe4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:27.547226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62e174-a732-4fca-880d-dae917cfe4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:27.547942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62e174-a732-4fca-880d-dae917cfe4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:27.549670 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62e174-a732-4fca-880d-dae917cfe4a8 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:27.566282 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 923/1840] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:27.570870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62e174-a732-4fca-880d-dae917cfe4a8 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:27.572653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ac62e174-a732-4fca-880d-dae917cfe4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:27.589168 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62e174-a732-4fca-880d-dae917cfe4a8 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:27.595436 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e5efc-4e6a-4581-a128-c096fb361f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:27.596108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e5efc-4e6a-4581-a128-c096fb361f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:27.596425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e5efc-4e6a-4581-a128-c096fb361f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:27.596841 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e5efc-4e6a-4581-a128-c096fb361f0f admin admin] PATH_INFO: `/v3/users/48317468eb2e40b0a9630db979e06bb9` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:27.598106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e5efc-4e6a-4581-a128-c096fb361f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=48317468eb2e40b0a9630db979e06bb9)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:27.600211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e5efc-4e6a-4581-a128-c096fb361f0f admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:27.661114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2ba7c-6ede-4b41-afc1-e2a522abff17 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:27.671069 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3f6e5efc-4e6a-4581-a128-c096fb361f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48317468eb2e40b0a9630db979e06bb9'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:27.671311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91be01-9551-4ba9-bd02-a1787c4cbf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:27.671961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3f6e5efc-4e6a-4581-a128-c096fb361f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48317468eb2e40b0a9630db979e06bb9'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:27.672143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91be01-9551-4ba9-bd02-a1787c4cbf86 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:27.672604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91be01-9551-4ba9-bd02-a1787c4cbf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:27.676582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91be01-9551-4ba9-bd02-a1787c4cbf86 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:27.676582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91be01-9551-4ba9-bd02-a1787c4cbf86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:27.678434 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91be01-9551-4ba9-bd02-a1787c4cbf86 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:27.690866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3f6e5efc-4e6a-4581-a128-c096fb361f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48317468eb2e40b0a9630db979e06bb9'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:27.704558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3f6e5efc-4e6a-4581-a128-c096fb361f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48317468eb2e40b0a9630db979e06bb9'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:27.705424 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3f6e5efc-4e6a-4581-a128-c096fb361f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48317468eb2e40b0a9630db979e06bb9'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:27.713144 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 918/1841] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:27 2022] POST /identity/v3/users => generated 303 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:27.718270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91be01-9551-4ba9-bd02-a1787c4cbf86 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:27.720456 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-be91be01-9551-4ba9-bd02-a1787c4cbf86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:27.732083 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:27.737800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 924/1842] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:27 2022] DELETE /identity/v3/users/48317468eb2e40b0a9630db979e06bb9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:27.739147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e5efc-4e6a-4581-a128-c096fb361f0f admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:27.740544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91be01-9551-4ba9-bd02-a1787c4cbf86 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:27.756977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3f6e5efc-4e6a-4581-a128-c096fb361f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:27.842897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b394b7-e59e-40d5-b88d-75ef8bf93c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:27.843632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b394b7-e59e-40d5-b88d-75ef8bf93c54 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:27.843955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b394b7-e59e-40d5-b88d-75ef8bf93c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:27.845175 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b394b7-e59e-40d5-b88d-75ef8bf93c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:27.846465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b394b7-e59e-40d5-b88d-75ef8bf93c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:27.848288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b394b7-e59e-40d5-b88d-75ef8bf93c54 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:27.863239 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 919/1843] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:27.869212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b394b7-e59e-40d5-b88d-75ef8bf93c54 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:27.884022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b394b7-e59e-40d5-b88d-75ef8bf93c54 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:27.892307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5eed6-90ba-4608-bbd3-6e45c9f85fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:27.893015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5eed6-90ba-4608-bbd3-6e45c9f85fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:27.893299 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5eed6-90ba-4608-bbd3-6e45c9f85fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:27.893577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5eed6-90ba-4608-bbd3-6e45c9f85fd0 admin admin] PATH_INFO: `/v3/projects/513f42a037304b998eb040edd7967aea/users/949e9797427340d6b9857f271f40a95c/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:27.914357 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5eed6-90ba-4608-bbd3-6e45c9f85fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513f42a037304b998eb040edd7967aea, user_id=949e9797427340d6b9857f271f40a95c, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:27.915214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e5efc-4e6a-4581-a128-c096fb361f0f admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:27.918727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5eed6-90ba-4608-bbd3-6e45c9f85fd0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:27.922162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeb7b9-bc00-4bf0-8fa9-c075104c6020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:27.922851 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeb7b9-bc00-4bf0-8fa9-c075104c6020 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:27.923325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeb7b9-bc00-4bf0-8fa9-c075104c6020 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:27.923614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeb7b9-bc00-4bf0-8fa9-c075104c6020 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:27.924479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfeb7b9-bc00-4bf0-8fa9-c075104c6020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:27.928168 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfeb7b9-bc00-4bf0-8fa9-c075104c6020 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:27.945601 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 925/1844] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:27.945864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 920/1845] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:27 2022] PUT /identity/v3/projects/513f42a037304b998eb040edd7967aea/users/949e9797427340d6b9857f271f40a95c/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:27.955375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeb7b9-bc00-4bf0-8fa9-c075104c6020 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:27.962312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6b7dd-bccd-4f91-b6ae-0862629fa3b3 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:27.963114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6b7dd-bccd-4f91-b6ae-0862629fa3b3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:27.964487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6b7dd-bccd-4f91-b6ae-0862629fa3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:27.973953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeb7b9-bc00-4bf0-8fa9-c075104c6020 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:28.047590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-cfa6b7dd-bccd-4f91-b6ae-0862629fa3b3 None None] MFA Rules not processed for user `949e9797427340d6b9857f271f40a95c`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:28.049200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-cfa6b7dd-bccd-4f91-b6ae-0862629fa3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:28.120762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:28.163695 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 921/1846] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:28.172978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6b7dd-bccd-4f91-b6ae-0862629fa3b3 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:28.176625 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f1135-e3b9-4e63-9432-b77ec312acb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:28.177655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f1135-e3b9-4e63-9432-b77ec312acb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:28.177811 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f1135-e3b9-4e63-9432-b77ec312acb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:28.178027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f1135-e3b9-4e63-9432-b77ec312acb3 admin admin] PATH_INFO: `/v3/projects/7ad055c2e9d642c88dc6559e37c34659/users/9178e76e9429491c996f93d8e9b610fa/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:28.199579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f1135-e3b9-4e63-9432-b77ec312acb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad055c2e9d642c88dc6559e37c34659, user_id=9178e76e9429491c996f93d8e9b610fa, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:28.206605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6b7dd-bccd-4f91-b6ae-0862629fa3b3 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:28.211164 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f1135-e3b9-4e63-9432-b77ec312acb3 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:28.215429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b8baa-60ce-4e48-bc2e-b98a70785821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:28.216540 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b8baa-60ce-4e48-bc2e-b98a70785821 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:28.216978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b8baa-60ce-4e48-bc2e-b98a70785821 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:28.217413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b8baa-60ce-4e48-bc2e-b98a70785821 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:28.218321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b8baa-60ce-4e48-bc2e-b98a70785821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:28.222627 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b8baa-60ce-4e48-bc2e-b98a70785821 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:28.241522 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 926/1847] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:27 2022] PUT /identity/v3/projects/7ad055c2e9d642c88dc6559e37c34659/users/9178e76e9429491c996f93d8e9b610fa/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:28.245777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f1135-e3b9-4e63-9432-b77ec312acb3 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:28.288912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 922/1848] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:28 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:28.289971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b8baa-60ce-4e48-bc2e-b98a70785821 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:28.294132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b99b8baa-60ce-4e48-bc2e-b98a70785821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:28.376029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f1135-e3b9-4e63-9432-b77ec312acb3 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:28.453290 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:28.465780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b8baa-60ce-4e48-bc2e-b98a70785821 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:28.477748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:28.490217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:28.490217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:28.490217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] PATH_INFO: `/v3/projects/725209dd77784e0f8e106eb41a187da1` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:28.490217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] RBAC: Authorizing `identity:delete_project(project_id=725209dd77784e0f8e106eb41a187da1)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:28.490217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:28.515025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b85cd0-e336-4269-b646-d1cf19f3a7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:28.515824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85cd0-e336-4269-b646-d1cf19f3a7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:28.516406 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85cd0-e336-4269-b646-d1cf19f3a7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:28.516971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b85cd0-e336-4269-b646-d1cf19f3a7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:28.517868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b85cd0-e336-4269-b646-d1cf19f3a7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:28.521283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b85cd0-e336-4269-b646-d1cf19f3a7e9 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:28.542263 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 927/1849] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:28.542263 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b85cd0-e336-4269-b646-d1cf19f3a7e9 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:28.566455 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b85cd0-e336-4269-b646-d1cf19f3a7e9 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:28.593386 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '725209dd77784e0f8e106eb41a187da1', 'request_id': 'req-8cea2f2e-3024-42c4-8906-2ff218b0b32d'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:28.604967 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '725209dd77784e0f8e106eb41a187da1', 'request_id': 'req-8cea2f2e-3024-42c4-8906-2ff218b0b32d'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:28.619100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '725209dd77784e0f8e106eb41a187da1', 'request_id': 'req-8cea2f2e-3024-42c4-8906-2ff218b0b32d'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:28.648381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] The token cache is being invalidate because project 725209dd77784e0f8e106eb41a187da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:28.648673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:28.650429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:28.658740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 923/1850] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:28 2022] DELETE /identity/v3/projects/725209dd77784e0f8e106eb41a187da1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:28.660304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:28.665088 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:28.690524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a053c-a5f6-404f-9d32-609d4a446798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:28.691420 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a053c-a5f6-404f-9d32-609d4a446798 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:28.691962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a053c-a5f6-404f-9d32-609d4a446798 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:28.692483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a053c-a5f6-404f-9d32-609d4a446798 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:28.693552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a053c-a5f6-404f-9d32-609d4a446798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:28.697145 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a053c-a5f6-404f-9d32-609d4a446798 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:28.730268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 928/1851] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:28 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:28.732179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5952c1-322f-4f40-897a-8ed205e33309 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:28.733597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5952c1-322f-4f40-897a-8ed205e33309 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:28.733597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5952c1-322f-4f40-897a-8ed205e33309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:28.744113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:28.759131 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-0c5952c1-322f-4f40-897a-8ed205e33309 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:28.761364 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0c5952c1-322f-4f40-897a-8ed205e33309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:28.766100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea2f2e-3024-42c4-8906-2ff218b0b32d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:28.770983 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6049c3c-4cda-477a-bb9e-88c90f20f64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:28.771676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6049c3c-4cda-477a-bb9e-88c90f20f64d admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:28.771951 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6049c3c-4cda-477a-bb9e-88c90f20f64d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:28.772373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 929/1852] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:28.772866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6049c3c-4cda-477a-bb9e-88c90f20f64d admin admin] PATH_INFO: `/v3/projects/7ad055c2e9d642c88dc6559e37c34659/users/9178e76e9429491c996f93d8e9b610fa/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:28.773220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5952c1-322f-4f40-897a-8ed205e33309 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:28.774911 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0c5952c1-322f-4f40-897a-8ed205e33309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:28.775081 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6049c3c-4cda-477a-bb9e-88c90f20f64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad055c2e9d642c88dc6559e37c34659, user_id=9178e76e9429491c996f93d8e9b610fa, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:28.778826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6049c3c-4cda-477a-bb9e-88c90f20f64d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:28.793206 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 924/1853] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:28 2022] PUT /identity/v3/projects/7ad055c2e9d642c88dc6559e37c34659/users/9178e76e9429491c996f93d8e9b610fa/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:28.794304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd99f12-18e0-40d2-a95f-2741a4e8eca8 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:28.794592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd99f12-18e0-40d2-a95f-2741a4e8eca8 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:28.795016 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd99f12-18e0-40d2-a95f-2741a4e8eca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:28.799835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5952c1-322f-4f40-897a-8ed205e33309 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:28.830081 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-8fd99f12-18e0-40d2-a95f-2741a4e8eca8 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:28.831366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-8fd99f12-18e0-40d2-a95f-2741a4e8eca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:28.882937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c6431-c851-4cdd-8682-6de74ec406a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:28.883663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c6431-c851-4cdd-8682-6de74ec406a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:28.883912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c6431-c851-4cdd-8682-6de74ec406a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:28.884293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c6431-c851-4cdd-8682-6de74ec406a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:28.885057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c6431-c851-4cdd-8682-6de74ec406a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:28.888747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c6431-c851-4cdd-8682-6de74ec406a6 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:28.899642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 930/1854] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:28.901140 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604bb02-e0bb-4e79-abdd-682aec561a7b None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:28.901394 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604bb02-e0bb-4e79-abdd-682aec561a7b None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:28.901648 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604bb02-e0bb-4e79-abdd-682aec561a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:28.917672 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 925/1855] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:28.918656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd99f12-18e0-40d2-a95f-2741a4e8eca8 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:28.929569 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd99f12-18e0-40d2-a95f-2741a4e8eca8 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:28.938970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d36e3-7807-4acb-b738-61b5f704d021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:28.939684 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d36e3-7807-4acb-b738-61b5f704d021 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:28.939973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-3604bb02-e0bb-4e79-abdd-682aec561a7b None None] MFA Rules not processed for user `9178e76e9429491c996f93d8e9b610fa`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:28.940151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d36e3-7807-4acb-b738-61b5f704d021 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:28.940282 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d36e3-7807-4acb-b738-61b5f704d021 admin admin] PATH_INFO: `/v3/projects/820641714c724b6cb77744506f936290/users/3e5f46de930d4449b339902c7a539985/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:28.941473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3604bb02-e0bb-4e79-abdd-682aec561a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:28.959725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d36e3-7807-4acb-b738-61b5f704d021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=820641714c724b6cb77744506f936290, user_id=3e5f46de930d4449b339902c7a539985, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:28.964480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d36e3-7807-4acb-b738-61b5f704d021 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:28.986250 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:28.991673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 926/1856] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:28 2022] PUT /identity/v3/projects/820641714c724b6cb77744506f936290/users/3e5f46de930d4449b339902c7a539985/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:28.993136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d36e3-7807-4acb-b738-61b5f704d021 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:29.046462 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 931/1857] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:29.047543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604bb02-e0bb-4e79-abdd-682aec561a7b None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:29.060909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604bb02-e0bb-4e79-abdd-682aec561a7b None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:29.077885 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d36e3-7807-4acb-b738-61b5f704d021 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:29.084056 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7603a83-abd8-4d86-b1ad-27ea158065a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:29.086294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7603a83-abd8-4d86-b1ad-27ea158065a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:29.086294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7603a83-abd8-4d86-b1ad-27ea158065a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:29.086294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7603a83-abd8-4d86-b1ad-27ea158065a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:29.087259 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7603a83-abd8-4d86-b1ad-27ea158065a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:29.087759 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7603a83-abd8-4d86-b1ad-27ea158065a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:29.090964 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7603a83-abd8-4d86-b1ad-27ea158065a1 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:29.107324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 927/1858] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:29.112726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7603a83-abd8-4d86-b1ad-27ea158065a1 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:29.112726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f7603a83-abd8-4d86-b1ad-27ea158065a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:29.160728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706633c5-c21c-4d96-af71-fc852573f439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:29.161468 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706633c5-c21c-4d96-af71-fc852573f439 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:29.162169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706633c5-c21c-4d96-af71-fc852573f439 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:29.162799 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706633c5-c21c-4d96-af71-fc852573f439 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:29.163665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706633c5-c21c-4d96-af71-fc852573f439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:29.165481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706633c5-c21c-4d96-af71-fc852573f439 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:29.181074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 932/1859] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:29.181074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706633c5-c21c-4d96-af71-fc852573f439 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:29.190458 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7603a83-abd8-4d86-b1ad-27ea158065a1 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:29.193661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706633c5-c21c-4d96-af71-fc852573f439 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:29.195040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03640372-11af-4c52-af34-cb56d74af1c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:29.195681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03640372-11af-4c52-af34-cb56d74af1c6 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:29.196022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03640372-11af-4c52-af34-cb56d74af1c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:29.196265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03640372-11af-4c52-af34-cb56d74af1c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:29.201147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfdd48-68f2-47bb-a5f7-ac6d30b21bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:29.201886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfdd48-68f2-47bb-a5f7-ac6d30b21bba admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:29.202351 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfdd48-68f2-47bb-a5f7-ac6d30b21bba admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:29.202709 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfdd48-68f2-47bb-a5f7-ac6d30b21bba admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:29.203467 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfdd48-68f2-47bb-a5f7-ac6d30b21bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:29.205513 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfdd48-68f2-47bb-a5f7-ac6d30b21bba admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:29.206970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:29.255237 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 933/1860] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:29 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:29.256201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfdd48-68f2-47bb-a5f7-ac6d30b21bba admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:29.350820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03640372-11af-4c52-af34-cb56d74af1c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:29.352644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03640372-11af-4c52-af34-cb56d74af1c6 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:29.362384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfdd48-68f2-47bb-a5f7-ac6d30b21bba admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:29.368103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b7f16-8a59-4acb-9791-38e72a0af15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:29.368796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b7f16-8a59-4acb-9791-38e72a0af15d admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:29.370429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b7f16-8a59-4acb-9791-38e72a0af15d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:29.370569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b7f16-8a59-4acb-9791-38e72a0af15d admin admin] PATH_INFO: `/v3/projects/820641714c724b6cb77744506f936290/users/3e5f46de930d4449b339902c7a539985/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:29.370649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 928/1861] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:29.372515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03640372-11af-4c52-af34-cb56d74af1c6 service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:29.379700 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b7f16-8a59-4acb-9791-38e72a0af15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=820641714c724b6cb77744506f936290, user_id=3e5f46de930d4449b339902c7a539985, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:29.386997 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b7f16-8a59-4acb-9791-38e72a0af15d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:29.387500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03640372-11af-4c52-af34-cb56d74af1c6 service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:29.395621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c2a4b-d7a9-437e-a27a-fd7d7365a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:29.396581 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c2a4b-d7a9-437e-a27a-fd7d7365a59e admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:29.396902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c2a4b-d7a9-437e-a27a-fd7d7365a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:29.397184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c2a4b-d7a9-437e-a27a-fd7d7365a59e admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:29.398498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c2a4b-d7a9-437e-a27a-fd7d7365a59e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:29.404617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c2a4b-d7a9-437e-a27a-fd7d7365a59e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:29.408803 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 934/1862] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:29 2022] PUT /identity/v3/projects/820641714c724b6cb77744506f936290/users/3e5f46de930d4449b339902c7a539985/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:29.427726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16f486-8f54-45fb-b66b-65d6e08a4956 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:29.428179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16f486-8f54-45fb-b66b-65d6e08a4956 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:29.428601 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16f486-8f54-45fb-b66b-65d6e08a4956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:29.459745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 929/1863] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:29 2022] POST /identity/v3/users => generated 292 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:29.469265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c2a4b-d7a9-437e-a27a-fd7d7365a59e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:29.472833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-2f1c2a4b-d7a9-437e-a27a-fd7d7365a59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:29.574352 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-ca16f486-8f54-45fb-b66b-65d6e08a4956 None None] MFA Rules not processed for user `3e5f46de930d4449b339902c7a539985`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:29.579325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ca16f486-8f54-45fb-b66b-65d6e08a4956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:29.648454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c2a4b-d7a9-437e-a27a-fd7d7365a59e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:29.648818 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:29.748441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 935/1864] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:29.754590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16f486-8f54-45fb-b66b-65d6e08a4956 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:29.796738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fbc52-72ea-4681-b9fe-d5ac2c72e49a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:29.797512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fbc52-72ea-4681-b9fe-d5ac2c72e49a service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:29.797932 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fbc52-72ea-4681-b9fe-d5ac2c72e49a service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:29.798345 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fbc52-72ea-4681-b9fe-d5ac2c72e49a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:29.800446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-763fbc52-72ea-4681-b9fe-d5ac2c72e49a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:29.876845 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16f486-8f54-45fb-b66b-65d6e08a4956 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:29.884113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfd3d3-d2cb-4bc4-977d-50863d38aff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:29.885169 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfd3d3-d2cb-4bc4-977d-50863d38aff6 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:29.886676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfd3d3-d2cb-4bc4-977d-50863d38aff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:29.887252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfd3d3-d2cb-4bc4-977d-50863d38aff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:29.888384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfd3d3-d2cb-4bc4-977d-50863d38aff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:29.893393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfd3d3-d2cb-4bc4-977d-50863d38aff6 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:29.902316 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:29.911582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fbc52-72ea-4681-b9fe-d5ac2c72e49a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:29.914814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fbc52-72ea-4681-b9fe-d5ac2c72e49a service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:29.919028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 936/1865] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:29.920414 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfd3d3-d2cb-4bc4-977d-50863d38aff6 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:29.929523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 930/1866] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:29.931220 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fbc52-72ea-4681-b9fe-d5ac2c72e49a service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:29.938483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfd3d3-d2cb-4bc4-977d-50863d38aff6 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:29.949402 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5802635-d6af-433e-9b08-24ee24a63867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:29.950481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5802635-d6af-433e-9b08-24ee24a63867 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:29.950908 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5802635-d6af-433e-9b08-24ee24a63867 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:29.951317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5802635-d6af-433e-9b08-24ee24a63867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:29.955996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fbc52-72ea-4681-b9fe-d5ac2c72e49a service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:29.961516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb77944-414f-45cb-8b0c-3ccae89be0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:29.962161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb77944-414f-45cb-8b0c-3ccae89be0bb admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:29.962501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb77944-414f-45cb-8b0c-3ccae89be0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:29.962781 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb77944-414f-45cb-8b0c-3ccae89be0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:29.964248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb77944-414f-45cb-8b0c-3ccae89be0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:29.966541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb77944-414f-45cb-8b0c-3ccae89be0bb admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:29.977938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5802635-d6af-433e-9b08-24ee24a63867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:29.979610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5802635-d6af-433e-9b08-24ee24a63867 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:29.992258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 931/1867] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:29.992577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 937/1868] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:29.996885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5802635-d6af-433e-9b08-24ee24a63867 service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:30.013152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5802635-d6af-433e-9b08-24ee24a63867 service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:30.020387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4be26-9cf7-4272-a80a-08e627956bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:30.021238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4be26-9cf7-4272-a80a-08e627956bea admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:30.021742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4be26-9cf7-4272-a80a-08e627956bea admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:30.022426 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4be26-9cf7-4272-a80a-08e627956bea admin admin] PATH_INFO: `/v3/projects/c693aba537324fb2ab027dde9bd46fae/users/68cfeacb0c514b89a7cbb33ca353bd05/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:30.057951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4be26-9cf7-4272-a80a-08e627956bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c693aba537324fb2ab027dde9bd46fae, user_id=68cfeacb0c514b89a7cbb33ca353bd05, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:30.066366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4be26-9cf7-4272-a80a-08e627956bea admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:30.091826 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 938/1869] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:29 2022] PUT /identity/v3/projects/c693aba537324fb2ab027dde9bd46fae/users/68cfeacb0c514b89a7cbb33ca353bd05/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:30.111592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd232166-a0c6-48cc-a49a-0cdfb967a3c8 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:30.112290 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd232166-a0c6-48cc-a49a-0cdfb967a3c8 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:30.112849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd232166-a0c6-48cc-a49a-0cdfb967a3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:30.192496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-fd232166-a0c6-48cc-a49a-0cdfb967a3c8 None None] MFA Rules not processed for user `68cfeacb0c514b89a7cbb33ca353bd05`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:30.195791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-fd232166-a0c6-48cc-a49a-0cdfb967a3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:30.421336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 932/1870] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:30.422274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4be26-9cf7-4272-a80a-08e627956bea admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:30.573186 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4be26-9cf7-4272-a80a-08e627956bea admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:30.591570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a095a9-b9e1-4c31-ba77-3f784393d6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:30.592235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a095a9-b9e1-4c31-ba77-3f784393d6ae admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:30.592532 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a095a9-b9e1-4c31-ba77-3f784393d6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:30.593076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a095a9-b9e1-4c31-ba77-3f784393d6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:30.593515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a095a9-b9e1-4c31-ba77-3f784393d6ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:30.595762 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a095a9-b9e1-4c31-ba77-3f784393d6ae admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:30.678810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 939/1871] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:30 2022] POST /identity/v3/projects => generated 383 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:30.680718 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd232166-a0c6-48cc-a49a-0cdfb967a3c8 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:30.702017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd232166-a0c6-48cc-a49a-0cdfb967a3c8 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:30.851503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd430fa4-e33b-4856-9877-a1a8b36d9af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:30.853394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd430fa4-e33b-4856-9877-a1a8b36d9af5 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:30.855248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd430fa4-e33b-4856-9877-a1a8b36d9af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:30.855695 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd430fa4-e33b-4856-9877-a1a8b36d9af5 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:30.856487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd430fa4-e33b-4856-9877-a1a8b36d9af5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:30.859294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd430fa4-e33b-4856-9877-a1a8b36d9af5 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:30.900643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a095a9-b9e1-4c31-ba77-3f784393d6ae admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:30.903778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-14a095a9-b9e1-4c31-ba77-3f784393d6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:30.917983 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 933/1872] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:30 2022] POST /identity/v3/users => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:30.918260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:30.919991 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd430fa4-e33b-4856-9877-a1a8b36d9af5 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:30.920931 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a095a9-b9e1-4c31-ba77-3f784393d6ae admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:30.928224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28397174-7c72-4fea-9c75-8c82a0bbe0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:30.929264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28397174-7c72-4fea-9c75-8c82a0bbe0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:30.934067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28397174-7c72-4fea-9c75-8c82a0bbe0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:30.934067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28397174-7c72-4fea-9c75-8c82a0bbe0bf admin admin] PATH_INFO: `/v3/users/aa0ae66f776944d580e2331684c72523` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:30.943733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28397174-7c72-4fea-9c75-8c82a0bbe0bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0ae66f776944d580e2331684c72523)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:30.946064 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28397174-7c72-4fea-9c75-8c82a0bbe0bf admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:30.948976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd430fa4-e33b-4856-9877-a1a8b36d9af5 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:30.962263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3d46c-e705-4071-9105-b8c07d755b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:30.965527 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3d46c-e705-4071-9105-b8c07d755b09 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:30.966589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3d46c-e705-4071-9105-b8c07d755b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:30.967777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3d46c-e705-4071-9105-b8c07d755b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:30.969740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3d46c-e705-4071-9105-b8c07d755b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:30.976299 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3d46c-e705-4071-9105-b8c07d755b09 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:31.005697 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 934/1873] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:31.007525 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3d46c-e705-4071-9105-b8c07d755b09 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:31.020489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3d46c-e705-4071-9105-b8c07d755b09 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:31.025777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e2708-497e-4319-b572-dc988410c6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:31.027264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e2708-497e-4319-b572-dc988410c6bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:31.027557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e2708-497e-4319-b572-dc988410c6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:31.027841 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e2708-497e-4319-b572-dc988410c6bd admin admin] PATH_INFO: `/v3/projects/3ee3ae4451104455890f161199d3a934/users/bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:31.045863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-28397174-7c72-4fea-9c75-8c82a0bbe0bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0ae66f776944d580e2331684c72523'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:31.047577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-28397174-7c72-4fea-9c75-8c82a0bbe0bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0ae66f776944d580e2331684c72523'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:31.050609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e2708-497e-4319-b572-dc988410c6bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee3ae4451104455890f161199d3a934, user_id=bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:31.054045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e2708-497e-4319-b572-dc988410c6bd admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:31.059550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-28397174-7c72-4fea-9c75-8c82a0bbe0bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0ae66f776944d580e2331684c72523'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:31.081424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 935/1874] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:31 2022] PUT /identity/v3/projects/3ee3ae4451104455890f161199d3a934/users/bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:31.081731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-28397174-7c72-4fea-9c75-8c82a0bbe0bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0ae66f776944d580e2331684c72523'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:31.081731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-28397174-7c72-4fea-9c75-8c82a0bbe0bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0ae66f776944d580e2331684c72523'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:31.082765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e2708-497e-4319-b572-dc988410c6bd admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:31.085061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-2d1e2708-497e-4319-b572-dc988410c6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:31.112901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 940/1875] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:30 2022] DELETE /identity/v3/users/aa0ae66f776944d580e2331684c72523 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:31.112901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28397174-7c72-4fea-9c75-8c82a0bbe0bf admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:31.114329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-28397174-7c72-4fea-9c75-8c82a0bbe0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:31.128153 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:31.174381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e2708-497e-4319-b572-dc988410c6bd admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:31.189702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28397174-7c72-4fea-9c75-8c82a0bbe0bf admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:31.196708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d1ec5-ccb6-4404-97d8-bf66dc2ab89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:31.197368 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d1ec5-ccb6-4404-97d8-bf66dc2ab89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:31.197682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d1ec5-ccb6-4404-97d8-bf66dc2ab89e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:31.197992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d1ec5-ccb6-4404-97d8-bf66dc2ab89e admin admin] PATH_INFO: `/v3/users/949e9797427340d6b9857f271f40a95c` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:31.199331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d1ec5-ccb6-4404-97d8-bf66dc2ab89e admin admin] RBAC: Authorizing `identity:delete_user(user_id=949e9797427340d6b9857f271f40a95c)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:31.201265 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d1ec5-ccb6-4404-97d8-bf66dc2ab89e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:31.238470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579326ea-f409-493d-9280-cba1041941f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:31.239104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579326ea-f409-493d-9280-cba1041941f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:31.239388 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579326ea-f409-493d-9280-cba1041941f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:31.239663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579326ea-f409-493d-9280-cba1041941f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:31.240379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579326ea-f409-493d-9280-cba1041941f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:31.241993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579326ea-f409-493d-9280-cba1041941f9 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:31.255832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 936/1876] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:31.257434 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fedcb7-3cef-49e0-a050-538210346e76 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:31.257787 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fedcb7-3cef-49e0-a050-538210346e76 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:31.258117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fedcb7-3cef-49e0-a050-538210346e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:31.276948 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-da2d1ec5-ccb6-4404-97d8-bf66dc2ab89e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949e9797427340d6b9857f271f40a95c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:31.277699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-da2d1ec5-ccb6-4404-97d8-bf66dc2ab89e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949e9797427340d6b9857f271f40a95c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:31.279989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-87fedcb7-3cef-49e0-a050-538210346e76 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:31.281255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-87fedcb7-3cef-49e0-a050-538210346e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:31.287211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-da2d1ec5-ccb6-4404-97d8-bf66dc2ab89e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949e9797427340d6b9857f271f40a95c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:31.290573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 937/1877] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:31.292006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fedcb7-3cef-49e0-a050-538210346e76 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:31.296626 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-da2d1ec5-ccb6-4404-97d8-bf66dc2ab89e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949e9797427340d6b9857f271f40a95c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:31.297372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-da2d1ec5-ccb6-4404-97d8-bf66dc2ab89e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949e9797427340d6b9857f271f40a95c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:31.302068 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-87fedcb7-3cef-49e0-a050-538210346e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:31.312188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:31.316331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fedcb7-3cef-49e0-a050-538210346e76 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:31.322114 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 941/1878] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:31 2022] DELETE /identity/v3/users/949e9797427340d6b9857f271f40a95c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:31.323338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3c2f3-abd8-4d73-96e2-55bad890c74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:31.324270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3c2f3-abd8-4d73-96e2-55bad890c74d admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:31.324564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3c2f3-abd8-4d73-96e2-55bad890c74d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:31.324823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3c2f3-abd8-4d73-96e2-55bad890c74d admin admin] PATH_INFO: `/v3/projects/3ee3ae4451104455890f161199d3a934/users/bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:31.326946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d1ec5-ccb6-4404-97d8-bf66dc2ab89e admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:31.327268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3c2f3-abd8-4d73-96e2-55bad890c74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee3ae4451104455890f161199d3a934, user_id=bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:31.328391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-da2d1ec5-ccb6-4404-97d8-bf66dc2ab89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:31.330176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3c2f3-abd8-4d73-96e2-55bad890c74d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:31.350482 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 938/1879] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:31 2022] PUT /identity/v3/projects/3ee3ae4451104455890f161199d3a934/users/bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:31.351991 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebda8f-5554-429c-928f-9f7bb91619bc None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:31.352279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebda8f-5554-429c-928f-9f7bb91619bc None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:31.352554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebda8f-5554-429c-928f-9f7bb91619bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:31.374006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-07ebda8f-5554-429c-928f-9f7bb91619bc None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:31.375286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-07ebda8f-5554-429c-928f-9f7bb91619bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:31.417526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d1ec5-ccb6-4404-97d8-bf66dc2ab89e admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:31.474593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 939/1880] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:31.476229 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63d420-8e2a-4087-bdc1-8198605dbd84 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:31.477448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63d420-8e2a-4087-bdc1-8198605dbd84 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:31.479940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63d420-8e2a-4087-bdc1-8198605dbd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:31.489481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a40ef-277c-4956-bfb2-a475e73e730a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:31.490563 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a40ef-277c-4956-bfb2-a475e73e730a service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:31.490884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a40ef-277c-4956-bfb2-a475e73e730a service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:31.491125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a40ef-277c-4956-bfb2-a475e73e730a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:31.507184 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a40ef-277c-4956-bfb2-a475e73e730a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:31.510634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a40ef-277c-4956-bfb2-a475e73e730a service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:31.520058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-1e63d420-8e2a-4087-bdc1-8198605dbd84 None None] MFA Rules not processed for user `bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:31.521297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1e63d420-8e2a-4087-bdc1-8198605dbd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:31.522653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 942/1881] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:31.523378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a40ef-277c-4956-bfb2-a475e73e730a service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:31.524644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-fc3a40ef-277c-4956-bfb2-a475e73e730a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:31.543280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a40ef-277c-4956-bfb2-a475e73e730a service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:31.551225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045657f5-f277-4929-afc4-105c822d33ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:31.551873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045657f5-f277-4929-afc4-105c822d33ea service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:31.552320 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045657f5-f277-4929-afc4-105c822d33ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:31.552856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045657f5-f277-4929-afc4-105c822d33ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:31.571502 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045657f5-f277-4929-afc4-105c822d33ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:31.573048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045657f5-f277-4929-afc4-105c822d33ea service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:31.590525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 943/1882] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:31.594338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:31.654562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 940/1883] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:31.668284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045657f5-f277-4929-afc4-105c822d33ea service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:31.669805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-045657f5-f277-4929-afc4-105c822d33ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:31.784050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045657f5-f277-4929-afc4-105c822d33ea service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:31.799519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffa323-139c-4977-847a-e8bccf58781d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:31.799786 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffa323-139c-4977-847a-e8bccf58781d service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:31.800038 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffa323-139c-4977-847a-e8bccf58781d service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:31.800551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffa323-139c-4977-847a-e8bccf58781d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:31.836135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffa323-139c-4977-847a-e8bccf58781d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:31.840477 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffa323-139c-4977-847a-e8bccf58781d service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:31.867983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 944/1884] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:50:32.056227 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63d420-8e2a-4087-bdc1-8198605dbd84 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:32.076644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63d420-8e2a-4087-bdc1-8198605dbd84 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:32.093023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f6b57-3f6c-406e-b0d7-5562dbe4e30b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:32.094000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f6b57-3f6c-406e-b0d7-5562dbe4e30b service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:32.094377 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f6b57-3f6c-406e-b0d7-5562dbe4e30b service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:32.094846 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f6b57-3f6c-406e-b0d7-5562dbe4e30b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:32.101348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-609f6b57-3f6c-406e-b0d7-5562dbe4e30b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:32.195397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffa323-139c-4977-847a-e8bccf58781d service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:32.197542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1cffa323-139c-4977-847a-e8bccf58781d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:32.219936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffa323-139c-4977-847a-e8bccf58781d service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:32.235630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f6b57-3f6c-406e-b0d7-5562dbe4e30b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:32.237669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f6b57-3f6c-406e-b0d7-5562dbe4e30b service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:32.239491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:32.243604 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:32.244132 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:32.245020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] PATH_INFO: `/v3/projects/513f42a037304b998eb040edd7967aea` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:32.250600 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] RBAC: Authorizing `identity:delete_project(project_id=513f42a037304b998eb040edd7967aea)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:32.255395 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:32.287939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 941/1885] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:32.315053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f6b57-3f6c-406e-b0d7-5562dbe4e30b service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:32.316985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-609f6b57-3f6c-406e-b0d7-5562dbe4e30b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:32.347308 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f6b57-3f6c-406e-b0d7-5562dbe4e30b service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:32.354792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:32.355904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:32.356369 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:32.357011 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] PATH_INFO: `/v3/projects/681686cb5c384e7ca9733ca27090d716` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:32.359773 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] RBAC: Authorizing `identity:delete_project(project_id=681686cb5c384e7ca9733ca27090d716)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:32.362586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:32.376511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:32.398486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513f42a037304b998eb040edd7967aea', 'request_id': 'req-b97db1d7-091c-46e5-a59a-c659a09743be'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.413834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513f42a037304b998eb040edd7967aea', 'request_id': 'req-b97db1d7-091c-46e5-a59a-c659a09743be'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.426081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513f42a037304b998eb040edd7967aea', 'request_id': 'req-b97db1d7-091c-46e5-a59a-c659a09743be'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.453742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] The token cache is being invalidate because project 513f42a037304b998eb040edd7967aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:32.455013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.456053 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.458753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '681686cb5c384e7ca9733ca27090d716', 'request_id': 'req-24588bab-bb0c-40fd-9a4a-ec4b497c045b'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.462375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 945/1886] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:32 2022] DELETE /identity/v3/projects/513f42a037304b998eb040edd7967aea => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:32.463826 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:32.465958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:32.467573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '681686cb5c384e7ca9733ca27090d716', 'request_id': 'req-24588bab-bb0c-40fd-9a4a-ec4b497c045b'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.478008 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '681686cb5c384e7ca9733ca27090d716', 'request_id': 'req-24588bab-bb0c-40fd-9a4a-ec4b497c045b'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.496980 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] The token cache is being invalidate because project 681686cb5c384e7ca9733ca27090d716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:32.497665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.498821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.503785 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 942/1887] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:32 2022] DELETE /identity/v3/projects/681686cb5c384e7ca9733ca27090d716 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:32.509038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:32.515426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:32.624405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97db1d7-091c-46e5-a59a-c659a09743be admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:32.646531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24588bab-bb0c-40fd-9a4a-ec4b497c045b admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:32.655996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263a0fe-5af8-46b2-ae3c-695033d56bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:32.657598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263a0fe-5af8-46b2-ae3c-695033d56bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:32.658366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263a0fe-5af8-46b2-ae3c-695033d56bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:32.658771 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263a0fe-5af8-46b2-ae3c-695033d56bcb admin admin] PATH_INFO: `/v3/users/015f67640392412799618619fa01eb0f` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:32.660245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263a0fe-5af8-46b2-ae3c-695033d56bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=015f67640392412799618619fa01eb0f)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:32.663655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263a0fe-5af8-46b2-ae3c-695033d56bcb admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:32.665207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:32.747148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadeb99d-046f-418f-8118-c6b8f727a0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:32.748599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadeb99d-046f-418f-8118-c6b8f727a0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:32.749014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadeb99d-046f-418f-8118-c6b8f727a0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:32.749462 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadeb99d-046f-418f-8118-c6b8f727a0a4 admin admin] PATH_INFO: `/v3/users/3e5f46de930d4449b339902c7a539985` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:32.767490 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadeb99d-046f-418f-8118-c6b8f727a0a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5f46de930d4449b339902c7a539985)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:32.775923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadeb99d-046f-418f-8118-c6b8f727a0a4 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:32.797613 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f263a0fe-5af8-46b2-ae3c-695033d56bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015f67640392412799618619fa01eb0f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.798486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f263a0fe-5af8-46b2-ae3c-695033d56bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015f67640392412799618619fa01eb0f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.824409 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f263a0fe-5af8-46b2-ae3c-695033d56bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015f67640392412799618619fa01eb0f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.828940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f263a0fe-5af8-46b2-ae3c-695033d56bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015f67640392412799618619fa01eb0f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.852317 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f263a0fe-5af8-46b2-ae3c-695033d56bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015f67640392412799618619fa01eb0f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.892831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 943/1888] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:32 2022] DELETE /identity/v3/users/015f67640392412799618619fa01eb0f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:32.896158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-dadeb99d-046f-418f-8118-c6b8f727a0a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5f46de930d4449b339902c7a539985'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.897410 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-dadeb99d-046f-418f-8118-c6b8f727a0a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5f46de930d4449b339902c7a539985'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.917039 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-dadeb99d-046f-418f-8118-c6b8f727a0a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5f46de930d4449b339902c7a539985'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.943606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-dadeb99d-046f-418f-8118-c6b8f727a0a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5f46de930d4449b339902c7a539985'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.945819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-dadeb99d-046f-418f-8118-c6b8f727a0a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5f46de930d4449b339902c7a539985'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:32.972482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:32.995757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 946/1889] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:32 2022] DELETE /identity/v3/users/3e5f46de930d4449b339902c7a539985 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:33.511412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263a0fe-5af8-46b2-ae3c-695033d56bcb admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:33.514463 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f263a0fe-5af8-46b2-ae3c-695033d56bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:33.614683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263a0fe-5af8-46b2-ae3c-695033d56bcb admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:33.691617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadeb99d-046f-418f-8118-c6b8f727a0a4 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:33.693812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-dadeb99d-046f-418f-8118-c6b8f727a0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:33.735844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdb593-51d4-4ed6-ba82-382596fa8d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:33.735844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb593-51d4-4ed6-ba82-382596fa8d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:33.735844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb593-51d4-4ed6-ba82-382596fa8d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:33.735844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdb593-51d4-4ed6-ba82-382596fa8d26 admin admin] PATH_INFO: `/v3/projects/820641714c724b6cb77744506f936290` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:33.736955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdb593-51d4-4ed6-ba82-382596fa8d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=820641714c724b6cb77744506f936290)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:33.739223 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdb593-51d4-4ed6-ba82-382596fa8d26 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:33.793141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:33.807288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadeb99d-046f-418f-8118-c6b8f727a0a4 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:33.813567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e1fdb593-51d4-4ed6-ba82-382596fa8d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '820641714c724b6cb77744506f936290', 'request_id': 'req-e1fdb593-51d4-4ed6-ba82-382596fa8d26'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:33.820945 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e1fdb593-51d4-4ed6-ba82-382596fa8d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '820641714c724b6cb77744506f936290', 'request_id': 'req-e1fdb593-51d4-4ed6-ba82-382596fa8d26'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:33.834064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e1fdb593-51d4-4ed6-ba82-382596fa8d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '820641714c724b6cb77744506f936290', 'request_id': 'req-e1fdb593-51d4-4ed6-ba82-382596fa8d26'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:33.851968 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e1fdb593-51d4-4ed6-ba82-382596fa8d26 admin admin] The token cache is being invalidate because project 820641714c724b6cb77744506f936290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:33.852403 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e1fdb593-51d4-4ed6-ba82-382596fa8d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:33.853324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e1fdb593-51d4-4ed6-ba82-382596fa8d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:33.856129 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 944/1890] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:33 2022] DELETE /identity/v3/projects/820641714c724b6cb77744506f936290 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:33.862424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79b8de-92c8-4ed7-b6a9-6c9db5a1053c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:33.862783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79b8de-92c8-4ed7-b6a9-6c9db5a1053c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:33.863211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79b8de-92c8-4ed7-b6a9-6c9db5a1053c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:33.879877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3add44-8764-4a91-b5ab-e765c6bfc066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:33.880549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3add44-8764-4a91-b5ab-e765c6bfc066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:33.880828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3add44-8764-4a91-b5ab-e765c6bfc066 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:33.881109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3add44-8764-4a91-b5ab-e765c6bfc066 admin admin] PATH_INFO: `/v3/projects/af0d5058bdd3461787c22b0a8160c62e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:33.882380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3add44-8764-4a91-b5ab-e765c6bfc066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af0d5058bdd3461787c22b0a8160c62e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:33.884315 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3add44-8764-4a91-b5ab-e765c6bfc066 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:33.888221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-ab79b8de-92c8-4ed7-b6a9-6c9db5a1053c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:33.892569 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ab79b8de-92c8-4ed7-b6a9-6c9db5a1053c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:33.906029 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 945/1891] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:33.916025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f5e1a-aa7f-4088-8d3d-eae476490aa5 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:33.916823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f5e1a-aa7f-4088-8d3d-eae476490aa5 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:33.917132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f5e1a-aa7f-4088-8d3d-eae476490aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:33.945207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-5d7f5e1a-aa7f-4088-8d3d-eae476490aa5 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:33.948391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5d7f5e1a-aa7f-4088-8d3d-eae476490aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:33.973812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6d3add44-8764-4a91-b5ab-e765c6bfc066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af0d5058bdd3461787c22b0a8160c62e', 'request_id': 'req-6d3add44-8764-4a91-b5ab-e765c6bfc066'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:33.982303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6d3add44-8764-4a91-b5ab-e765c6bfc066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af0d5058bdd3461787c22b0a8160c62e', 'request_id': 'req-6d3add44-8764-4a91-b5ab-e765c6bfc066'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:33.995199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6d3add44-8764-4a91-b5ab-e765c6bfc066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af0d5058bdd3461787c22b0a8160c62e', 'request_id': 'req-6d3add44-8764-4a91-b5ab-e765c6bfc066'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:34.016623 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6d3add44-8764-4a91-b5ab-e765c6bfc066 admin admin] The token cache is being invalidate because project af0d5058bdd3461787c22b0a8160c62e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:34.017242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6d3add44-8764-4a91-b5ab-e765c6bfc066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:34.018177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6d3add44-8764-4a91-b5ab-e765c6bfc066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:34.020298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 947/1892] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:33 2022] DELETE /identity/v3/projects/af0d5058bdd3461787c22b0a8160c62e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:34.027779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d102-f60d-47ad-b480-e10d5d00c684 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.028207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d102-f60d-47ad-b480-e10d5d00c684 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.028497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8d102-f60d-47ad-b480-e10d5d00c684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.047575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 946/1893] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:34.052400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f5e1a-aa7f-4088-8d3d-eae476490aa5 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:34.055528 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-27a8d102-f60d-47ad-b480-e10d5d00c684 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:34.057554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-27a8d102-f60d-47ad-b480-e10d5d00c684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:34.064086 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f5e1a-aa7f-4088-8d3d-eae476490aa5 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:34.066404 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 948/1894] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:34.069251 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e03465-c808-4b82-a097-f41f6c5089fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:34.069931 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e03465-c808-4b82-a097-f41f6c5089fb admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.070242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e03465-c808-4b82-a097-f41f6c5089fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.070523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e03465-c808-4b82-a097-f41f6c5089fb admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.071274 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e03465-c808-4b82-a097-f41f6c5089fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:34.071587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e03465-c808-4b82-a097-f41f6c5089fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:34.074172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e03465-c808-4b82-a097-f41f6c5089fb admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:34.075351 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418b200-f00c-4fed-9970-587dea26fba2 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.075705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418b200-f00c-4fed-9970-587dea26fba2 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.076058 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418b200-f00c-4fed-9970-587dea26fba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.089010 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 947/1895] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:50:34.094440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e03465-c808-4b82-a097-f41f6c5089fb admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:34.100583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6418b200-f00c-4fed-9970-587dea26fba2 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:34.101796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6418b200-f00c-4fed-9970-587dea26fba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:34.109430 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e03465-c808-4b82-a097-f41f6c5089fb admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:34.113421 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 949/1896] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:34.115732 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e167c5-4f4f-420a-b840-7b3aa8eba556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:34.116522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e167c5-4f4f-420a-b840-7b3aa8eba556 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.116782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e167c5-4f4f-420a-b840-7b3aa8eba556 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.117059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e167c5-4f4f-420a-b840-7b3aa8eba556 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.117768 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418b200-f00c-4fed-9970-587dea26fba2 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:34.117930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e167c5-4f4f-420a-b840-7b3aa8eba556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:34.120780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e167c5-4f4f-420a-b840-7b3aa8eba556 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:34.129038 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418b200-f00c-4fed-9970-587dea26fba2 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:34.134615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4da27-d211-49ed-b925-a93ab441a944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:34.136127 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4da27-d211-49ed-b925-a93ab441a944 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.136641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4da27-d211-49ed-b925-a93ab441a944 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.136939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4da27-d211-49ed-b925-a93ab441a944 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.137657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4da27-d211-49ed-b925-a93ab441a944 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:34.137967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4da27-d211-49ed-b925-a93ab441a944 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:34.139703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4da27-d211-49ed-b925-a93ab441a944 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:34.158831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 950/1897] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:34.162912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 948/1898] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:34 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:34.167627 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e167c5-4f4f-420a-b840-7b3aa8eba556 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:34.167778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4da27-d211-49ed-b925-a93ab441a944 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:34.174408 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:34.181425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4da27-d211-49ed-b925-a93ab441a944 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:34.310479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e167c5-4f4f-420a-b840-7b3aa8eba556 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:34.320755 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cdba5-a039-461f-a3cf-255c80fc7bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:34.321633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cdba5-a039-461f-a3cf-255c80fc7bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.322024 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cdba5-a039-461f-a3cf-255c80fc7bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.322345 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cdba5-a039-461f-a3cf-255c80fc7bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.325008 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cdba5-a039-461f-a3cf-255c80fc7bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:34.327688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d94ac-5a07-4f29-947f-27c7a1bb8b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:34.328467 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d94ac-5a07-4f29-947f-27c7a1bb8b85 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.328827 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d94ac-5a07-4f29-947f-27c7a1bb8b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.329113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d94ac-5a07-4f29-947f-27c7a1bb8b85 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.331971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cdba5-a039-461f-a3cf-255c80fc7bd9 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:34.333296 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d94ac-5a07-4f29-947f-27c7a1bb8b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:34.335572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d94ac-5a07-4f29-947f-27c7a1bb8b85 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:34.392901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 951/1899] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:34 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:34.397709 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d94ac-5a07-4f29-947f-27c7a1bb8b85 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:34.406754 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:34.415546 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d94ac-5a07-4f29-947f-27c7a1bb8b85 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:34.423898 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5945d-9497-4072-992f-61128b8f3e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:34.424936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5945d-9497-4072-992f-61128b8f3e54 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.425476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5945d-9497-4072-992f-61128b8f3e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.426900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5945d-9497-4072-992f-61128b8f3e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.428220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5945d-9497-4072-992f-61128b8f3e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:34.431094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5945d-9497-4072-992f-61128b8f3e54 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:34.433283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 949/1900] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:34 2022] POST /identity/v3/projects => generated 381 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:34.438549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cdba5-a039-461f-a3cf-255c80fc7bd9 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:34.452678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 952/1901] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:50:34.454229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5945d-9497-4072-992f-61128b8f3e54 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:34.468682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5945d-9497-4072-992f-61128b8f3e54 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:34.550132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cdba5-a039-461f-a3cf-255c80fc7bd9 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:34.558784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a22ee-a0d6-43b0-87b4-08c6522eafda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:34.558784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a22ee-a0d6-43b0-87b4-08c6522eafda admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.559165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a22ee-a0d6-43b0-87b4-08c6522eafda admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.559165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a22ee-a0d6-43b0-87b4-08c6522eafda admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.559883 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a22ee-a0d6-43b0-87b4-08c6522eafda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:34.562301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a22ee-a0d6-43b0-87b4-08c6522eafda admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:34.575932 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ece26e-9ae2-432a-bef2-e5536798cab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:34.577210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ece26e-9ae2-432a-bef2-e5536798cab0 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.578135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ece26e-9ae2-432a-bef2-e5536798cab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.578623 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ece26e-9ae2-432a-bef2-e5536798cab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.580095 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ece26e-9ae2-432a-bef2-e5536798cab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:34.581577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ece26e-9ae2-432a-bef2-e5536798cab0 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:34.589827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 950/1902] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:34 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:34.593854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a22ee-a0d6-43b0-87b4-08c6522eafda admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:34.596506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-432a22ee-a0d6-43b0-87b4-08c6522eafda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:34.607998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 953/1903] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:34.609267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ece26e-9ae2-432a-bef2-e5536798cab0 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:34.612488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a22ee-a0d6-43b0-87b4-08c6522eafda admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:34.617866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe643a9-0a6f-4748-bbd3-6fbdc428be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:34.618582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe643a9-0a6f-4748-bbd3-6fbdc428be15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.618859 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe643a9-0a6f-4748-bbd3-6fbdc428be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.620415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe643a9-0a6f-4748-bbd3-6fbdc428be15 admin admin] PATH_INFO: `/v3/users/c29a3635e5da444c81921aeac6e86bda` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.621774 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe643a9-0a6f-4748-bbd3-6fbdc428be15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c29a3635e5da444c81921aeac6e86bda)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:34.624114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe643a9-0a6f-4748-bbd3-6fbdc428be15 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:34.626054 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ece26e-9ae2-432a-bef2-e5536798cab0 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:34.633404 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e2795-0afa-46ca-b5a3-7645085eedf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:34.635056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e2795-0afa-46ca-b5a3-7645085eedf9 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.635056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e2795-0afa-46ca-b5a3-7645085eedf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.635351 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e2795-0afa-46ca-b5a3-7645085eedf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.636289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e2795-0afa-46ca-b5a3-7645085eedf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:34.638882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e2795-0afa-46ca-b5a3-7645085eedf9 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:34.658049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 954/1904] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:34.659057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e2795-0afa-46ca-b5a3-7645085eedf9 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:34.672029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e2795-0afa-46ca-b5a3-7645085eedf9 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:34.678858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d076ee5-b653-46bb-8acc-b3b79ed94d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:34.679986 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d076ee5-b653-46bb-8acc-b3b79ed94d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.680535 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d076ee5-b653-46bb-8acc-b3b79ed94d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.680817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d076ee5-b653-46bb-8acc-b3b79ed94d73 admin admin] PATH_INFO: `/v3/projects/b23b694ea7244326aa1bf796423bf38a/users/007948c806884ccd9988deabe04e8e29/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.699608 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d076ee5-b653-46bb-8acc-b3b79ed94d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23b694ea7244326aa1bf796423bf38a, user_id=007948c806884ccd9988deabe04e8e29, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:34.702392 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d076ee5-b653-46bb-8acc-b3b79ed94d73 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:34.703331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-bfe643a9-0a6f-4748-bbd3-6fbdc428be15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c29a3635e5da444c81921aeac6e86bda'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:34.709654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-bfe643a9-0a6f-4748-bbd3-6fbdc428be15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c29a3635e5da444c81921aeac6e86bda'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:34.712650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-bfe643a9-0a6f-4748-bbd3-6fbdc428be15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c29a3635e5da444c81921aeac6e86bda'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:34.714966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-bfe643a9-0a6f-4748-bbd3-6fbdc428be15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c29a3635e5da444c81921aeac6e86bda'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:34.723570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 955/1905] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:34 2022] PUT /identity/v3/projects/b23b694ea7244326aa1bf796423bf38a/users/007948c806884ccd9988deabe04e8e29/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:34.731467 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d076ee5-b653-46bb-8acc-b3b79ed94d73 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:34.737068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-4d076ee5-b653-46bb-8acc-b3b79ed94d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:34.742923 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-bfe643a9-0a6f-4748-bbd3-6fbdc428be15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c29a3635e5da444c81921aeac6e86bda'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:34.779601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 951/1906] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:34 2022] DELETE /identity/v3/users/c29a3635e5da444c81921aeac6e86bda => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:34.782831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3f6a5-ff49-40c4-8374-ff63afa93510 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.782831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3f6a5-ff49-40c4-8374-ff63afa93510 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.782831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3f6a5-ff49-40c4-8374-ff63afa93510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.819194 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:34.833471 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-c7c3f6a5-ff49-40c4-8374-ff63afa93510 None None] MFA Rules not processed for user `007948c806884ccd9988deabe04e8e29`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:34.834974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c7c3f6a5-ff49-40c4-8374-ff63afa93510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:34.852984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d076ee5-b653-46bb-8acc-b3b79ed94d73 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:34.913517 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:34.962794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 952/1907] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:34.965060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fbec2-852b-404b-8d88-77e0cad08e60 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.965358 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fbec2-852b-404b-8d88-77e0cad08e60 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.965653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fbec2-852b-404b-8d88-77e0cad08e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.990374 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c0416-e7a0-41b4-a994-b8f4d26afde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:34.991439 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c0416-e7a0-41b4-a994-b8f4d26afde7 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:34.991892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c0416-e7a0-41b4-a994-b8f4d26afde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:34.992578 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c0416-e7a0-41b4-a994-b8f4d26afde7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:34.993603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c0416-e7a0-41b4-a994-b8f4d26afde7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:34.996221 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c0416-e7a0-41b4-a994-b8f4d26afde7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:35.001856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-cb9fbec2-852b-404b-8d88-77e0cad08e60 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:35.003142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-cb9fbec2-852b-404b-8d88-77e0cad08e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:35.015127 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 956/1908] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:35.015127 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c0416-e7a0-41b4-a994-b8f4d26afde7 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:35.016144 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 953/1909] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:35.017125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fbec2-852b-404b-8d88-77e0cad08e60 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:35.022846 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-4b1c0416-e7a0-41b4-a994-b8f4d26afde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:35.034960 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fbec2-852b-404b-8d88-77e0cad08e60 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:35.039874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9a6d9-4c47-41ae-90d7-c35ce33c603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:35.040649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9a6d9-4c47-41ae-90d7-c35ce33c603a admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:35.041011 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9a6d9-4c47-41ae-90d7-c35ce33c603a admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:35.042002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9a6d9-4c47-41ae-90d7-c35ce33c603a admin admin] PATH_INFO: `/v3/projects/26720a5873c045a78e60c745a49befc6/users/cb56813658cd4fa591d9a4c12c8bb833/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:35.067947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9a6d9-4c47-41ae-90d7-c35ce33c603a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26720a5873c045a78e60c745a49befc6, user_id=cb56813658cd4fa591d9a4c12c8bb833, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:35.070723 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9a6d9-4c47-41ae-90d7-c35ce33c603a admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:35.096943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 954/1910] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:35 2022] PUT /identity/v3/projects/26720a5873c045a78e60c745a49befc6/users/cb56813658cd4fa591d9a4c12c8bb833/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:35.098128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9a6d9-4c47-41ae-90d7-c35ce33c603a admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:35.108510 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-60f9a6d9-4c47-41ae-90d7-c35ce33c603a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:35.111148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c0416-e7a0-41b4-a994-b8f4d26afde7 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:35.192667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9a6d9-4c47-41ae-90d7-c35ce33c603a admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:35.197051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c50e4-4190-404c-82a1-df22be4320f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:35.198501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c50e4-4190-404c-82a1-df22be4320f4 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:35.198642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9111f9b-8a2e-4e07-ad49-4c9f2c70feb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:35.199045 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c50e4-4190-404c-82a1-df22be4320f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:35.199323 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c50e4-4190-404c-82a1-df22be4320f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:35.199459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9111f9b-8a2e-4e07-ad49-4c9f2c70feb2 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:35.199728 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9111f9b-8a2e-4e07-ad49-4c9f2c70feb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:35.200002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9111f9b-8a2e-4e07-ad49-4c9f2c70feb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:35.288293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c50e4-4190-404c-82a1-df22be4320f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:35.291052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c50e4-4190-404c-82a1-df22be4320f4 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:35.292748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9111f9b-8a2e-4e07-ad49-4c9f2c70feb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:35.294727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9111f9b-8a2e-4e07-ad49-4c9f2c70feb2 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:35.298561 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:35.308818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 955/1911] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:35.310283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90561a1-1410-4d4c-b6cf-11d63c29fcf0 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:35.310683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90561a1-1410-4d4c-b6cf-11d63c29fcf0 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:35.311091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90561a1-1410-4d4c-b6cf-11d63c29fcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:35.313384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 957/1912] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:35.344359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-d90561a1-1410-4d4c-b6cf-11d63c29fcf0 None None] MFA Rules not processed for user `cb56813658cd4fa591d9a4c12c8bb833`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:35.345750 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d90561a1-1410-4d4c-b6cf-11d63c29fcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:35.436441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c50e4-4190-404c-82a1-df22be4320f4 service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:35.438399 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-127c50e4-4190-404c-82a1-df22be4320f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:35.466288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c50e4-4190-404c-82a1-df22be4320f4 service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:35.478888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b393ae-31d1-47b3-b3a4-615512df49f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:35.478888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b393ae-31d1-47b3-b3a4-615512df49f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:35.479331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b393ae-31d1-47b3-b3a4-615512df49f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:35.479662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:35.480204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b393ae-31d1-47b3-b3a4-615512df49f0 admin admin] PATH_INFO: `/v3/users/68cfeacb0c514b89a7cbb33ca353bd05` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:35.481867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b393ae-31d1-47b3-b3a4-615512df49f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68cfeacb0c514b89a7cbb33ca353bd05)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:35.486135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b393ae-31d1-47b3-b3a4-615512df49f0 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:35.503044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 956/1913] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:35.504005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90561a1-1410-4d4c-b6cf-11d63c29fcf0 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:35.517453 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90561a1-1410-4d4c-b6cf-11d63c29fcf0 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:35.523850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66777c35-1fe6-485c-82d8-eec67cbaad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:35.524542 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66777c35-1fe6-485c-82d8-eec67cbaad15 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:35.524855 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66777c35-1fe6-485c-82d8-eec67cbaad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:35.525172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66777c35-1fe6-485c-82d8-eec67cbaad15 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:35.526917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66777c35-1fe6-485c-82d8-eec67cbaad15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:35.528933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66777c35-1fe6-485c-82d8-eec67cbaad15 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:35.585003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 957/1914] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:35 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:35.594361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66777c35-1fe6-485c-82d8-eec67cbaad15 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:35.594975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b7b393ae-31d1-47b3-b3a4-615512df49f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68cfeacb0c514b89a7cbb33ca353bd05'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:35.596018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b7b393ae-31d1-47b3-b3a4-615512df49f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68cfeacb0c514b89a7cbb33ca353bd05'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:35.613983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b7b393ae-31d1-47b3-b3a4-615512df49f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68cfeacb0c514b89a7cbb33ca353bd05'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:35.631408 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b7b393ae-31d1-47b3-b3a4-615512df49f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68cfeacb0c514b89a7cbb33ca353bd05'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:35.646034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b7b393ae-31d1-47b3-b3a4-615512df49f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68cfeacb0c514b89a7cbb33ca353bd05'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:35.710938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 958/1915] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:35 2022] DELETE /identity/v3/users/68cfeacb0c514b89a7cbb33ca353bd05 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:35.716111 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081143b3-bff4-407b-8ac1-f2b7a9b862f3 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:35.716451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081143b3-bff4-407b-8ac1-f2b7a9b862f3 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:35.716673 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081143b3-bff4-407b-8ac1-f2b7a9b862f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:35.736942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66777c35-1fe6-485c-82d8-eec67cbaad15 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:35.754322 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-081143b3-bff4-407b-8ac1-f2b7a9b862f3 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:35.757337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-081143b3-bff4-407b-8ac1-f2b7a9b862f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:35.861128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36878b53-95f6-4fd8-b291-8c7e176d52aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:35.861814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36878b53-95f6-4fd8-b291-8c7e176d52aa admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:35.862101 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36878b53-95f6-4fd8-b291-8c7e176d52aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:35.862411 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36878b53-95f6-4fd8-b291-8c7e176d52aa admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:35.863432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36878b53-95f6-4fd8-b291-8c7e176d52aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:35.865441 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36878b53-95f6-4fd8-b291-8c7e176d52aa admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:35.893101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 959/1916] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:35.907675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081143b3-bff4-407b-8ac1-f2b7a9b862f3 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:35.913917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-081143b3-bff4-407b-8ac1-f2b7a9b862f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:35.928264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 958/1917] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:35 2022] POST /identity/v3/users => generated 294 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:35.932521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36878b53-95f6-4fd8-b291-8c7e176d52aa admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:35.935316 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-36878b53-95f6-4fd8-b291-8c7e176d52aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:35.964988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36878b53-95f6-4fd8-b291-8c7e176d52aa admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:35.973724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9b027-b29c-4e97-96b7-cb98412e2fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:35.975132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9b027-b29c-4e97-96b7-cb98412e2fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:35.975132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9b027-b29c-4e97-96b7-cb98412e2fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:35.975678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9b027-b29c-4e97-96b7-cb98412e2fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:35.976884 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9b027-b29c-4e97-96b7-cb98412e2fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:35.988375 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9b027-b29c-4e97-96b7-cb98412e2fb5 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:36.014280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 959/1918] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:36.018965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9b027-b29c-4e97-96b7-cb98412e2fb5 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:36.037787 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9b027-b29c-4e97-96b7-cb98412e2fb5 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:36.044341 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579b66f-ae50-4745-8f7c-d18341a11b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:36.045629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579b66f-ae50-4745-8f7c-d18341a11b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:36.045921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579b66f-ae50-4745-8f7c-d18341a11b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:36.046234 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579b66f-ae50-4745-8f7c-d18341a11b20 admin admin] PATH_INFO: `/v3/projects/9367200e9b0a4e90b89694fb260c6e10/users/48990413fbd647bcb22c39e946724528/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:36.075121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579b66f-ae50-4745-8f7c-d18341a11b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9367200e9b0a4e90b89694fb260c6e10, user_id=48990413fbd647bcb22c39e946724528, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:36.078942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579b66f-ae50-4745-8f7c-d18341a11b20 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:36.108509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 960/1919] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:36 2022] PUT /identity/v3/projects/9367200e9b0a4e90b89694fb260c6e10/users/48990413fbd647bcb22c39e946724528/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:36.108827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579b66f-ae50-4745-8f7c-d18341a11b20 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:36.111664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c579b66f-ae50-4745-8f7c-d18341a11b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:36.122298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081143b3-bff4-407b-8ac1-f2b7a9b862f3 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:36.165946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:36.188547 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:36.227203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579b66f-ae50-4745-8f7c-d18341a11b20 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:36.235334 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:36.236340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:36.236777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:36.237317 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] PATH_INFO: `/v3/projects/06fabaa510594f9192e35cf11ada9de5` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:36.239183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06fabaa510594f9192e35cf11ada9de5)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:36.241479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:36.242319 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380fad4-95ce-4d21-b327-d32fb7380c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:36.245984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380fad4-95ce-4d21-b327-d32fb7380c51 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:36.246800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380fad4-95ce-4d21-b327-d32fb7380c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:36.247490 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380fad4-95ce-4d21-b327-d32fb7380c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:36.279313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380fad4-95ce-4d21-b327-d32fb7380c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:36.282642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380fad4-95ce-4d21-b327-d32fb7380c51 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:36.305448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 960/1920] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:36.308775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380fad4-95ce-4d21-b327-d32fb7380c51 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:36.337742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380fad4-95ce-4d21-b327-d32fb7380c51 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:36.386254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06fabaa510594f9192e35cf11ada9de5', 'request_id': 'req-b525253d-8489-41c3-a982-0c0dceae8c53'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.411598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06fabaa510594f9192e35cf11ada9de5', 'request_id': 'req-b525253d-8489-41c3-a982-0c0dceae8c53'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.443848 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06fabaa510594f9192e35cf11ada9de5', 'request_id': 'req-b525253d-8489-41c3-a982-0c0dceae8c53'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.482617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] The token cache is being invalidate because project 06fabaa510594f9192e35cf11ada9de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:36.483103 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.484448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.492401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 961/1921] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:36 2022] DELETE /identity/v3/projects/06fabaa510594f9192e35cf11ada9de5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:36.494899 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:36.497292 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:36.518773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ca846-09a6-4d6b-a7c7-d5b8d07c010c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:36.519707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ca846-09a6-4d6b-a7c7-d5b8d07c010c admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:36.520107 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ca846-09a6-4d6b-a7c7-d5b8d07c010c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:36.520431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ca846-09a6-4d6b-a7c7-d5b8d07c010c admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:36.521233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ca846-09a6-4d6b-a7c7-d5b8d07c010c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:36.523574 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ca846-09a6-4d6b-a7c7-d5b8d07c010c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:36.537601 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 961/1922] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:36.544012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ca846-09a6-4d6b-a7c7-d5b8d07c010c admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:36.546347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ea1ca846-09a6-4d6b-a7c7-d5b8d07c010c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:36.565465 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ca846-09a6-4d6b-a7c7-d5b8d07c010c admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:36.571629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6ae1a-8187-4b04-8a74-47d932b5d93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:36.573059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ae1a-8187-4b04-8a74-47d932b5d93f admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:36.573618 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ae1a-8187-4b04-8a74-47d932b5d93f admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:36.573900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ae1a-8187-4b04-8a74-47d932b5d93f admin admin] PATH_INFO: `/v3/projects/9367200e9b0a4e90b89694fb260c6e10/users/48990413fbd647bcb22c39e946724528/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:36.576362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6ae1a-8187-4b04-8a74-47d932b5d93f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9367200e9b0a4e90b89694fb260c6e10, user_id=48990413fbd647bcb22c39e946724528, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:36.579521 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6ae1a-8187-4b04-8a74-47d932b5d93f admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:36.594008 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 962/1923] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:36 2022] PUT /identity/v3/projects/9367200e9b0a4e90b89694fb260c6e10/users/48990413fbd647bcb22c39e946724528/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:36.603294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525253d-8489-41c3-a982-0c0dceae8c53 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:36.609201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a940-26b1-40e3-becf-9dc7ffb19f0f None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:36.609633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a940-26b1-40e3-becf-9dc7ffb19f0f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:36.610081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a940-26b1-40e3-becf-9dc7ffb19f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:36.648513 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-b862a940-26b1-40e3-becf-9dc7ffb19f0f None None] MFA Rules not processed for user `48990413fbd647bcb22c39e946724528`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:36.649822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b862a940-26b1-40e3-becf-9dc7ffb19f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:36.714245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d08ff-bafb-444e-a13a-894b3789d3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:36.714245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d08ff-bafb-444e-a13a-894b3789d3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:36.714245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d08ff-bafb-444e-a13a-894b3789d3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:36.714245 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d08ff-bafb-444e-a13a-894b3789d3f7 admin admin] PATH_INFO: `/v3/users/9178e76e9429491c996f93d8e9b610fa` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:36.722900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d08ff-bafb-444e-a13a-894b3789d3f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9178e76e9429491c996f93d8e9b610fa)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:36.728038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d08ff-bafb-444e-a13a-894b3789d3f7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:36.772099 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:36.772283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 963/1924] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:36.774669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862a940-26b1-40e3-becf-9dc7ffb19f0f None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:36.779450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b862a940-26b1-40e3-becf-9dc7ffb19f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:36.811259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862a940-26b1-40e3-becf-9dc7ffb19f0f None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:36.819864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:36.821009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:36.821551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:36.822089 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] PATH_INFO: `/v3/projects/c693aba537324fb2ab027dde9bd46fae` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:36.824268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c693aba537324fb2ab027dde9bd46fae)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:36.826955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:36.839692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ce9d08ff-bafb-444e-a13a-894b3789d3f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9178e76e9429491c996f93d8e9b610fa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.840668 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ce9d08ff-bafb-444e-a13a-894b3789d3f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9178e76e9429491c996f93d8e9b610fa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.849109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ce9d08ff-bafb-444e-a13a-894b3789d3f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9178e76e9429491c996f93d8e9b610fa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.849791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ce9d08ff-bafb-444e-a13a-894b3789d3f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9178e76e9429491c996f93d8e9b610fa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.883910 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ce9d08ff-bafb-444e-a13a-894b3789d3f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9178e76e9429491c996f93d8e9b610fa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.898777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:36.913106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 962/1925] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:36 2022] DELETE /identity/v3/users/9178e76e9429491c996f93d8e9b610fa => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:36.914324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d08ff-bafb-444e-a13a-894b3789d3f7 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:36.918401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ce9d08ff-bafb-444e-a13a-894b3789d3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:36.920166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c693aba537324fb2ab027dde9bd46fae', 'request_id': 'req-9278ccb6-4f9f-44c7-9307-7eb87c31d995'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.931532 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c693aba537324fb2ab027dde9bd46fae', 'request_id': 'req-9278ccb6-4f9f-44c7-9307-7eb87c31d995'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.940300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c693aba537324fb2ab027dde9bd46fae', 'request_id': 'req-9278ccb6-4f9f-44c7-9307-7eb87c31d995'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.957903 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] The token cache is being invalidate because project c693aba537324fb2ab027dde9bd46fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:36.958419 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.959381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:36.961228 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 964/1926] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:36 2022] DELETE /identity/v3/projects/c693aba537324fb2ab027dde9bd46fae => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:36.965803 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:36.968056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:37.030923 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d08ff-bafb-444e-a13a-894b3789d3f7 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:37.047809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abb337-4774-4318-b5fb-0d9d71dd006d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:37.049209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abb337-4774-4318-b5fb-0d9d71dd006d service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:37.049209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abb337-4774-4318-b5fb-0d9d71dd006d service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:37.049209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abb337-4774-4318-b5fb-0d9d71dd006d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:37.063157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c0abb337-4774-4318-b5fb-0d9d71dd006d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:37.101875 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278ccb6-4f9f-44c7-9307-7eb87c31d995 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:37.176060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abb337-4774-4318-b5fb-0d9d71dd006d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:37.177670 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abb337-4774-4318-b5fb-0d9d71dd006d service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:37.192278 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 963/1927] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:37.211366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd25749-21e4-423a-81ae-a8d9fe01bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:37.212661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd25749-21e4-423a-81ae-a8d9fe01bb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:37.213800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd25749-21e4-423a-81ae-a8d9fe01bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:37.214897 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd25749-21e4-423a-81ae-a8d9fe01bb03 admin admin] PATH_INFO: `/v3/users/bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:37.217825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd25749-21e4-423a-81ae-a8d9fe01bb03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:37.221914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd25749-21e4-423a-81ae-a8d9fe01bb03 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:37.329182 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-ddd25749-21e4-423a-81ae-a8d9fe01bb03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:37.331530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-ddd25749-21e4-423a-81ae-a8d9fe01bb03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:37.343543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-ddd25749-21e4-423a-81ae-a8d9fe01bb03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:37.361318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abb337-4774-4318-b5fb-0d9d71dd006d service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:37.362970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c0abb337-4774-4318-b5fb-0d9d71dd006d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:37.368231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-ddd25749-21e4-423a-81ae-a8d9fe01bb03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:37.373427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-ddd25749-21e4-423a-81ae-a8d9fe01bb03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:37.383256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abb337-4774-4318-b5fb-0d9d71dd006d service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:37.389318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:37.392065 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e9d1d-57f5-4e9b-8b9d-9a4efdb0ef0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:37.393806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e9d1d-57f5-4e9b-8b9d-9a4efdb0ef0f service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:37.393990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e9d1d-57f5-4e9b-8b9d-9a4efdb0ef0f service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:37.394482 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e9d1d-57f5-4e9b-8b9d-9a4efdb0ef0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:37.402605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f61e9d1d-57f5-4e9b-8b9d-9a4efdb0ef0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:37.423976 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 965/1928] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:36 2022] DELETE /identity/v3/users/bb8a9a2b3d8c4f8eb3c5242a2b4b3d3a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:37.489503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:37.520323 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd25749-21e4-423a-81ae-a8d9fe01bb03 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:37.521883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ddd25749-21e4-423a-81ae-a8d9fe01bb03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:37.545396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e9d1d-57f5-4e9b-8b9d-9a4efdb0ef0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:37.547751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e9d1d-57f5-4e9b-8b9d-9a4efdb0ef0f service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:37.562955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 964/1929] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:50:37.668842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd25749-21e4-423a-81ae-a8d9fe01bb03 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:37.677941 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649d169-2570-4dc3-9c03-4765b6da250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:37.679059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649d169-2570-4dc3-9c03-4765b6da250a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:37.679731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649d169-2570-4dc3-9c03-4765b6da250a admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:37.680554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649d169-2570-4dc3-9c03-4765b6da250a admin admin] PATH_INFO: `/v3/projects/7ad055c2e9d642c88dc6559e37c34659` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:37.683224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649d169-2570-4dc3-9c03-4765b6da250a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad055c2e9d642c88dc6559e37c34659)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:37.685711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649d169-2570-4dc3-9c03-4765b6da250a admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:37.770836 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2649d169-2570-4dc3-9c03-4765b6da250a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad055c2e9d642c88dc6559e37c34659', 'request_id': 'req-2649d169-2570-4dc3-9c03-4765b6da250a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:37.786519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2649d169-2570-4dc3-9c03-4765b6da250a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad055c2e9d642c88dc6559e37c34659', 'request_id': 'req-2649d169-2570-4dc3-9c03-4765b6da250a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:37.796316 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2649d169-2570-4dc3-9c03-4765b6da250a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad055c2e9d642c88dc6559e37c34659', 'request_id': 'req-2649d169-2570-4dc3-9c03-4765b6da250a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:37.812545 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2649d169-2570-4dc3-9c03-4765b6da250a admin admin] The token cache is being invalidate because project 7ad055c2e9d642c88dc6559e37c34659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:37.812869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2649d169-2570-4dc3-9c03-4765b6da250a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:37.813599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2649d169-2570-4dc3-9c03-4765b6da250a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:37.815769 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 966/1930] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:37 2022] DELETE /identity/v3/projects/7ad055c2e9d642c88dc6559e37c34659 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:37.821587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db391aeb-54f2-415b-affb-cab443455ca6 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:37.824278 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db391aeb-54f2-415b-affb-cab443455ca6 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:37.825169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db391aeb-54f2-415b-affb-cab443455ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:37.849468 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-db391aeb-54f2-415b-affb-cab443455ca6 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:37.850978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-db391aeb-54f2-415b-affb-cab443455ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:37.959758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eebc67-9c8f-46c0-bafd-6eeb0728f0e0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:37.960296 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eebc67-9c8f-46c0-bafd-6eeb0728f0e0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:37.960756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eebc67-9c8f-46c0-bafd-6eeb0728f0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:37.966306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 965/1931] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:37.992338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-d8eebc67-9c8f-46c0-bafd-6eeb0728f0e0 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:37.993853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-d8eebc67-9c8f-46c0-bafd-6eeb0728f0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:38.010813 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 967/1932] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:38.012847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db391aeb-54f2-415b-affb-cab443455ca6 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:38.034584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db391aeb-54f2-415b-affb-cab443455ca6 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:38.041376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c681a1-a259-4faa-990e-ae690c7d7154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:38.042647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c681a1-a259-4faa-990e-ae690c7d7154 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.043088 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c681a1-a259-4faa-990e-ae690c7d7154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.043555 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c681a1-a259-4faa-990e-ae690c7d7154 admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.044396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c681a1-a259-4faa-990e-ae690c7d7154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:38.044705 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c681a1-a259-4faa-990e-ae690c7d7154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:38.046596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c681a1-a259-4faa-990e-ae690c7d7154 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:38.060702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 966/1933] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:38.065530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eebc67-9c8f-46c0-bafd-6eeb0728f0e0 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:38.078247 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eebc67-9c8f-46c0-bafd-6eeb0728f0e0 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:38.084971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e593a1f-4f0f-4892-959a-44de509e2c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:38.086086 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e593a1f-4f0f-4892-959a-44de509e2c70 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.087065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e593a1f-4f0f-4892-959a-44de509e2c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.087543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e593a1f-4f0f-4892-959a-44de509e2c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.089148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e593a1f-4f0f-4892-959a-44de509e2c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:38.091823 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e593a1f-4f0f-4892-959a-44de509e2c70 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:38.133990 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 968/1934] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:38 2022] POST /identity/v3/projects => generated 405 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:38.138742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c681a1-a259-4faa-990e-ae690c7d7154 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:38.152478 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c681a1-a259-4faa-990e-ae690c7d7154 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:38.156455 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92616ae-c2e5-44bf-8727-465c74617b9f None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.156971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92616ae-c2e5-44bf-8727-465c74617b9f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.157341 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92616ae-c2e5-44bf-8727-465c74617b9f None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.159122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 969/1935] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jul 27 10:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:50:38.184454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5c0de-bdd0-407c-b2a3-b11519e85f68 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.184454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5c0de-bdd0-407c-b2a3-b11519e85f68 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.184766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5c0de-bdd0-407c-b2a3-b11519e85f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.213238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-a3c5c0de-bdd0-407c-b2a3-b11519e85f68 None None] MFA Rules not processed for user `3bb16c9232464cc2aeee12b7fa918b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:38.214529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a3c5c0de-bdd0-407c-b2a3-b11519e85f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:38.240012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cfd2a-5123-4a14-a911-55bb1a817bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:38.240704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cfd2a-5123-4a14-a911-55bb1a817bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.240836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cfd2a-5123-4a14-a911-55bb1a817bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.241373 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cfd2a-5123-4a14-a911-55bb1a817bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.241951 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cfd2a-5123-4a14-a911-55bb1a817bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:38.244637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cfd2a-5123-4a14-a911-55bb1a817bb4 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:38.282389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 967/1936] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:38 2022] POST /identity/v3/users => generated 303 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:38.283315 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cfd2a-5123-4a14-a911-55bb1a817bb4 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:38.287517 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b84cfd2a-5123-4a14-a911-55bb1a817bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:38.296524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:38.300532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cfd2a-5123-4a14-a911-55bb1a817bb4 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:38.307901 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:38.308693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.309051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.309460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] PATH_INFO: `/v3/projects/3ee3ae4451104455890f161199d3a934` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.311173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee3ae4451104455890f161199d3a934)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:38.313136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:38.331465 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 970/1937] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jul 27 10:50:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:38.332324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5c0de-bdd0-407c-b2a3-b11519e85f68 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:38.347015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c5c0de-bdd0-407c-b2a3-b11519e85f68 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:38.352205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652281e-6d50-45a0-9898-c84f84de18cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:38.352861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652281e-6d50-45a0-9898-c84f84de18cb admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.353150 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652281e-6d50-45a0-9898-c84f84de18cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.353462 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652281e-6d50-45a0-9898-c84f84de18cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.354923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652281e-6d50-45a0-9898-c84f84de18cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:38.357229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652281e-6d50-45a0-9898-c84f84de18cb admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:38.370241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 971/1938] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:38.370241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652281e-6d50-45a0-9898-c84f84de18cb admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:38.373852 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6652281e-6d50-45a0-9898-c84f84de18cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:38.379270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee3ae4451104455890f161199d3a934', 'request_id': 'req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:38.387572 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee3ae4451104455890f161199d3a934', 'request_id': 'req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:38.391981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652281e-6d50-45a0-9898-c84f84de18cb admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:38.399893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:38.402730 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee3ae4451104455890f161199d3a934', 'request_id': 'req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:38.424753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] The token cache is being invalidate because project 3ee3ae4451104455890f161199d3a934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:38.425055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:38.425756 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:38.432630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 968/1939] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:38 2022] DELETE /identity/v3/projects/3ee3ae4451104455890f161199d3a934 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:38.434936 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:38.439550 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:38.515131 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892cab2-1350-421d-b34d-afcea7c9acca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:38.517239 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892cab2-1350-421d-b34d-afcea7c9acca service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.517579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892cab2-1350-421d-b34d-afcea7c9acca service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.518063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892cab2-1350-421d-b34d-afcea7c9acca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.522534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8892cab2-1350-421d-b34d-afcea7c9acca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:38.549739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892cab2-1350-421d-b34d-afcea7c9acca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:38.552397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892cab2-1350-421d-b34d-afcea7c9acca service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:38.570111 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 972/1940] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:38.572404 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee0012-4da1-4a13-bb2c-cc0a3f7e3d34 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:38.575590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f0eae-0ed1-41c7-b192-5e1eabd788e4 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.576105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f0eae-0ed1-41c7-b192-5e1eabd788e4 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.576652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f0eae-0ed1-41c7-b192-5e1eabd788e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.577939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b12b6-dc20-4b3d-b020-e27f93c34af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:38.578631 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b12b6-dc20-4b3d-b020-e27f93c34af5 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.578920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b12b6-dc20-4b3d-b020-e27f93c34af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.579202 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b12b6-dc20-4b3d-b020-e27f93c34af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.579929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b12b6-dc20-4b3d-b020-e27f93c34af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:38.581551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b12b6-dc20-4b3d-b020-e27f93c34af5 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:38.594416 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 969/1941] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:38.598920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b12b6-dc20-4b3d-b020-e27f93c34af5 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:38.614242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b12b6-dc20-4b3d-b020-e27f93c34af5 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:38.615902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-1d5f0eae-0ed1-41c7-b192-5e1eabd788e4 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:38.624940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1d5f0eae-0ed1-41c7-b192-5e1eabd788e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:38.625500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18818838-26ec-4d4c-b675-a6c43d48e6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:38.625500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18818838-26ec-4d4c-b675-a6c43d48e6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.625500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18818838-26ec-4d4c-b675-a6c43d48e6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.625500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18818838-26ec-4d4c-b675-a6c43d48e6dc admin admin] PATH_INFO: `/v3/projects/f2996534c86c49fe8f33616f43d01dd4/users/2ad90e53b6c74a32a10a41a91c183eff/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.631416 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 973/1942] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:38.635237 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08717f92-c094-44d0-951f-5d7b49b4cddb None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.635602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08717f92-c094-44d0-951f-5d7b49b4cddb None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.635953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08717f92-c094-44d0-951f-5d7b49b4cddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.645398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18818838-26ec-4d4c-b675-a6c43d48e6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2996534c86c49fe8f33616f43d01dd4, user_id=2ad90e53b6c74a32a10a41a91c183eff, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:38.649083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18818838-26ec-4d4c-b675-a6c43d48e6dc admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:38.659912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-08717f92-c094-44d0-951f-5d7b49b4cddb None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:38.661274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-08717f92-c094-44d0-951f-5d7b49b4cddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:38.672186 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 970/1943] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:38 2022] PUT /identity/v3/projects/f2996534c86c49fe8f33616f43d01dd4/users/2ad90e53b6c74a32a10a41a91c183eff/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:38.685775 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e2697-b48f-4307-9cd2-8b60dd2706fd None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.686102 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e2697-b48f-4307-9cd2-8b60dd2706fd None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.686462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e2697-b48f-4307-9cd2-8b60dd2706fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.724508 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-6a9e2697-b48f-4307-9cd2-8b60dd2706fd None None] MFA Rules not processed for user `2ad90e53b6c74a32a10a41a91c183eff`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:38.725549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6a9e2697-b48f-4307-9cd2-8b60dd2706fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:38.745510 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 974/1944] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:38.749672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08717f92-c094-44d0-951f-5d7b49b4cddb None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:38.759964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08717f92-c094-44d0-951f-5d7b49b4cddb None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:38.766680 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d618c-a65d-4390-b1e2-d3c9f47b0e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:38.767401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d618c-a65d-4390-b1e2-d3c9f47b0e52 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.767829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d618c-a65d-4390-b1e2-d3c9f47b0e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.768207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d618c-a65d-4390-b1e2-d3c9f47b0e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.768996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d618c-a65d-4390-b1e2-d3c9f47b0e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:38.769409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d618c-a65d-4390-b1e2-d3c9f47b0e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:38.771254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d618c-a65d-4390-b1e2-d3c9f47b0e52 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:38.786385 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 975/1945] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:50:38.789901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d618c-a65d-4390-b1e2-d3c9f47b0e52 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:38.808074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d618c-a65d-4390-b1e2-d3c9f47b0e52 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:38.815239 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd06618-93ed-40e3-8a1d-79f56f473260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:38.816149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd06618-93ed-40e3-8a1d-79f56f473260 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.816661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd06618-93ed-40e3-8a1d-79f56f473260 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.816948 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd06618-93ed-40e3-8a1d-79f56f473260 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.818737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd06618-93ed-40e3-8a1d-79f56f473260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:38.820690 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd06618-93ed-40e3-8a1d-79f56f473260 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:38.821957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 971/1946] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:38.831870 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e2697-b48f-4307-9cd2-8b60dd2706fd None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:38.842968 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e2697-b48f-4307-9cd2-8b60dd2706fd None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:38.848144 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece651d7-bf05-4bb5-aa59-92d29b03f6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:38.848894 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece651d7-bf05-4bb5-aa59-92d29b03f6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:38.849335 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece651d7-bf05-4bb5-aa59-92d29b03f6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:38.849864 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece651d7-bf05-4bb5-aa59-92d29b03f6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:38.850671 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece651d7-bf05-4bb5-aa59-92d29b03f6b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:38.852706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece651d7-bf05-4bb5-aa59-92d29b03f6b0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:38.890369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 976/1947] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:38 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:38.908511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd06618-93ed-40e3-8a1d-79f56f473260 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:38.935437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 972/1948] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:38 2022] POST /identity/v3/projects => generated 407 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:38.940290 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece651d7-bf05-4bb5-aa59-92d29b03f6b0 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:39.001025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:39.016769 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:39.121738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece651d7-bf05-4bb5-aa59-92d29b03f6b0 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:39.138076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604f05f-05d8-4e3d-9b64-74c04b929ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:39.140390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604f05f-05d8-4e3d-9b64-74c04b929ced admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:39.142332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604f05f-05d8-4e3d-9b64-74c04b929ced admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:39.142332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604f05f-05d8-4e3d-9b64-74c04b929ced admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:39.143059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604f05f-05d8-4e3d-9b64-74c04b929ced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:39.149125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604f05f-05d8-4e3d-9b64-74c04b929ced admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:39.181212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd06618-93ed-40e3-8a1d-79f56f473260 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:39.197038 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9289a64-f720-439e-b5f5-8066b363f9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:39.199941 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289a64-f720-439e-b5f5-8066b363f9ee admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:39.200239 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289a64-f720-439e-b5f5-8066b363f9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:39.201412 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289a64-f720-439e-b5f5-8066b363f9ee admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:39.202173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9289a64-f720-439e-b5f5-8066b363f9ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:39.202577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 973/1949] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:38 2022] POST /identity/v3/users => generated 310 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:39.205148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9289a64-f720-439e-b5f5-8066b363f9ee admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:39.207378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604f05f-05d8-4e3d-9b64-74c04b929ced admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:39.230435 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604f05f-05d8-4e3d-9b64-74c04b929ced admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:39.247018 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ed451-774a-4ff6-91de-258c2d6d8804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:39.247808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed451-774a-4ff6-91de-258c2d6d8804 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:39.248204 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed451-774a-4ff6-91de-258c2d6d8804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:39.248574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed451-774a-4ff6-91de-258c2d6d8804 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:39.249361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ed451-774a-4ff6-91de-258c2d6d8804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:39.253616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ed451-774a-4ff6-91de-258c2d6d8804 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:39.262585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 977/1950] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:38 2022] POST /identity/v3/users => generated 283 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:39.266762 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9289a64-f720-439e-b5f5-8066b363f9ee admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:39.281693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 974/1951] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:39.286608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ed451-774a-4ff6-91de-258c2d6d8804 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:39.292886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9289a64-f720-439e-b5f5-8066b363f9ee admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:39.304082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e081196-1fb5-4cf3-abc7-5a2963945042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:39.305343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e081196-1fb5-4cf3-abc7-5a2963945042 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:39.305654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e081196-1fb5-4cf3-abc7-5a2963945042 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:39.305833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ed451-774a-4ff6-91de-258c2d6d8804 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:39.305973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e081196-1fb5-4cf3-abc7-5a2963945042 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:39.309091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e081196-1fb5-4cf3-abc7-5a2963945042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:39.312675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e081196-1fb5-4cf3-abc7-5a2963945042 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:39.314496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e76b2-ae5c-4ea8-8044-0034cd7735f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:39.315413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e76b2-ae5c-4ea8-8044-0034cd7735f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:39.315702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e76b2-ae5c-4ea8-8044-0034cd7735f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:39.315986 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e76b2-ae5c-4ea8-8044-0034cd7735f1 admin admin] PATH_INFO: `/v3/projects/8b9c98b3796342a2be35e782946e8e55/users/492cb45d86d448c1a77ef16afc8a6e3c/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:39.329984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 978/1952] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:39.339999 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e76b2-ae5c-4ea8-8044-0034cd7735f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b9c98b3796342a2be35e782946e8e55, user_id=492cb45d86d448c1a77ef16afc8a6e3c, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:39.341874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e081196-1fb5-4cf3-abc7-5a2963945042 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:39.343040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e76b2-ae5c-4ea8-8044-0034cd7735f1 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:39.363046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e081196-1fb5-4cf3-abc7-5a2963945042 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:39.376415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 975/1953] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:39 2022] PUT /identity/v3/projects/8b9c98b3796342a2be35e782946e8e55/users/492cb45d86d448c1a77ef16afc8a6e3c/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:39.378314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e76b2-ae5c-4ea8-8044-0034cd7735f1 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:39.514738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e76b2-ae5c-4ea8-8044-0034cd7735f1 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:39.532101 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f26ca8-e354-4a97-a3c1-c17daa2a3625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:39.533404 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f26ca8-e354-4a97-a3c1-c17daa2a3625 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:39.533866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f26ca8-e354-4a97-a3c1-c17daa2a3625 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:39.534322 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f26ca8-e354-4a97-a3c1-c17daa2a3625 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:39.535281 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f26ca8-e354-4a97-a3c1-c17daa2a3625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:39.537779 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f26ca8-e354-4a97-a3c1-c17daa2a3625 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:39.548724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b37e9-647c-4d23-aa30-4e249138f848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:39.549375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b37e9-647c-4d23-aa30-4e249138f848 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:39.549661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b37e9-647c-4d23-aa30-4e249138f848 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:39.549940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b37e9-647c-4d23-aa30-4e249138f848 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:39.550686 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b37e9-647c-4d23-aa30-4e249138f848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:39.552318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b37e9-647c-4d23-aa30-4e249138f848 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:39.554603 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 976/1954] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:39.568644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f26ca8-e354-4a97-a3c1-c17daa2a3625 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:39.582539 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 979/1955] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:39.586869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b37e9-647c-4d23-aa30-4e249138f848 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:39.595289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f26ca8-e354-4a97-a3c1-c17daa2a3625 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:39.604588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b37e9-647c-4d23-aa30-4e249138f848 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:39.607549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62724ce2-5b6b-42c2-8fa3-f50565d8685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:39.608561 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62724ce2-5b6b-42c2-8fa3-f50565d8685e admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:39.609374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62724ce2-5b6b-42c2-8fa3-f50565d8685e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:39.609883 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62724ce2-5b6b-42c2-8fa3-f50565d8685e admin admin] PATH_INFO: `/v3/projects/8b9c98b3796342a2be35e782946e8e55/users/492cb45d86d448c1a77ef16afc8a6e3c/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:39.613474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62724ce2-5b6b-42c2-8fa3-f50565d8685e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b9c98b3796342a2be35e782946e8e55, user_id=492cb45d86d448c1a77ef16afc8a6e3c, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:39.613641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ffca5-55d4-4e3f-969e-3c960b56aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:39.616309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ffca5-55d4-4e3f-969e-3c960b56aed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:39.617205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ffca5-55d4-4e3f-969e-3c960b56aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:39.617915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ffca5-55d4-4e3f-969e-3c960b56aed2 admin admin] PATH_INFO: `/v3/projects/f5f8305d4bd24d53b63d67ebebd4ee79/users/3da55416a93d44d0be4292d1db2c305c/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:39.623218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62724ce2-5b6b-42c2-8fa3-f50565d8685e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:39.647179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ffca5-55d4-4e3f-969e-3c960b56aed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f8305d4bd24d53b63d67ebebd4ee79, user_id=3da55416a93d44d0be4292d1db2c305c, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:39.650898 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ffca5-55d4-4e3f-969e-3c960b56aed2 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:39.651619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 977/1956] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:39 2022] PUT /identity/v3/projects/8b9c98b3796342a2be35e782946e8e55/users/492cb45d86d448c1a77ef16afc8a6e3c/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:39.674428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149224-2758-4218-a4e3-126c853c8980 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:39.675286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149224-2758-4218-a4e3-126c853c8980 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:39.675882 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149224-2758-4218-a4e3-126c853c8980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:39.692041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 980/1957] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:39 2022] PUT /identity/v3/projects/f5f8305d4bd24d53b63d67ebebd4ee79/users/3da55416a93d44d0be4292d1db2c305c/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:39.695273 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22095af0-fd2b-4db9-9a91-e1db4ec561d0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:39.695645 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22095af0-fd2b-4db9-9a91-e1db4ec561d0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:39.695886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22095af0-fd2b-4db9-9a91-e1db4ec561d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:39.726106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-22095af0-fd2b-4db9-9a91-e1db4ec561d0 None None] MFA Rules not processed for user `3da55416a93d44d0be4292d1db2c305c`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:39.727388 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-22095af0-fd2b-4db9-9a91-e1db4ec561d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:39.730618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-cd149224-2758-4218-a4e3-126c853c8980 None None] MFA Rules not processed for user `492cb45d86d448c1a77ef16afc8a6e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:39.733579 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-cd149224-2758-4218-a4e3-126c853c8980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:39.789267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:39.803487 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 981/1958] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:39.806711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:39.809269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22095af0-fd2b-4db9-9a91-e1db4ec561d0 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:39.858699 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 978/1959] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:39 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:39.867895 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd149224-2758-4218-a4e3-126c853c8980 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:39.872529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-cd149224-2758-4218-a4e3-126c853c8980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:39.937652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22095af0-fd2b-4db9-9a91-e1db4ec561d0 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:39.942404 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6d187-7516-47ff-a9c7-460daeef0619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:39.943066 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6d187-7516-47ff-a9c7-460daeef0619 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:39.943429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6d187-7516-47ff-a9c7-460daeef0619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:39.943882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6d187-7516-47ff-a9c7-460daeef0619 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:39.945077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6d187-7516-47ff-a9c7-460daeef0619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:39.946753 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6d187-7516-47ff-a9c7-460daeef0619 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:39.985644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 982/1960] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:39 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:39.989484 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6d187-7516-47ff-a9c7-460daeef0619 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:39.991188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd149224-2758-4218-a4e3-126c853c8980 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:40.077820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c9c9d-a895-4cf9-a143-73ad9cdb1339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:40.080294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c9c9d-a895-4cf9-a143-73ad9cdb1339 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:40.080588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c9c9d-a895-4cf9-a143-73ad9cdb1339 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:40.080914 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c9c9d-a895-4cf9-a143-73ad9cdb1339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:40.090241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6d187-7516-47ff-a9c7-460daeef0619 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:40.131572 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309589c1-08be-47b3-88d4-9012bdb84546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:40.132226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309589c1-08be-47b3-88d4-9012bdb84546 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:40.132515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309589c1-08be-47b3-88d4-9012bdb84546 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:40.132790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309589c1-08be-47b3-88d4-9012bdb84546 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:40.133809 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309589c1-08be-47b3-88d4-9012bdb84546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:40.136193 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309589c1-08be-47b3-88d4-9012bdb84546 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:40.194414 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c9c9d-a895-4cf9-a143-73ad9cdb1339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:40.196134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c9c9d-a895-4cf9-a143-73ad9cdb1339 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:40.209477 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 983/1961] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:39 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:40.212741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309589c1-08be-47b3-88d4-9012bdb84546 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:40.230507 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 979/1962] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:39 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:40.269070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309589c1-08be-47b3-88d4-9012bdb84546 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:40.294359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29b098-7b26-4b30-a775-8398e7c75bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:40.295780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29b098-7b26-4b30-a775-8398e7c75bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:40.296647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29b098-7b26-4b30-a775-8398e7c75bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:40.297554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29b098-7b26-4b30-a775-8398e7c75bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:40.300007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29b098-7b26-4b30-a775-8398e7c75bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:40.310582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29b098-7b26-4b30-a775-8398e7c75bf5 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:40.357407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 984/1963] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:40.361370 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c9c9d-a895-4cf9-a143-73ad9cdb1339 service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:40.378322 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c9c9d-a895-4cf9-a143-73ad9cdb1339 service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:40.392735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc40795-4b0f-4fe3-ba40-395a6339177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:40.397282 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc40795-4b0f-4fe3-ba40-395a6339177e admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:40.397586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc40795-4b0f-4fe3-ba40-395a6339177e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:40.397909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc40795-4b0f-4fe3-ba40-395a6339177e admin admin] PATH_INFO: `/v3/projects/d817bb8f53d64e8e8b212eb92c29c2c6/users/8e4243e2c9854db4b606822c4d94297b/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:40.456855 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc40795-4b0f-4fe3-ba40-395a6339177e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d817bb8f53d64e8e8b212eb92c29c2c6, user_id=8e4243e2c9854db4b606822c4d94297b, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:40.464866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc40795-4b0f-4fe3-ba40-395a6339177e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:40.511812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 980/1964] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:40 2022] PUT /identity/v3/projects/d817bb8f53d64e8e8b212eb92c29c2c6/users/8e4243e2c9854db4b606822c4d94297b/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:40.517574 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29b098-7b26-4b30-a775-8398e7c75bf5 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:40.550360 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29b098-7b26-4b30-a775-8398e7c75bf5 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:40.579128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc40795-4b0f-4fe3-ba40-395a6339177e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:40.630880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:40.681713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc40795-4b0f-4fe3-ba40-395a6339177e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:40.687936 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a293cd-9d8b-4dcd-9b0c-5940ffe06cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:40.688862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a293cd-9d8b-4dcd-9b0c-5940ffe06cea service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:40.689295 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a293cd-9d8b-4dcd-9b0c-5940ffe06cea service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:40.689815 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a293cd-9d8b-4dcd-9b0c-5940ffe06cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:40.716529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:40.739902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d028aa5-c82c-42f2-9043-e3038bebda01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:40.743398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d028aa5-c82c-42f2-9043-e3038bebda01 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:40.743694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d028aa5-c82c-42f2-9043-e3038bebda01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:40.744077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d028aa5-c82c-42f2-9043-e3038bebda01 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:40.744971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d028aa5-c82c-42f2-9043-e3038bebda01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:40.749315 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d028aa5-c82c-42f2-9043-e3038bebda01 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:40.778737 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a293cd-9d8b-4dcd-9b0c-5940ffe06cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:40.780450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a293cd-9d8b-4dcd-9b0c-5940ffe06cea service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:40.787909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 985/1965] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:40.793012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d028aa5-c82c-42f2-9043-e3038bebda01 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:40.804540 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 981/1966] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:40 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:40.830936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d028aa5-c82c-42f2-9043-e3038bebda01 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:40.838720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd6163-bed2-4d7e-a582-508c8b0d047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:40.838720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd6163-bed2-4d7e-a582-508c8b0d047a admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:40.838720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd6163-bed2-4d7e-a582-508c8b0d047a admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:40.838720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd6163-bed2-4d7e-a582-508c8b0d047a admin admin] PATH_INFO: `/v3/projects/d817bb8f53d64e8e8b212eb92c29c2c6/users/8e4243e2c9854db4b606822c4d94297b/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:40.842986 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd6163-bed2-4d7e-a582-508c8b0d047a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d817bb8f53d64e8e8b212eb92c29c2c6, user_id=8e4243e2c9854db4b606822c4d94297b, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:40.850294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd6163-bed2-4d7e-a582-508c8b0d047a admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:40.881475 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 986/1967] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:40 2022] PUT /identity/v3/projects/d817bb8f53d64e8e8b212eb92c29c2c6/users/8e4243e2c9854db4b606822c4d94297b/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:40.896573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044abb68-517c-4030-9b18-51e0ee2ce8a4 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:40.897072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044abb68-517c-4030-9b18-51e0ee2ce8a4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:40.897152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044abb68-517c-4030-9b18-51e0ee2ce8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:41.005337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-044abb68-517c-4030-9b18-51e0ee2ce8a4 None None] MFA Rules not processed for user `8e4243e2c9854db4b606822c4d94297b`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:41.009088 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-044abb68-517c-4030-9b18-51e0ee2ce8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:41.169087 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 982/1968] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:41.330618 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd6163-bed2-4d7e-a582-508c8b0d047a admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:41.465190 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd6163-bed2-4d7e-a582-508c8b0d047a admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:41.469874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d0390-2e4b-4a26-83bc-899253778a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:41.470105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0390-2e4b-4a26-83bc-899253778a96 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:41.470397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0390-2e4b-4a26-83bc-899253778a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:41.470778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d0390-2e4b-4a26-83bc-899253778a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:41.495859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d0390-2e4b-4a26-83bc-899253778a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:41.497301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d0390-2e4b-4a26-83bc-899253778a96 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:41.537482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 987/1969] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:41 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:41.674214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044abb68-517c-4030-9b18-51e0ee2ce8a4 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:41.676466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-044abb68-517c-4030-9b18-51e0ee2ce8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:41.749436 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d0390-2e4b-4a26-83bc-899253778a96 service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:41.751334 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-db2d0390-2e4b-4a26-83bc-899253778a96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:41.767398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d0390-2e4b-4a26-83bc-899253778a96 service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:41.779003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7acc5-544f-4321-8afb-29cfc1506abe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:41.780003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7acc5-544f-4321-8afb-29cfc1506abe service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:41.780549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7acc5-544f-4321-8afb-29cfc1506abe service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:41.781036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7acc5-544f-4321-8afb-29cfc1506abe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:41.843475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044abb68-517c-4030-9b18-51e0ee2ce8a4 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:41.859821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170ae4d-d5a1-4196-860a-d9fe2d71a495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:41.862662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ae4d-d5a1-4196-860a-d9fe2d71a495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:41.863522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ae4d-d5a1-4196-860a-d9fe2d71a495 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:41.865854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ae4d-d5a1-4196-860a-d9fe2d71a495 admin admin] PATH_INFO: `/v3/users/007948c806884ccd9988deabe04e8e29` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:41.868466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170ae4d-d5a1-4196-860a-d9fe2d71a495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=007948c806884ccd9988deabe04e8e29)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:41.873157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170ae4d-d5a1-4196-860a-d9fe2d71a495 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:41.901592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:41.934538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7acc5-544f-4321-8afb-29cfc1506abe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:41.936508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7acc5-544f-4321-8afb-29cfc1506abe service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:41.950276 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 988/1970] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:50:42.000012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4170ae4d-d5a1-4196-860a-d9fe2d71a495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '007948c806884ccd9988deabe04e8e29'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:42.000920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4170ae4d-d5a1-4196-860a-d9fe2d71a495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '007948c806884ccd9988deabe04e8e29'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:42.015168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4170ae4d-d5a1-4196-860a-d9fe2d71a495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '007948c806884ccd9988deabe04e8e29'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:42.015850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4170ae4d-d5a1-4196-860a-d9fe2d71a495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '007948c806884ccd9988deabe04e8e29'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:42.027451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4170ae4d-d5a1-4196-860a-d9fe2d71a495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '007948c806884ccd9988deabe04e8e29'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:42.061184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 983/1971] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:41 2022] DELETE /identity/v3/users/007948c806884ccd9988deabe04e8e29 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:42.062781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23051dc-a619-4f2c-ae2c-852eeb4f913f None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:42.063076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23051dc-a619-4f2c-ae2c-852eeb4f913f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:42.063355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23051dc-a619-4f2c-ae2c-852eeb4f913f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:42.090759 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-a23051dc-a619-4f2c-ae2c-852eeb4f913f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:42.093551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a23051dc-a619-4f2c-ae2c-852eeb4f913f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:42.274954 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 989/1972] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:42.295182 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170ae4d-d5a1-4196-860a-d9fe2d71a495 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:42.298270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4170ae4d-d5a1-4196-860a-d9fe2d71a495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:42.419241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170ae4d-d5a1-4196-860a-d9fe2d71a495 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:42.425431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87fd55-222d-4f9d-a7a6-25caf5966607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:42.426300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87fd55-222d-4f9d-a7a6-25caf5966607 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:42.426823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87fd55-222d-4f9d-a7a6-25caf5966607 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:42.427181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87fd55-222d-4f9d-a7a6-25caf5966607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:42.440882 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87fd55-222d-4f9d-a7a6-25caf5966607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:42.443459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87fd55-222d-4f9d-a7a6-25caf5966607 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:42.485342 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 984/1973] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:43.174084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23051dc-a619-4f2c-ae2c-852eeb4f913f None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:43.177137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a23051dc-a619-4f2c-ae2c-852eeb4f913f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:43.198856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23051dc-a619-4f2c-ae2c-852eeb4f913f None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:43.216209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:43.217685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:43.220019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:43.220531 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e admin admin] PATH_INFO: `/v3/projects/b23b694ea7244326aa1bf796423bf38a` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:43.225300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23b694ea7244326aa1bf796423bf38a)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:43.229843 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:43.261466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:43.313619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23b694ea7244326aa1bf796423bf38a', 'request_id': 'req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:43.321431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23b694ea7244326aa1bf796423bf38a', 'request_id': 'req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:43.332520 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23b694ea7244326aa1bf796423bf38a', 'request_id': 'req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:43.368065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e admin admin] The token cache is being invalidate because project b23b694ea7244326aa1bf796423bf38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:43.368769 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:43.371248 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-094ab64a-6e5b-4b1b-bc34-2935847cbe6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:43.378799 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 990/1974] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:43 2022] DELETE /identity/v3/projects/b23b694ea7244326aa1bf796423bf38a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:43.383978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b970098-2389-486e-a3a9-7ff3cbcd600d None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:43.385110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b970098-2389-486e-a3a9-7ff3cbcd600d None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:43.385788 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b970098-2389-486e-a3a9-7ff3cbcd600d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:43.429599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-8b970098-2389-486e-a3a9-7ff3cbcd600d None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:43.432146 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-8b970098-2389-486e-a3a9-7ff3cbcd600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:43.607772 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 985/1975] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:43.615795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb714b6-9077-492d-9e2a-3a11d5e3bbd2 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:43.616118 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb714b6-9077-492d-9e2a-3a11d5e3bbd2 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:43.616528 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb714b6-9077-492d-9e2a-3a11d5e3bbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:43.654651 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-3fb714b6-9077-492d-9e2a-3a11d5e3bbd2 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:43.654651 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3fb714b6-9077-492d-9e2a-3a11d5e3bbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:43.661361 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 991/1976] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:43.666792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b970098-2389-486e-a3a9-7ff3cbcd600d None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:43.679692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b970098-2389-486e-a3a9-7ff3cbcd600d None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:43.687679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b6bdc-3cc8-4e8d-8a5a-88537e253b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:43.688507 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b6bdc-3cc8-4e8d-8a5a-88537e253b56 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:43.688956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b6bdc-3cc8-4e8d-8a5a-88537e253b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:43.689358 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b6bdc-3cc8-4e8d-8a5a-88537e253b56 admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:43.690424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b6bdc-3cc8-4e8d-8a5a-88537e253b56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:43.691026 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b6bdc-3cc8-4e8d-8a5a-88537e253b56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:43.693338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b6bdc-3cc8-4e8d-8a5a-88537e253b56 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:43.716454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 986/1977] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:43.720610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb714b6-9077-492d-9e2a-3a11d5e3bbd2 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:43.732928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb714b6-9077-492d-9e2a-3a11d5e3bbd2 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:43.741041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e5c3b-2500-4201-bccf-69d17974f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:43.742679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e5c3b-2500-4201-bccf-69d17974f6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:43.743177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e5c3b-2500-4201-bccf-69d17974f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:43.743670 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e5c3b-2500-4201-bccf-69d17974f6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:43.745556 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e5c3b-2500-4201-bccf-69d17974f6d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:43.748978 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e5c3b-2500-4201-bccf-69d17974f6d1 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:43.787516 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 992/1978] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:43 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:43.793205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b6bdc-3cc8-4e8d-8a5a-88537e253b56 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:43.809834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b6bdc-3cc8-4e8d-8a5a-88537e253b56 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:43.830802 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:43.887914 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910cbe0-04ab-43d8-9407-35350eb6f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:43.888753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910cbe0-04ab-43d8-9407-35350eb6f461 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:43.889038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910cbe0-04ab-43d8-9407-35350eb6f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:43.889508 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910cbe0-04ab-43d8-9407-35350eb6f461 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:43.890474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910cbe0-04ab-43d8-9407-35350eb6f461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:43.892536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910cbe0-04ab-43d8-9407-35350eb6f461 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:43.918308 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 987/1979] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:43 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:43.922501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e5c3b-2500-4201-bccf-69d17974f6d1 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:43.935231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e5c3b-2500-4201-bccf-69d17974f6d1 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:43.941726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c15511-fc75-4ea8-9ed6-6b8734f1bb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:43.942520 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c15511-fc75-4ea8-9ed6-6b8734f1bb87 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:43.942825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c15511-fc75-4ea8-9ed6-6b8734f1bb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:43.943096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c15511-fc75-4ea8-9ed6-6b8734f1bb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:43.943839 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c15511-fc75-4ea8-9ed6-6b8734f1bb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:43.945579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c15511-fc75-4ea8-9ed6-6b8734f1bb87 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:43.962254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 993/1980] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:50:43.963902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910cbe0-04ab-43d8-9407-35350eb6f461 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:43.978724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910cbe0-04ab-43d8-9407-35350eb6f461 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:43.990342 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7694d3-3b7d-4c9a-b399-a28ff9cf9af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:43.991032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7694d3-3b7d-4c9a-b399-a28ff9cf9af0 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:43.991366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7694d3-3b7d-4c9a-b399-a28ff9cf9af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:43.992724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7694d3-3b7d-4c9a-b399-a28ff9cf9af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:43.992724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7694d3-3b7d-4c9a-b399-a28ff9cf9af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:43.995206 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7694d3-3b7d-4c9a-b399-a28ff9cf9af0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:44.012708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 988/1981] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:44.027563 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c15511-fc75-4ea8-9ed6-6b8734f1bb87 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:44.039134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c15511-fc75-4ea8-9ed6-6b8734f1bb87 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:44.044858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59963a-9884-4331-9ef9-9544019fe87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:44.045742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59963a-9884-4331-9ef9-9544019fe87d admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:44.046067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59963a-9884-4331-9ef9-9544019fe87d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:44.046333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59963a-9884-4331-9ef9-9544019fe87d admin admin] PATH_INFO: `/v3/projects/a2ecf39f9ada4e44bb6936260d030a1d/users/cf233c558d034ea984161bbe3a5fea39/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:44.065200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59963a-9884-4331-9ef9-9544019fe87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ecf39f9ada4e44bb6936260d030a1d, user_id=cf233c558d034ea984161bbe3a5fea39, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:44.068072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59963a-9884-4331-9ef9-9544019fe87d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:44.091470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 994/1982] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:44 2022] PUT /identity/v3/projects/a2ecf39f9ada4e44bb6936260d030a1d/users/cf233c558d034ea984161bbe3a5fea39/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:44.111446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7244f02-e5cc-426a-97f7-b867da75a49b None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:44.111793 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7244f02-e5cc-426a-97f7-b867da75a49b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:44.112142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7244f02-e5cc-426a-97f7-b867da75a49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:44.152454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-c7244f02-e5cc-426a-97f7-b867da75a49b None None] MFA Rules not processed for user `cf233c558d034ea984161bbe3a5fea39`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:44.154050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c7244f02-e5cc-426a-97f7-b867da75a49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:44.233018 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 989/1983] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:44.237817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59963a-9884-4331-9ef9-9544019fe87d admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:44.332820 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59963a-9884-4331-9ef9-9544019fe87d admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:44.338900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb649d75-862a-44cd-bd9b-5cde9a749cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:44.339565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb649d75-862a-44cd-bd9b-5cde9a749cee admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:44.339857 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb649d75-862a-44cd-bd9b-5cde9a749cee admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:44.340842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb649d75-862a-44cd-bd9b-5cde9a749cee admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:44.341654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb649d75-862a-44cd-bd9b-5cde9a749cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:44.344445 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb649d75-862a-44cd-bd9b-5cde9a749cee admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:44.381840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 995/1984] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:44 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:44.387029 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7244f02-e5cc-426a-97f7-b867da75a49b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:44.403533 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7244f02-e5cc-426a-97f7-b867da75a49b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:44.482557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e9a87-785e-44e2-9ba6-6384dc064ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:44.483773 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e9a87-785e-44e2-9ba6-6384dc064ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:44.484258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e9a87-785e-44e2-9ba6-6384dc064ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:44.484707 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e9a87-785e-44e2-9ba6-6384dc064ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:44.485597 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e9a87-785e-44e2-9ba6-6384dc064ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:44.488161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e9a87-785e-44e2-9ba6-6384dc064ee0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:44.526938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 990/1985] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:44 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:44.528750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb649d75-862a-44cd-bd9b-5cde9a749cee admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:44.542998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb649d75-862a-44cd-bd9b-5cde9a749cee admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:44.550981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d498294-7b43-4146-9e3c-08624c0a10ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:44.551470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d498294-7b43-4146-9e3c-08624c0a10ae admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:44.551750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d498294-7b43-4146-9e3c-08624c0a10ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:44.552032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d498294-7b43-4146-9e3c-08624c0a10ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:44.552741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d498294-7b43-4146-9e3c-08624c0a10ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:44.554554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d498294-7b43-4146-9e3c-08624c0a10ae admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:44.572536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 996/1986] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:44.576359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e9a87-785e-44e2-9ba6-6384dc064ee0 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:44.592446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e9a87-785e-44e2-9ba6-6384dc064ee0 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:44.612001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5e997-c2bb-407b-b325-8982442a57b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:44.612649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5e997-c2bb-407b-b325-8982442a57b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:44.612922 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5e997-c2bb-407b-b325-8982442a57b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:44.613200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5e997-c2bb-407b-b325-8982442a57b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:44.613922 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5e997-c2bb-407b-b325-8982442a57b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:44.615591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5e997-c2bb-407b-b325-8982442a57b1 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:44.652151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 991/1987] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:44.653082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d498294-7b43-4146-9e3c-08624c0a10ae admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:44.668154 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d498294-7b43-4146-9e3c-08624c0a10ae admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:44.694575 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c456b-241e-4175-b806-fc14786bcdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:44.695527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c456b-241e-4175-b806-fc14786bcdf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:44.695850 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c456b-241e-4175-b806-fc14786bcdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:44.696134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c456b-241e-4175-b806-fc14786bcdf7 admin admin] PATH_INFO: `/v3/projects/272f3f9217d244dfb8ec31828fd4ad25/users/b926c16be0364e3c9b622971d0d1975f/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:44.736556 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:44.742873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c456b-241e-4175-b806-fc14786bcdf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=272f3f9217d244dfb8ec31828fd4ad25, user_id=b926c16be0364e3c9b622971d0d1975f, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:44.748906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c456b-241e-4175-b806-fc14786bcdf7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:44.780920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef3a8c-d0af-48f3-9be7-478200dce9ce None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:44.781261 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef3a8c-d0af-48f3-9be7-478200dce9ce None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:44.781475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef3a8c-d0af-48f3-9be7-478200dce9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:44.784594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 997/1988] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:44 2022] PUT /identity/v3/projects/272f3f9217d244dfb8ec31828fd4ad25/users/b926c16be0364e3c9b622971d0d1975f/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:44.790302 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:44.833822 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-91ef3a8c-d0af-48f3-9be7-478200dce9ce None None] MFA Rules not processed for user `b926c16be0364e3c9b622971d0d1975f`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:44.839346 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-91ef3a8c-d0af-48f3-9be7-478200dce9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:45.040268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 992/1989] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:45.046643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c456b-241e-4175-b806-fc14786bcdf7 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:45.210151 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c456b-241e-4175-b806-fc14786bcdf7 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:45.219938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b424ab-42a8-49ab-97bc-af532dd1313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:45.220889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b424ab-42a8-49ab-97bc-af532dd1313b admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:45.221569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b424ab-42a8-49ab-97bc-af532dd1313b admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:45.222095 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b424ab-42a8-49ab-97bc-af532dd1313b admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:45.223629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b424ab-42a8-49ab-97bc-af532dd1313b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:45.226331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b424ab-42a8-49ab-97bc-af532dd1313b admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:45.291923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 998/1990] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:45 2022] POST /identity/v3/projects => generated 375 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:45.297848 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef3a8c-d0af-48f3-9be7-478200dce9ce None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:45.316093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef3a8c-d0af-48f3-9be7-478200dce9ce None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:45.399669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4871c-f327-4d79-acd7-f96916cfd28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:45.401792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4871c-f327-4d79-acd7-f96916cfd28e admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:45.402111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4871c-f327-4d79-acd7-f96916cfd28e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:45.402442 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4871c-f327-4d79-acd7-f96916cfd28e admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:45.403146 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4871c-f327-4d79-acd7-f96916cfd28e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:45.405134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4871c-f327-4d79-acd7-f96916cfd28e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:45.430439 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 993/1991] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:45 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:45.435495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b424ab-42a8-49ab-97bc-af532dd1313b admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:45.454704 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b424ab-42a8-49ab-97bc-af532dd1313b admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:45.470763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971af4f-99a2-43e8-b84c-9dfc540f8846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:45.471628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971af4f-99a2-43e8-b84c-9dfc540f8846 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:45.472118 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971af4f-99a2-43e8-b84c-9dfc540f8846 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:45.473115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971af4f-99a2-43e8-b84c-9dfc540f8846 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:45.473763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971af4f-99a2-43e8-b84c-9dfc540f8846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:45.475823 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971af4f-99a2-43e8-b84c-9dfc540f8846 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:45.492040 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 999/1992] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:45.504370 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4871c-f327-4d79-acd7-f96916cfd28e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:45.516883 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4871c-f327-4d79-acd7-f96916cfd28e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:45.521860 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3344f6b-3bc3-444a-88ac-3cc678c0b13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:45.522626 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3344f6b-3bc3-444a-88ac-3cc678c0b13e admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:45.523711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3344f6b-3bc3-444a-88ac-3cc678c0b13e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:45.523711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3344f6b-3bc3-444a-88ac-3cc678c0b13e admin admin] PATH_INFO: `/v3/projects/31b61b9ef9f1488c93d43e0c231e520e/users/1fb9ab043aad4d4381b48443e4eb8b07/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:45.552786 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3344f6b-3bc3-444a-88ac-3cc678c0b13e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b61b9ef9f1488c93d43e0c231e520e, user_id=1fb9ab043aad4d4381b48443e4eb8b07, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:45.560394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3344f6b-3bc3-444a-88ac-3cc678c0b13e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:45.591618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 994/1993] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:45 2022] PUT /identity/v3/projects/31b61b9ef9f1488c93d43e0c231e520e/users/1fb9ab043aad4d4381b48443e4eb8b07/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:45.591748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971af4f-99a2-43e8-b84c-9dfc540f8846 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:45.604767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971af4f-99a2-43e8-b84c-9dfc540f8846 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:45.691076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49b915-0fb9-47e9-8016-853380a6575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:45.691704 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49b915-0fb9-47e9-8016-853380a6575f admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:45.691969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49b915-0fb9-47e9-8016-853380a6575f admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:45.692264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49b915-0fb9-47e9-8016-853380a6575f admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:45.692989 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49b915-0fb9-47e9-8016-853380a6575f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:45.694694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49b915-0fb9-47e9-8016-853380a6575f admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:45.707612 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1000/1994] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:50:45.713453 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3344f6b-3bc3-444a-88ac-3cc678c0b13e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:45.724117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3344f6b-3bc3-444a-88ac-3cc678c0b13e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:45.729906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e999e28-89b7-4ea2-a6ba-322817f97839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:45.730677 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999e28-89b7-4ea2-a6ba-322817f97839 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:45.730961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999e28-89b7-4ea2-a6ba-322817f97839 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:45.731241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999e28-89b7-4ea2-a6ba-322817f97839 admin admin] PATH_INFO: `/v3/projects/31b61b9ef9f1488c93d43e0c231e520e/users/1fb9ab043aad4d4381b48443e4eb8b07/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:45.734023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e999e28-89b7-4ea2-a6ba-322817f97839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b61b9ef9f1488c93d43e0c231e520e, user_id=1fb9ab043aad4d4381b48443e4eb8b07, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:45.736064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e999e28-89b7-4ea2-a6ba-322817f97839 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:45.748244 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 995/1995] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:45 2022] PUT /identity/v3/projects/31b61b9ef9f1488c93d43e0c231e520e/users/1fb9ab043aad4d4381b48443e4eb8b07/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:45.760541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b856e-3418-422d-9376-b52e3c8961ea None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:45.760909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b856e-3418-422d-9376-b52e3c8961ea None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:45.761262 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b856e-3418-422d-9376-b52e3c8961ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:45.802476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-129b856e-3418-422d-9376-b52e3c8961ea None None] MFA Rules not processed for user `1fb9ab043aad4d4381b48443e4eb8b07`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:45.803869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-129b856e-3418-422d-9376-b52e3c8961ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:45.903064 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:45.933676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1001/1996] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:45.956574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e999e28-89b7-4ea2-a6ba-322817f97839 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:45.959217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1e999e28-89b7-4ea2-a6ba-322817f97839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:46.042498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:46.055899 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e999e28-89b7-4ea2-a6ba-322817f97839 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:46.060601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258a4b0-10e6-42cf-a2cd-157c41629cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:46.061309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258a4b0-10e6-42cf-a2cd-157c41629cfa service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:46.061676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258a4b0-10e6-42cf-a2cd-157c41629cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:46.061994 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258a4b0-10e6-42cf-a2cd-157c41629cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:46.173594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258a4b0-10e6-42cf-a2cd-157c41629cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:46.176120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258a4b0-10e6-42cf-a2cd-157c41629cfa service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:46.191240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 996/1997] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:46.383542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b856e-3418-422d-9376-b52e3c8961ea None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:46.387143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-129b856e-3418-422d-9376-b52e3c8961ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:46.544737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b856e-3418-422d-9376-b52e3c8961ea None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:46.561198 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b182d-87a5-4963-a91e-d117e9e9a826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:46.562304 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b182d-87a5-4963-a91e-d117e9e9a826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:46.563138 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b182d-87a5-4963-a91e-d117e9e9a826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:46.563961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b182d-87a5-4963-a91e-d117e9e9a826 admin admin] PATH_INFO: `/v3/users/2ad90e53b6c74a32a10a41a91c183eff` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:46.567902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b182d-87a5-4963-a91e-d117e9e9a826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad90e53b6c74a32a10a41a91c183eff)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:46.572623 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b182d-87a5-4963-a91e-d117e9e9a826 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:46.668956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bf6b182d-87a5-4963-a91e-d117e9e9a826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad90e53b6c74a32a10a41a91c183eff'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:46.670505 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bf6b182d-87a5-4963-a91e-d117e9e9a826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad90e53b6c74a32a10a41a91c183eff'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:46.686688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bf6b182d-87a5-4963-a91e-d117e9e9a826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad90e53b6c74a32a10a41a91c183eff'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:46.702237 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bf6b182d-87a5-4963-a91e-d117e9e9a826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad90e53b6c74a32a10a41a91c183eff'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:46.703582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bf6b182d-87a5-4963-a91e-d117e9e9a826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad90e53b6c74a32a10a41a91c183eff'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:46.766308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1002/1998] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:46 2022] DELETE /identity/v3/users/2ad90e53b6c74a32a10a41a91c183eff => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:46.774177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e01fe-40dc-4c76-9484-9652a1117c82 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:46.774742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e01fe-40dc-4c76-9484-9652a1117c82 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:46.775205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e01fe-40dc-4c76-9484-9652a1117c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:46.882315 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-c98e01fe-40dc-4c76-9484-9652a1117c82 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:46.885217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c98e01fe-40dc-4c76-9484-9652a1117c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:47.088598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 997/1999] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:47.113969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b182d-87a5-4963-a91e-d117e9e9a826 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:47.117486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-bf6b182d-87a5-4963-a91e-d117e9e9a826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:47.153947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e01fe-40dc-4c76-9484-9652a1117c82 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:47.155506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c98e01fe-40dc-4c76-9484-9652a1117c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:47.181774 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e01fe-40dc-4c76-9484-9652a1117c82 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:47.195838 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dd231-1265-46db-86da-1ed132027fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:47.197385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dd231-1265-46db-86da-1ed132027fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:47.197661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dd231-1265-46db-86da-1ed132027fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:47.198055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dd231-1265-46db-86da-1ed132027fa3 admin admin] PATH_INFO: `/v3/users/cb56813658cd4fa591d9a4c12c8bb833` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:47.202773 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dd231-1265-46db-86da-1ed132027fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb56813658cd4fa591d9a4c12c8bb833)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:47.207033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dd231-1265-46db-86da-1ed132027fa3 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:47.269290 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b182d-87a5-4963-a91e-d117e9e9a826 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:47.276235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a848509-dbb2-41d8-9cd3-63396f8143cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:47.279035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848509-dbb2-41d8-9cd3-63396f8143cf service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:47.279443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848509-dbb2-41d8-9cd3-63396f8143cf service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:47.279804 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848509-dbb2-41d8-9cd3-63396f8143cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:47.313934 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a848509-dbb2-41d8-9cd3-63396f8143cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:47.316302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a848509-dbb2-41d8-9cd3-63396f8143cf service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:47.349889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1003/2000] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:47.426201 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4c2dd231-1265-46db-86da-1ed132027fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb56813658cd4fa591d9a4c12c8bb833'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:47.427723 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4c2dd231-1265-46db-86da-1ed132027fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb56813658cd4fa591d9a4c12c8bb833'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:47.447530 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4c2dd231-1265-46db-86da-1ed132027fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb56813658cd4fa591d9a4c12c8bb833'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:47.448162 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4c2dd231-1265-46db-86da-1ed132027fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb56813658cd4fa591d9a4c12c8bb833'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:47.461583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4c2dd231-1265-46db-86da-1ed132027fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb56813658cd4fa591d9a4c12c8bb833'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:47.502246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 998/2001] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:47 2022] DELETE /identity/v3/users/cb56813658cd4fa591d9a4c12c8bb833 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:47.508485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546dab8-9ffe-4c11-b9fc-9f31244ac798 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:47.509362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546dab8-9ffe-4c11-b9fc-9f31244ac798 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:47.516298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546dab8-9ffe-4c11-b9fc-9f31244ac798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:47.554783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-3546dab8-9ffe-4c11-b9fc-9f31244ac798 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:47.556533 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3546dab8-9ffe-4c11-b9fc-9f31244ac798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:47.562163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:47.670277 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1004/2002] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:47.707368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dd231-1265-46db-86da-1ed132027fa3 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:47.710558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4c2dd231-1265-46db-86da-1ed132027fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:47.745362 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:47.831646 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dd231-1265-46db-86da-1ed132027fa3 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:47.839348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f32f9-fa43-4731-a017-9c889109a547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:47.840191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f32f9-fa43-4731-a017-9c889109a547 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:47.840633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f32f9-fa43-4731-a017-9c889109a547 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:47.841067 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f32f9-fa43-4731-a017-9c889109a547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:47.856195 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f32f9-fa43-4731-a017-9c889109a547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:47.885953 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f32f9-fa43-4731-a017-9c889109a547 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:47.911675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 999/2003] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:48.186128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546dab8-9ffe-4c11-b9fc-9f31244ac798 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:48.188351 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3546dab8-9ffe-4c11-b9fc-9f31244ac798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:48.213101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546dab8-9ffe-4c11-b9fc-9f31244ac798 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:48.226560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:48.227268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:48.227542 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:48.227823 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] PATH_INFO: `/v3/projects/f2996534c86c49fe8f33616f43d01dd4` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:48.229926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2996534c86c49fe8f33616f43d01dd4)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:48.231892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:48.260131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f32f9-fa43-4731-a017-9c889109a547 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:48.261712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-df9f32f9-fa43-4731-a017-9c889109a547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:48.320524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2996534c86c49fe8f33616f43d01dd4', 'request_id': 'req-1b79e20f-f195-4bd1-84c6-8e79af02be17'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.331479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2996534c86c49fe8f33616f43d01dd4', 'request_id': 'req-1b79e20f-f195-4bd1-84c6-8e79af02be17'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.341779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2996534c86c49fe8f33616f43d01dd4', 'request_id': 'req-1b79e20f-f195-4bd1-84c6-8e79af02be17'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.349030 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f32f9-fa43-4731-a017-9c889109a547 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:48.379459 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] The token cache is being invalidate because project f2996534c86c49fe8f33616f43d01dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:48.379735 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.381316 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.384868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1005/2004] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:48 2022] DELETE /identity/v3/projects/f2996534c86c49fe8f33616f43d01dd4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:48.391063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:48.404148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:48.453542 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e4f81-7dc6-4bfb-919d-a9c8407b8632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:48.454995 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e4f81-7dc6-4bfb-919d-a9c8407b8632 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:48.455426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e4f81-7dc6-4bfb-919d-a9c8407b8632 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:48.456084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e4f81-7dc6-4bfb-919d-a9c8407b8632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:48.464051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a27e4f81-7dc6-4bfb-919d-a9c8407b8632 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:48.585209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e4f81-7dc6-4bfb-919d-a9c8407b8632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:48.587778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e4f81-7dc6-4bfb-919d-a9c8407b8632 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:48.594461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79e20f-f195-4bd1-84c6-8e79af02be17 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:48.606347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c557dc-9553-4364-a310-34d12ec86add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:48.607557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c557dc-9553-4364-a310-34d12ec86add admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:48.607889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c557dc-9553-4364-a310-34d12ec86add admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:48.608343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c557dc-9553-4364-a310-34d12ec86add admin admin] PATH_INFO: `/v3/users/492cb45d86d448c1a77ef16afc8a6e3c` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:48.610115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1000/2005] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:50:48.612152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c557dc-9553-4364-a310-34d12ec86add admin admin] RBAC: Authorizing `identity:delete_user(user_id=492cb45d86d448c1a77ef16afc8a6e3c)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:48.614113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c557dc-9553-4364-a310-34d12ec86add admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:48.684999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:48.706702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-72c557dc-9553-4364-a310-34d12ec86add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492cb45d86d448c1a77ef16afc8a6e3c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.707637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-72c557dc-9553-4364-a310-34d12ec86add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492cb45d86d448c1a77ef16afc8a6e3c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.720770 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e4f81-7dc6-4bfb-919d-a9c8407b8632 service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:48.722406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a27e4f81-7dc6-4bfb-919d-a9c8407b8632 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:48.735584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-72c557dc-9553-4364-a310-34d12ec86add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492cb45d86d448c1a77ef16afc8a6e3c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.748951 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e4f81-7dc6-4bfb-919d-a9c8407b8632 service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:48.750921 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-72c557dc-9553-4364-a310-34d12ec86add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492cb45d86d448c1a77ef16afc8a6e3c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.751604 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-72c557dc-9553-4364-a310-34d12ec86add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492cb45d86d448c1a77ef16afc8a6e3c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.777622 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1006/2006] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:48 2022] DELETE /identity/v3/users/492cb45d86d448c1a77ef16afc8a6e3c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:48.778392 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c557dc-9553-4364-a310-34d12ec86add admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:48.780754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-72c557dc-9553-4364-a310-34d12ec86add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:48.782178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:48.782879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:48.783366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:48.783797 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] PATH_INFO: `/v3/projects/26720a5873c045a78e60c745a49befc6` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:48.785180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26720a5873c045a78e60c745a49befc6)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:48.787168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:48.830172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:48.864053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26720a5873c045a78e60c745a49befc6', 'request_id': 'req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.873743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26720a5873c045a78e60c745a49befc6', 'request_id': 'req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.885751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26720a5873c045a78e60c745a49befc6', 'request_id': 'req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.889267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c557dc-9553-4364-a310-34d12ec86add admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:48.905342 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] The token cache is being invalidate because project 26720a5873c045a78e60c745a49befc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:48.905877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.907103 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:48.910105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1001/2007] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:48 2022] DELETE /identity/v3/projects/26720a5873c045a78e60c745a49befc6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:48.914278 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:48.916971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:49.034204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea06aab-6424-4612-88eb-3f75dd1e63f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:49.035020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea06aab-6424-4612-88eb-3f75dd1e63f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:49.035355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea06aab-6424-4612-88eb-3f75dd1e63f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:49.036373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea06aab-6424-4612-88eb-3f75dd1e63f7 admin admin] PATH_INFO: `/v3/users/3da55416a93d44d0be4292d1db2c305c` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:49.041398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea06aab-6424-4612-88eb-3f75dd1e63f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da55416a93d44d0be4292d1db2c305c)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:49.045277 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea06aab-6424-4612-88eb-3f75dd1e63f7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:49.156959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-cea06aab-6424-4612-88eb-3f75dd1e63f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da55416a93d44d0be4292d1db2c305c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:49.158390 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-cea06aab-6424-4612-88eb-3f75dd1e63f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da55416a93d44d0be4292d1db2c305c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:49.168907 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f398f45-0fc4-4034-8dd6-3cbbab5a4db6 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:49.175730 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-cea06aab-6424-4612-88eb-3f75dd1e63f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da55416a93d44d0be4292d1db2c305c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:49.177988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec528d-acfb-4a6e-82e1-4245888f66af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:49.179158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec528d-acfb-4a6e-82e1-4245888f66af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:49.179716 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec528d-acfb-4a6e-82e1-4245888f66af admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:49.180571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec528d-acfb-4a6e-82e1-4245888f66af admin admin] PATH_INFO: `/v3/users/48990413fbd647bcb22c39e946724528` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:49.183573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec528d-acfb-4a6e-82e1-4245888f66af admin admin] RBAC: Authorizing `identity:delete_user(user_id=48990413fbd647bcb22c39e946724528)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:49.186071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:49.187083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec528d-acfb-4a6e-82e1-4245888f66af admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:49.188551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-cea06aab-6424-4612-88eb-3f75dd1e63f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da55416a93d44d0be4292d1db2c305c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:49.189347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-cea06aab-6424-4612-88eb-3f75dd1e63f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da55416a93d44d0be4292d1db2c305c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:49.260974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-33ec528d-acfb-4a6e-82e1-4245888f66af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48990413fbd647bcb22c39e946724528'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:49.262324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-33ec528d-acfb-4a6e-82e1-4245888f66af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48990413fbd647bcb22c39e946724528'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:49.264904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1007/2008] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:48 2022] DELETE /identity/v3/users/3da55416a93d44d0be4292d1db2c305c => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:49.269244 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7627c-b0a7-4c0d-baa7-17a4d332dff2 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:49.269593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7627c-b0a7-4c0d-baa7-17a4d332dff2 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:49.270001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7627c-b0a7-4c0d-baa7-17a4d332dff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:49.276153 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-33ec528d-acfb-4a6e-82e1-4245888f66af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48990413fbd647bcb22c39e946724528'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:49.277378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-33ec528d-acfb-4a6e-82e1-4245888f66af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48990413fbd647bcb22c39e946724528'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:49.290425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-33ec528d-acfb-4a6e-82e1-4245888f66af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48990413fbd647bcb22c39e946724528'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:49.318970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1002/2009] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:48 2022] DELETE /identity/v3/users/48990413fbd647bcb22c39e946724528 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:49.331085 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6ca7627c-b0a7-4c0d-baa7-17a4d332dff2 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:49.332829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6ca7627c-b0a7-4c0d-baa7-17a4d332dff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:49.453191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1008/2010] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:49.469666 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec528d-acfb-4a6e-82e1-4245888f66af admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:49.471178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-33ec528d-acfb-4a6e-82e1-4245888f66af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:49.545468 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:49.615727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec528d-acfb-4a6e-82e1-4245888f66af admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:49.621042 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7106e-bc69-497c-94e7-90e4a38038aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:49.621836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7106e-bc69-497c-94e7-90e4a38038aa service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:49.622115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7106e-bc69-497c-94e7-90e4a38038aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:49.622493 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7106e-bc69-497c-94e7-90e4a38038aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:49.645008 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7106e-bc69-497c-94e7-90e4a38038aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:49.647273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7106e-bc69-497c-94e7-90e4a38038aa service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:49.675517 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1003/2011] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:49.708815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7627c-b0a7-4c0d-baa7-17a4d332dff2 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:49.710387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6ca7627c-b0a7-4c0d-baa7-17a4d332dff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:49.787312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7627c-b0a7-4c0d-baa7-17a4d332dff2 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:49.795639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf3079-2e9a-447c-819a-4697e1a44e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:49.796848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf3079-2e9a-447c-819a-4697e1a44e85 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:49.797143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf3079-2e9a-447c-819a-4697e1a44e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:49.798131 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf3079-2e9a-447c-819a-4697e1a44e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:49.800719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8ddf3079-2e9a-447c-819a-4697e1a44e85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:49.896786 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf3079-2e9a-447c-819a-4697e1a44e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:49.898777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf3079-2e9a-447c-819a-4697e1a44e85 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:49.912495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1009/2012] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:50.135182 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7106e-bc69-497c-94e7-90e4a38038aa service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:50.137123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-93e7106e-bc69-497c-94e7-90e4a38038aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:50.154997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7106e-bc69-497c-94e7-90e4a38038aa service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:50.166905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf3079-2e9a-447c-819a-4697e1a44e85 service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:50.168293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8ddf3079-2e9a-447c-819a-4697e1a44e85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:50.171533 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:50.172332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:50.172632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:50.172908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] PATH_INFO: `/v3/projects/8b9c98b3796342a2be35e782946e8e55` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:50.184580 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b9c98b3796342a2be35e782946e8e55)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:50.185240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:50.203517 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf3079-2e9a-447c-819a-4697e1a44e85 service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:50.219971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1483d8f-c672-4f1f-bced-98e7e780656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:50.220652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1483d8f-c672-4f1f-bced-98e7e780656e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:50.220992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1483d8f-c672-4f1f-bced-98e7e780656e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:50.221234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1483d8f-c672-4f1f-bced-98e7e780656e admin admin] PATH_INFO: `/v3/projects/9367200e9b0a4e90b89694fb260c6e10` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:50.223223 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1483d8f-c672-4f1f-bced-98e7e780656e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9367200e9b0a4e90b89694fb260c6e10)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:50.225513 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1483d8f-c672-4f1f-bced-98e7e780656e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:50.325423 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:50.380553 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b1483d8f-c672-4f1f-bced-98e7e780656e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9367200e9b0a4e90b89694fb260c6e10', 'request_id': 'req-b1483d8f-c672-4f1f-bced-98e7e780656e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.382346 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b9c98b3796342a2be35e782946e8e55', 'request_id': 'req-2704e2ce-49b4-44f7-a826-17502b63c8ae'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.398493 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b9c98b3796342a2be35e782946e8e55', 'request_id': 'req-2704e2ce-49b4-44f7-a826-17502b63c8ae'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.405845 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b1483d8f-c672-4f1f-bced-98e7e780656e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9367200e9b0a4e90b89694fb260c6e10', 'request_id': 'req-b1483d8f-c672-4f1f-bced-98e7e780656e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.415267 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b9c98b3796342a2be35e782946e8e55', 'request_id': 'req-2704e2ce-49b4-44f7-a826-17502b63c8ae'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.418419 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b1483d8f-c672-4f1f-bced-98e7e780656e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9367200e9b0a4e90b89694fb260c6e10', 'request_id': 'req-b1483d8f-c672-4f1f-bced-98e7e780656e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.436201 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] The token cache is being invalidate because project 8b9c98b3796342a2be35e782946e8e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:50.436529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.437504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.440135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1004/2013] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:50 2022] DELETE /identity/v3/projects/8b9c98b3796342a2be35e782946e8e55 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:50.441455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:50.450442 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:50.455016 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b1483d8f-c672-4f1f-bced-98e7e780656e admin admin] The token cache is being invalidate because project 9367200e9b0a4e90b89694fb260c6e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:50.455329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b1483d8f-c672-4f1f-bced-98e7e780656e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.457981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-b1483d8f-c672-4f1f-bced-98e7e780656e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.460240 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1010/2014] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:50 2022] DELETE /identity/v3/projects/9367200e9b0a4e90b89694fb260c6e10 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:50.461289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a75bc8-aedc-41a8-bc24-a7074f4656e8 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:50.461461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a75bc8-aedc-41a8-bc24-a7074f4656e8 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:50.461747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a75bc8-aedc-41a8-bc24-a7074f4656e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:50.493093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-e5a75bc8-aedc-41a8-bc24-a7074f4656e8 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:50.495872 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-e5a75bc8-aedc-41a8-bc24-a7074f4656e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:50.584458 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1011/2015] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:50.585958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f573b77-3a30-4def-b7a4-83399d31fea7 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:50.586277 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f573b77-3a30-4def-b7a4-83399d31fea7 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:50.586554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f573b77-3a30-4def-b7a4-83399d31fea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:50.615400 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-7f573b77-3a30-4def-b7a4-83399d31fea7 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:50.616314 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7f573b77-3a30-4def-b7a4-83399d31fea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:50.626326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1012/2016] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:50.634779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c5a7-76a6-4741-b25a-f15e2e17a14f None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:50.635588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c5a7-76a6-4741-b25a-f15e2e17a14f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:50.635710 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75c5a7-76a6-4741-b25a-f15e2e17a14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:50.645512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704e2ce-49b4-44f7-a826-17502b63c8ae admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:50.658069 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:50.659225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:50.659692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:50.660120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] PATH_INFO: `/v3/projects/f5f8305d4bd24d53b63d67ebebd4ee79` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:50.660926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-4a75c5a7-76a6-4741-b25a-f15e2e17a14f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:50.661744 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f8305d4bd24d53b63d67ebebd4ee79)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:50.663275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-4a75c5a7-76a6-4741-b25a-f15e2e17a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:50.664289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:50.676791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1013/2017] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:50.679159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29277a-f01d-4c88-b044-9444d1bfd0bb None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:50.679513 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29277a-f01d-4c88-b044-9444d1bfd0bb None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:50.679859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29277a-f01d-4c88-b044-9444d1bfd0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:50.705689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6f29277a-f01d-4c88-b044-9444d1bfd0bb None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:50.707363 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6f29277a-f01d-4c88-b044-9444d1bfd0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:50.731509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1014/2018] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:50.732230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29277a-f01d-4c88-b044-9444d1bfd0bb None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:50.749250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f8305d4bd24d53b63d67ebebd4ee79', 'request_id': 'req-4d684ced-7475-44ba-9e03-4458909bd2ed'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.757919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29277a-f01d-4c88-b044-9444d1bfd0bb None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:50.759547 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f8305d4bd24d53b63d67ebebd4ee79', 'request_id': 'req-4d684ced-7475-44ba-9e03-4458909bd2ed'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.763304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:50.771797 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f8305d4bd24d53b63d67ebebd4ee79', 'request_id': 'req-4d684ced-7475-44ba-9e03-4458909bd2ed'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.799362 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] The token cache is being invalidate because project f5f8305d4bd24d53b63d67ebebd4ee79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:50.800065 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.800946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.809228 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1005/2019] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:50 2022] DELETE /identity/v3/projects/f5f8305d4bd24d53b63d67ebebd4ee79 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:50.811166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:50.813014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:50.848521 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74720053-035e-4e0b-b270-265cf5d1aed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:50.849506 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74720053-035e-4e0b-b270-265cf5d1aed3 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:50.850223 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74720053-035e-4e0b-b270-265cf5d1aed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:50.850551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74720053-035e-4e0b-b270-265cf5d1aed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:50.851594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74720053-035e-4e0b-b270-265cf5d1aed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:50.852026 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74720053-035e-4e0b-b270-265cf5d1aed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:50.854684 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74720053-035e-4e0b-b270-265cf5d1aed3 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:50.885120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1015/2020] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:50.885120 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74720053-035e-4e0b-b270-265cf5d1aed3 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:50.885712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-74720053-035e-4e0b-b270-265cf5d1aed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:50.901947 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74720053-035e-4e0b-b270-265cf5d1aed3 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:50.915876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7aeec-a8e5-4b86-9d21-b417468121ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:50.917799 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7aeec-a8e5-4b86-9d21-b417468121ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:50.917799 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7aeec-a8e5-4b86-9d21-b417468121ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:50.918234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7aeec-a8e5-4b86-9d21-b417468121ac admin admin] PATH_INFO: `/v3/users/8e4243e2c9854db4b606822c4d94297b` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:50.921457 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7aeec-a8e5-4b86-9d21-b417468121ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e4243e2c9854db4b606822c4d94297b)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:50.924032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7aeec-a8e5-4b86-9d21-b417468121ac admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:50.937514 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d684ced-7475-44ba-9e03-4458909bd2ed admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:50.945629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf17e9-136c-4f34-a642-3bc1e6e3db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:50.946271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf17e9-136c-4f34-a642-3bc1e6e3db0c admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:50.948575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf17e9-136c-4f34-a642-3bc1e6e3db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:50.949084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf17e9-136c-4f34-a642-3bc1e6e3db0c admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:50.951375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:50.951757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf17e9-136c-4f34-a642-3bc1e6e3db0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:50.953240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf17e9-136c-4f34-a642-3bc1e6e3db0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:50.955087 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf17e9-136c-4f34-a642-3bc1e6e3db0c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:50.974233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1006/2021] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:50.976453 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf17e9-136c-4f34-a642-3bc1e6e3db0c admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:50.984795 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f4bf17e9-136c-4f34-a642-3bc1e6e3db0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:50.997657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c2d7aeec-a8e5-4b86-9d21-b417468121ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e4243e2c9854db4b606822c4d94297b'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:50.998978 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c2d7aeec-a8e5-4b86-9d21-b417468121ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e4243e2c9854db4b606822c4d94297b'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:51.010984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c2d7aeec-a8e5-4b86-9d21-b417468121ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e4243e2c9854db4b606822c4d94297b'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:51.019200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf17e9-136c-4f34-a642-3bc1e6e3db0c admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:51.025263 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c2d7aeec-a8e5-4b86-9d21-b417468121ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e4243e2c9854db4b606822c4d94297b'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:51.025864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c2d7aeec-a8e5-4b86-9d21-b417468121ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e4243e2c9854db4b606822c4d94297b'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:51.035603 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb94961-dd93-4e60-98b6-5ceee537e8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:51.036628 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb94961-dd93-4e60-98b6-5ceee537e8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:51.037105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb94961-dd93-4e60-98b6-5ceee537e8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:51.037620 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb94961-dd93-4e60-98b6-5ceee537e8f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:51.038683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb94961-dd93-4e60-98b6-5ceee537e8f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:51.041933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb94961-dd93-4e60-98b6-5ceee537e8f0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:51.057018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1016/2022] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:50 2022] DELETE /identity/v3/users/8e4243e2c9854db4b606822c4d94297b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:51.058097 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7aeec-a8e5-4b86-9d21-b417468121ac admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:51.059606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c2d7aeec-a8e5-4b86-9d21-b417468121ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:51.138670 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1007/2023] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:50 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:51.144194 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb94961-dd93-4e60-98b6-5ceee537e8f0 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:51.144358 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7aeec-a8e5-4b86-9d21-b417468121ac admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:51.148578 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6bb94961-dd93-4e60-98b6-5ceee537e8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:51.263145 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de847dcc-d0a6-4fcf-957f-d800740c9149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:51.263953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de847dcc-d0a6-4fcf-957f-d800740c9149 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:51.264130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de847dcc-d0a6-4fcf-957f-d800740c9149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:51.264524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de847dcc-d0a6-4fcf-957f-d800740c9149 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:51.265225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de847dcc-d0a6-4fcf-957f-d800740c9149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:51.267074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de847dcc-d0a6-4fcf-957f-d800740c9149 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:51.331101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1017/2024] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:51 2022] POST /identity/v3/projects => generated 377 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:51.339343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de847dcc-d0a6-4fcf-957f-d800740c9149 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:51.384955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb94961-dd93-4e60-98b6-5ceee537e8f0 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:51.490139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:51.614309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de847dcc-d0a6-4fcf-957f-d800740c9149 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:51.628436 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c38701-c326-4124-b1f4-7501ccb8e979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:51.629144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c38701-c326-4124-b1f4-7501ccb8e979 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:51.629437 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c38701-c326-4124-b1f4-7501ccb8e979 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:51.629718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c38701-c326-4124-b1f4-7501ccb8e979 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:51.630517 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c38701-c326-4124-b1f4-7501ccb8e979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:51.636050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c38701-c326-4124-b1f4-7501ccb8e979 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:51.638724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3603562-ca4d-4542-9ec8-0fb472ebf412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:51.639320 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3603562-ca4d-4542-9ec8-0fb472ebf412 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:51.639780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3603562-ca4d-4542-9ec8-0fb472ebf412 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:51.639888 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3603562-ca4d-4542-9ec8-0fb472ebf412 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:51.640706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3603562-ca4d-4542-9ec8-0fb472ebf412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:51.645952 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3603562-ca4d-4542-9ec8-0fb472ebf412 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:51.669153 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:51.690988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1018/2025] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:51 2022] POST /identity/v3/users => generated 289 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:51.695616 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c38701-c326-4124-b1f4-7501ccb8e979 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:51.717621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c38701-c326-4124-b1f4-7501ccb8e979 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:51.718425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1008/2026] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:51 2022] POST /identity/v3/users => generated 281 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:51.721425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3603562-ca4d-4542-9ec8-0fb472ebf412 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:51.734864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d1dce-5cb2-4512-b172-8396b4541360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:51.735686 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d1dce-5cb2-4512-b172-8396b4541360 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:51.736435 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d1dce-5cb2-4512-b172-8396b4541360 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:51.737921 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d1dce-5cb2-4512-b172-8396b4541360 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:51.739103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d1dce-5cb2-4512-b172-8396b4541360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:51.742967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d1dce-5cb2-4512-b172-8396b4541360 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:51.746135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3603562-ca4d-4542-9ec8-0fb472ebf412 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:51.767974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7e844-44a7-479a-8b7f-ddb03fe95b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:51.769266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7e844-44a7-479a-8b7f-ddb03fe95b1b admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:51.769266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7e844-44a7-479a-8b7f-ddb03fe95b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:51.769654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7e844-44a7-479a-8b7f-ddb03fe95b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:51.770762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7e844-44a7-479a-8b7f-ddb03fe95b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:51.773609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7e844-44a7-479a-8b7f-ddb03fe95b1b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:51.775718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1019/2027] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:50:51.776975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d1dce-5cb2-4512-b172-8396b4541360 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:51.809063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d1dce-5cb2-4512-b172-8396b4541360 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:51.810556 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1009/2028] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:51.813701 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7e844-44a7-479a-8b7f-ddb03fe95b1b admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:51.823671 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d5d8f-0c9d-4f10-a964-d43e6c42fa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:51.826140 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d5d8f-0c9d-4f10-a964-d43e6c42fa9c admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:51.827722 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d5d8f-0c9d-4f10-a964-d43e6c42fa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:51.828440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d5d8f-0c9d-4f10-a964-d43e6c42fa9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:51.830271 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d5d8f-0c9d-4f10-a964-d43e6c42fa9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:51.833908 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d5d8f-0c9d-4f10-a964-d43e6c42fa9c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:51.845195 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7e844-44a7-479a-8b7f-ddb03fe95b1b admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:51.865163 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cde7f-fe4a-4899-b31c-ab4ace72d1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:51.865817 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cde7f-fe4a-4899-b31c-ab4ace72d1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:51.866105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cde7f-fe4a-4899-b31c-ab4ace72d1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:51.866407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cde7f-fe4a-4899-b31c-ab4ace72d1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:51.873055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13cde7f-fe4a-4899-b31c-ab4ace72d1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:51.874139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1020/2029] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:51.878672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d5d8f-0c9d-4f10-a964-d43e6c42fa9c admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:51.888315 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13cde7f-fe4a-4899-b31c-ab4ace72d1f1 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:51.892921 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d5d8f-0c9d-4f10-a964-d43e6c42fa9c admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:51.910041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918214e-d95f-44a0-b932-f592451c3143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:51.911940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918214e-d95f-44a0-b932-f592451c3143 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:51.913633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918214e-d95f-44a0-b932-f592451c3143 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:51.917848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918214e-d95f-44a0-b932-f592451c3143 admin admin] PATH_INFO: `/v3/projects/c20939698ac740779010408577efa71a/users/b9e02de13d5a43d28f69d8cae62aa9aa/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:51.943746 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1010/2030] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:51.948869 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cde7f-fe4a-4899-b31c-ab4ace72d1f1 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:51.973316 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918214e-d95f-44a0-b932-f592451c3143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20939698ac740779010408577efa71a, user_id=b9e02de13d5a43d28f69d8cae62aa9aa, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:51.984432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cde7f-fe4a-4899-b31c-ab4ace72d1f1 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:51.989119 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918214e-d95f-44a0-b932-f592451c3143 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:52.004768 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df7c7a-aea3-43a3-8e36-f8c060fea2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:52.007700 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df7c7a-aea3-43a3-8e36-f8c060fea2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:52.009853 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df7c7a-aea3-43a3-8e36-f8c060fea2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:52.009853 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df7c7a-aea3-43a3-8e36-f8c060fea2b3 admin admin] PATH_INFO: `/v3/projects/d142e3a4f77a4ca0b1395fada4b9c9ce/users/c7800b14ecd54fb780641890ff5f5ab8/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:52.037964 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1021/2031] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:51 2022] PUT /identity/v3/projects/c20939698ac740779010408577efa71a/users/b9e02de13d5a43d28f69d8cae62aa9aa/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:52.056974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c9f0-bd94-4b38-9d86-e674cc9754a7 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:52.057366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c9f0-bd94-4b38-9d86-e674cc9754a7 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:52.057741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384c9f0-bd94-4b38-9d86-e674cc9754a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:52.074031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df7c7a-aea3-43a3-8e36-f8c060fea2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d142e3a4f77a4ca0b1395fada4b9c9ce, user_id=c7800b14ecd54fb780641890ff5f5ab8, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:52.079965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df7c7a-aea3-43a3-8e36-f8c060fea2b3 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:52.130312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1011/2032] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:51 2022] PUT /identity/v3/projects/d142e3a4f77a4ca0b1395fada4b9c9ce/users/c7800b14ecd54fb780641890ff5f5ab8/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:52.133383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-2384c9f0-bd94-4b38-9d86-e674cc9754a7 None None] MFA Rules not processed for user `b9e02de13d5a43d28f69d8cae62aa9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:52.135500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2384c9f0-bd94-4b38-9d86-e674cc9754a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:52.137487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ac5cf-0818-4e30-995b-1bcf736b8edc None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:52.137789 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ac5cf-0818-4e30-995b-1bcf736b8edc None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:52.139224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ac5cf-0818-4e30-995b-1bcf736b8edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:52.203450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-844ac5cf-0818-4e30-995b-1bcf736b8edc None None] MFA Rules not processed for user `c7800b14ecd54fb780641890ff5f5ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:52.205050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-844ac5cf-0818-4e30-995b-1bcf736b8edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:52.275918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1022/2033] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:50:52.281481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384c9f0-bd94-4b38-9d86-e674cc9754a7 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:52.324181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1012/2034] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:52.325085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ac5cf-0818-4e30-995b-1bcf736b8edc None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:52.330905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-844ac5cf-0818-4e30-995b-1bcf736b8edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:52.403430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384c9f0-bd94-4b38-9d86-e674cc9754a7 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:52.408825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6f5c5-af55-458a-b9e8-bdd4e26e0e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:52.409707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6f5c5-af55-458a-b9e8-bdd4e26e0e5c admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:52.410494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6f5c5-af55-458a-b9e8-bdd4e26e0e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:52.410494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6f5c5-af55-458a-b9e8-bdd4e26e0e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:52.411032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6f5c5-af55-458a-b9e8-bdd4e26e0e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:52.412980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6f5c5-af55-458a-b9e8-bdd4e26e0e5c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:52.429858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:52.439280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ac5cf-0818-4e30-995b-1bcf736b8edc None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:52.445826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:52.446738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:52.447101 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:52.447389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] PATH_INFO: `/v3/projects/d817bb8f53d64e8e8b212eb92c29c2c6` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:52.450225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d817bb8f53d64e8e8b212eb92c29c2c6)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:52.451186 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:52.453650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1023/2035] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:52 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:52.454781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6f5c5-af55-458a-b9e8-bdd4e26e0e5c admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:52.456682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-faa6f5c5-af55-458a-b9e8-bdd4e26e0e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:52.503867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:52.512630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd817bb8f53d64e8e8b212eb92c29c2c6', 'request_id': 'req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:52.520751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd817bb8f53d64e8e8b212eb92c29c2c6', 'request_id': 'req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:52.532778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd817bb8f53d64e8e8b212eb92c29c2c6', 'request_id': 'req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:52.550059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6f5c5-af55-458a-b9e8-bdd4e26e0e5c admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:52.552461 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] The token cache is being invalidate because project d817bb8f53d64e8e8b212eb92c29c2c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:52.552834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:52.554605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:52.556521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1013/2036] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:52 2022] DELETE /identity/v3/projects/d817bb8f53d64e8e8b212eb92c29c2c6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:52.559215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:52.560707 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:52.637174 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b20ada-e3be-4b26-b08d-1de5efbf2971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:52.638292 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b20ada-e3be-4b26-b08d-1de5efbf2971 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:52.638808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b20ada-e3be-4b26-b08d-1de5efbf2971 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:52.639155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b20ada-e3be-4b26-b08d-1de5efbf2971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:52.641417 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-82b20ada-e3be-4b26-b08d-1de5efbf2971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:52.688382 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c22cb8-d505-45e3-aaa4-ea3b9ac37e2a admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:52.695554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5073138-b021-4bfc-ac82-d8ed104e69a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:52.696452 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5073138-b021-4bfc-ac82-d8ed104e69a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:52.696802 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5073138-b021-4bfc-ac82-d8ed104e69a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:52.697157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5073138-b021-4bfc-ac82-d8ed104e69a7 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:52.697874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5073138-b021-4bfc-ac82-d8ed104e69a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:52.700613 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5073138-b021-4bfc-ac82-d8ed104e69a7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:52.756538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1014/2037] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:52 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:52.756538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5dd3d-9778-46d2-b3a8-a433c38caa9a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:52.756538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5dd3d-9778-46d2-b3a8-a433c38caa9a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:52.757345 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5dd3d-9778-46d2-b3a8-a433c38caa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:52.758381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b20ada-e3be-4b26-b08d-1de5efbf2971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:52.760705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b20ada-e3be-4b26-b08d-1de5efbf2971 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:52.777166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1024/2038] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:52.778060 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b20ada-e3be-4b26-b08d-1de5efbf2971 service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:52.791914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b20ada-e3be-4b26-b08d-1de5efbf2971 service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:52.817867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f51b73-ec3c-4fed-bdc2-b052c9047b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:52.818644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f51b73-ec3c-4fed-bdc2-b052c9047b6e admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:52.819114 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f51b73-ec3c-4fed-bdc2-b052c9047b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:52.819398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f51b73-ec3c-4fed-bdc2-b052c9047b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:52.821303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f51b73-ec3c-4fed-bdc2-b052c9047b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:52.830731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f51b73-ec3c-4fed-bdc2-b052c9047b6e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:52.841374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-efd5dd3d-9778-46d2-b3a8-a433c38caa9a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:52.843543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-efd5dd3d-9778-46d2-b3a8-a433c38caa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:52.864458 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1025/2039] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:52.865862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f51b73-ec3c-4fed-bdc2-b052c9047b6e admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:52.876268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1015/2040] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:52.876569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-25f51b73-ec3c-4fed-bdc2-b052c9047b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:52.877234 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5dd3d-9778-46d2-b3a8-a433c38caa9a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:52.893199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5dd3d-9778-46d2-b3a8-a433c38caa9a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:52.899109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660817e8-626d-474b-9a55-904d2969abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:52.899950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660817e8-626d-474b-9a55-904d2969abff admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:52.900203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660817e8-626d-474b-9a55-904d2969abff admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:52.900466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660817e8-626d-474b-9a55-904d2969abff admin admin] PATH_INFO: `/v3/projects/f4279cea3cd14182973f02d039842e12/users/cdab92d750b3401e875263fc9f34afc7/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:52.923463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f51b73-ec3c-4fed-bdc2-b052c9047b6e admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:52.933257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660817e8-626d-474b-9a55-904d2969abff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4279cea3cd14182973f02d039842e12, user_id=cdab92d750b3401e875263fc9f34afc7, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:52.936407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660817e8-626d-474b-9a55-904d2969abff admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:52.940820 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afd1ce-dd78-46be-8157-83312cbdbd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:52.942216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afd1ce-dd78-46be-8157-83312cbdbd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:52.942673 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afd1ce-dd78-46be-8157-83312cbdbd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:52.943919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afd1ce-dd78-46be-8157-83312cbdbd9c admin admin] PATH_INFO: `/v3/users/c7800b14ecd54fb780641890ff5f5ab8` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:52.946047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afd1ce-dd78-46be-8157-83312cbdbd9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7800b14ecd54fb780641890ff5f5ab8)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:52.950628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afd1ce-dd78-46be-8157-83312cbdbd9c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:52.957649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1016/2041] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:52 2022] PUT /identity/v3/projects/f4279cea3cd14182973f02d039842e12/users/cdab92d750b3401e875263fc9f34afc7/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:52.959434 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b151-1d6b-46ff-b06c-84b1a6b444e4 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:52.959878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b151-1d6b-46ff-b06c-84b1a6b444e4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:52.960190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b151-1d6b-46ff-b06c-84b1a6b444e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:52.986945 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-3106b151-1d6b-46ff-b06c-84b1a6b444e4 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:52.988222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3106b151-1d6b-46ff-b06c-84b1a6b444e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:53.072875 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:53.082549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c2afd1ce-dd78-46be-8157-83312cbdbd9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7800b14ecd54fb780641890ff5f5ab8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:53.085095 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c2afd1ce-dd78-46be-8157-83312cbdbd9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7800b14ecd54fb780641890ff5f5ab8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:53.105260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c2afd1ce-dd78-46be-8157-83312cbdbd9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7800b14ecd54fb780641890ff5f5ab8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:53.122126 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c2afd1ce-dd78-46be-8157-83312cbdbd9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7800b14ecd54fb780641890ff5f5ab8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:53.122886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c2afd1ce-dd78-46be-8157-83312cbdbd9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7800b14ecd54fb780641890ff5f5ab8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:53.127404 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1017/2042] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:53.128761 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106b151-1d6b-46ff-b06c-84b1a6b444e4 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:53.130364 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3106b151-1d6b-46ff-b06c-84b1a6b444e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:53.147030 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106b151-1d6b-46ff-b06c-84b1a6b444e4 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:53.154253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e613171-f517-4c65-8049-1f6550d197af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:53.155687 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e613171-f517-4c65-8049-1f6550d197af admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:53.156635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e613171-f517-4c65-8049-1f6550d197af admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:53.157051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e613171-f517-4c65-8049-1f6550d197af admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:53.158100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e613171-f517-4c65-8049-1f6550d197af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:53.160905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e613171-f517-4c65-8049-1f6550d197af admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:53.176761 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1018/2043] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:53.177627 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e613171-f517-4c65-8049-1f6550d197af admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:53.189380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1026/2044] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:52 2022] DELETE /identity/v3/users/c7800b14ecd54fb780641890ff5f5ab8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:53.189380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afd1ce-dd78-46be-8157-83312cbdbd9c admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:53.195561 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e613171-f517-4c65-8049-1f6550d197af admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:53.214040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:53.294807 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff03d3-1f62-4a54-8228-031acb427bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:53.295448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff03d3-1f62-4a54-8228-031acb427bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:53.296114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff03d3-1f62-4a54-8228-031acb427bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:53.296411 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff03d3-1f62-4a54-8228-031acb427bb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:53.297113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff03d3-1f62-4a54-8228-031acb427bb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:53.297424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff03d3-1f62-4a54-8228-031acb427bb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:53.299751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff03d3-1f62-4a54-8228-031acb427bb7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:53.314950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1019/2045] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:53.316758 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4ed07-ba42-4ab8-a5f8-8e8526b51867 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:53.317055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4ed07-ba42-4ab8-a5f8-8e8526b51867 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:53.317337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4ed07-ba42-4ab8-a5f8-8e8526b51867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:53.356070 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-94a4ed07-ba42-4ab8-a5f8-8e8526b51867 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:53.357627 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-94a4ed07-ba42-4ab8-a5f8-8e8526b51867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:53.372924 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1020/2046] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:53.373149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afd1ce-dd78-46be-8157-83312cbdbd9c admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:53.373250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4ed07-ba42-4ab8-a5f8-8e8526b51867 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:53.377725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727de9c-3e10-4a8c-9554-c48ea06720b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:53.379231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727de9c-3e10-4a8c-9554-c48ea06720b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:53.379516 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727de9c-3e10-4a8c-9554-c48ea06720b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:53.379952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727de9c-3e10-4a8c-9554-c48ea06720b0 admin admin] PATH_INFO: `/v3/projects/f4279cea3cd14182973f02d039842e12/users/cdab92d750b3401e875263fc9f34afc7/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:53.382922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727de9c-3e10-4a8c-9554-c48ea06720b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4279cea3cd14182973f02d039842e12, user_id=cdab92d750b3401e875263fc9f34afc7, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:53.383359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4ed07-ba42-4ab8-a5f8-8e8526b51867 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:53.386520 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727de9c-3e10-4a8c-9554-c48ea06720b0 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:53.397990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07981ca4-a846-4295-8cc9-4b3889206676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:53.398672 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07981ca4-a846-4295-8cc9-4b3889206676 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:53.399025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07981ca4-a846-4295-8cc9-4b3889206676 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:53.400759 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1027/2047] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:53 2022] PUT /identity/v3/projects/f4279cea3cd14182973f02d039842e12/users/cdab92d750b3401e875263fc9f34afc7/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:53.401207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07981ca4-a846-4295-8cc9-4b3889206676 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:53.402387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07981ca4-a846-4295-8cc9-4b3889206676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:53.404207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07981ca4-a846-4295-8cc9-4b3889206676 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:53.413556 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727de9c-3e10-4a8c-9554-c48ea06720b0 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:53.417514 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9727de9c-3e10-4a8c-9554-c48ea06720b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:53.494974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1021/2048] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:53 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:53.494974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165079bf-5d4d-43bd-b33c-f29615551ed1 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:53.494974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165079bf-5d4d-43bd-b33c-f29615551ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:53.494974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165079bf-5d4d-43bd-b33c-f29615551ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:53.532365 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-165079bf-5d4d-43bd-b33c-f29615551ed1 None None] MFA Rules not processed for user `cdab92d750b3401e875263fc9f34afc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:53.533956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-165079bf-5d4d-43bd-b33c-f29615551ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:53.556737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727de9c-3e10-4a8c-9554-c48ea06720b0 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:53.668754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab077b7f-df42-4593-b9e9-1e987eac5e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:53.669985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab077b7f-df42-4593-b9e9-1e987eac5e62 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:53.670504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab077b7f-df42-4593-b9e9-1e987eac5e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:53.671231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab077b7f-df42-4593-b9e9-1e987eac5e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:53.688058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1022/2049] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:53.690111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165079bf-5d4d-43bd-b33c-f29615551ed1 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:53.727375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:53.775792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab077b7f-df42-4593-b9e9-1e987eac5e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:53.777270 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab077b7f-df42-4593-b9e9-1e987eac5e62 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:53.789965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1028/2050] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:53.790240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165079bf-5d4d-43bd-b33c-f29615551ed1 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:53.795265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bf08a-cd41-42cd-a1fa-66b84242b3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:53.795460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab077b7f-df42-4593-b9e9-1e987eac5e62 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:53.795911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bf08a-cd41-42cd-a1fa-66b84242b3fd admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:53.796199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bf08a-cd41-42cd-a1fa-66b84242b3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:53.796480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bf08a-cd41-42cd-a1fa-66b84242b3fd admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:53.797153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ab077b7f-df42-4593-b9e9-1e987eac5e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:53.797284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bf08a-cd41-42cd-a1fa-66b84242b3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:53.799132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bf08a-cd41-42cd-a1fa-66b84242b3fd admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:53.812532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:53.829707 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1023/2051] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:53 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:53.834230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bf08a-cd41-42cd-a1fa-66b84242b3fd admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:53.848427 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bf08a-cd41-42cd-a1fa-66b84242b3fd admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:53.854335 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295f314-15d0-4c2b-a898-90421c2e14f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:53.854947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295f314-15d0-4c2b-a898-90421c2e14f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:53.855290 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295f314-15d0-4c2b-a898-90421c2e14f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:53.855572 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295f314-15d0-4c2b-a898-90421c2e14f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:53.856346 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295f314-15d0-4c2b-a898-90421c2e14f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:53.858090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295f314-15d0-4c2b-a898-90421c2e14f3 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:53.872379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1024/2052] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:53.876778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295f314-15d0-4c2b-a898-90421c2e14f3 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:53.887520 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab077b7f-df42-4593-b9e9-1e987eac5e62 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:53.888851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295f314-15d0-4c2b-a898-90421c2e14f3 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:53.901577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e2ff6-de19-4c3b-8d10-ba32c6896c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:53.902485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e2ff6-de19-4c3b-8d10-ba32c6896c4c service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:53.902986 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e2ff6-de19-4c3b-8d10-ba32c6896c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:53.903278 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e2ff6-de19-4c3b-8d10-ba32c6896c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:53.905821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d3ec1-1134-42d1-a633-ef6bd6a24a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:53.906509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d3ec1-1134-42d1-a633-ef6bd6a24a25 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:53.906946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d3ec1-1134-42d1-a633-ef6bd6a24a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:53.907241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d3ec1-1134-42d1-a633-ef6bd6a24a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:53.907981 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d3ec1-1134-42d1-a633-ef6bd6a24a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:53.909574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d3ec1-1134-42d1-a633-ef6bd6a24a25 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:53.919939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e2ff6-de19-4c3b-8d10-ba32c6896c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:53.921785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e2ff6-de19-4c3b-8d10-ba32c6896c4c service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:53.924006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1025/2053] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:53.928037 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d3ec1-1134-42d1-a633-ef6bd6a24a25 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:53.935691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1029/2054] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:53.939873 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d3ec1-1134-42d1-a633-ef6bd6a24a25 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:53.948161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15502b-ca5b-4a4a-ab9c-fc8dbeff6136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:53.949094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15502b-ca5b-4a4a-ab9c-fc8dbeff6136 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:53.949487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15502b-ca5b-4a4a-ab9c-fc8dbeff6136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:53.949867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15502b-ca5b-4a4a-ab9c-fc8dbeff6136 admin admin] PATH_INFO: `/v3/projects/ee1739e73bc348a58e756679a5d13839/users/dbae05c70063413cb0382364444ca56f/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:53.968701 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15502b-ca5b-4a4a-ab9c-fc8dbeff6136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee1739e73bc348a58e756679a5d13839, user_id=dbae05c70063413cb0382364444ca56f, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:53.983024 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15502b-ca5b-4a4a-ab9c-fc8dbeff6136 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:54.014239 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1026/2055] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:53 2022] PUT /identity/v3/projects/ee1739e73bc348a58e756679a5d13839/users/dbae05c70063413cb0382364444ca56f/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:54.022538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d6a57-57e7-434f-a742-2ccedd229bd9 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:54.023028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d6a57-57e7-434f-a742-2ccedd229bd9 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:54.023479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d6a57-57e7-434f-a742-2ccedd229bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:54.088988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-aa3d6a57-57e7-434f-a742-2ccedd229bd9 None None] MFA Rules not processed for user `dbae05c70063413cb0382364444ca56f`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:54.090227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-aa3d6a57-57e7-434f-a742-2ccedd229bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:54.219847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1030/2056] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:54.223002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15502b-ca5b-4a4a-ab9c-fc8dbeff6136 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:54.224792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5c15502b-ca5b-4a4a-ab9c-fc8dbeff6136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:54.233373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d6a57-57e7-434f-a742-2ccedd229bd9 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:54.358219 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:54.377699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d6a57-57e7-434f-a742-2ccedd229bd9 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:54.398912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e3ea9-0b5e-4715-8c55-826aaf3a51a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:54.400458 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e3ea9-0b5e-4715-8c55-826aaf3a51a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:54.400833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e3ea9-0b5e-4715-8c55-826aaf3a51a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:54.401248 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e3ea9-0b5e-4715-8c55-826aaf3a51a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:54.403418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e3ea9-0b5e-4715-8c55-826aaf3a51a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:54.407396 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e3ea9-0b5e-4715-8c55-826aaf3a51a0 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:54.426881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15502b-ca5b-4a4a-ab9c-fc8dbeff6136 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:54.433023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:54.434881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:54.435125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:54.435370 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] PATH_INFO: `/v3/projects/d142e3a4f77a4ca0b1395fada4b9c9ce` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:54.437010 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] RBAC: Authorizing `identity:delete_project(project_id=d142e3a4f77a4ca0b1395fada4b9c9ce)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:54.439851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:54.458615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1031/2057] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:54 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:54.465636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e3ea9-0b5e-4715-8c55-826aaf3a51a0 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:54.503743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd142e3a4f77a4ca0b1395fada4b9c9ce', 'request_id': 'req-1202746a-d570-4c17-bbf9-1b44989b03da'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:54.517676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd142e3a4f77a4ca0b1395fada4b9c9ce', 'request_id': 'req-1202746a-d570-4c17-bbf9-1b44989b03da'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:54.528108 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd142e3a4f77a4ca0b1395fada4b9c9ce', 'request_id': 'req-1202746a-d570-4c17-bbf9-1b44989b03da'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:54.541324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] The token cache is being invalidate because project d142e3a4f77a4ca0b1395fada4b9c9ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:54.541619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:54.542319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:54.544082 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1027/2058] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:54 2022] DELETE /identity/v3/projects/d142e3a4f77a4ca0b1395fada4b9c9ce => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:54.548806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:54.550214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:54.558900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e3ea9-0b5e-4715-8c55-826aaf3a51a0 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:54.607507 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:54.630546 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7e632-38f0-4e1b-a1a4-00333a915ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:54.631191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7e632-38f0-4e1b-a1a4-00333a915ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:54.631478 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7e632-38f0-4e1b-a1a4-00333a915ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:54.631940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7e632-38f0-4e1b-a1a4-00333a915ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:54.632448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7e632-38f0-4e1b-a1a4-00333a915ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:54.635067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7e632-38f0-4e1b-a1a4-00333a915ed5 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:54.638539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202746a-d570-4c17-bbf9-1b44989b03da admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:54.643387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560697b-a834-473c-9880-9426b9b624a5 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdab92d750b3401e875263fc9f34afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4279cea3cd14182973f02d039842e12', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:54.644025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560697b-a834-473c-9880-9426b9b624a5 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:54.644314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560697b-a834-473c-9880-9426b9b624a5 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:54.644599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560697b-a834-473c-9880-9426b9b624a5 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:54.645397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560697b-a834-473c-9880-9426b9b624a5 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:54.645823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560697b-a834-473c-9880-9426b9b624a5 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:54.647733 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560697b-a834-473c-9880-9426b9b624a5 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:54.660900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1032/2059] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:54 2022] POST /identity/v3/users => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:54.660900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5227638-8e9e-4ca6-9de9-b31a1ef85b7c None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:54.660900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5227638-8e9e-4ca6-9de9-b31a1ef85b7c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:54.660900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5227638-8e9e-4ca6-9de9-b31a1ef85b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:54.670703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1028/2060] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:54.670703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560697b-a834-473c-9880-9426b9b624a5 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:54.670703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5560697b-a834-473c-9880-9426b9b624a5 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:54.683507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-a5227638-8e9e-4ca6-9de9-b31a1ef85b7c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:54.684394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560697b-a834-473c-9880-9426b9b624a5 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:54.684757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a5227638-8e9e-4ca6-9de9-b31a1ef85b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:54.689251 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a00ae9-1a1b-4d7e-8189-3d5cbd51e2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:54.689873 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a00ae9-1a1b-4d7e-8189-3d5cbd51e2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:54.690260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a00ae9-1a1b-4d7e-8189-3d5cbd51e2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:54.690460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a00ae9-1a1b-4d7e-8189-3d5cbd51e2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:54.691169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a00ae9-1a1b-4d7e-8189-3d5cbd51e2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:54.692779 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a00ae9-1a1b-4d7e-8189-3d5cbd51e2a1 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:54.694348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1033/2061] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:54.694754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5227638-8e9e-4ca6-9de9-b31a1ef85b7c None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:54.712263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1029/2062] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:54.712263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035bcc9-4b8f-4c71-a679-33240ff8f537 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:54.712263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035bcc9-4b8f-4c71-a679-33240ff8f537 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:54.712263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035bcc9-4b8f-4c71-a679-33240ff8f537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:54.716247 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5227638-8e9e-4ca6-9de9-b31a1ef85b7c None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:54.722745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7444fb-2503-4c30-a0d5-1cf845e05271 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdab92d750b3401e875263fc9f34afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4279cea3cd14182973f02d039842e12', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:54.723502 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7444fb-2503-4c30-a0d5-1cf845e05271 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:54.723794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7444fb-2503-4c30-a0d5-1cf845e05271 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:54.724080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7444fb-2503-4c30-a0d5-1cf845e05271 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:54.725200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7444fb-2503-4c30-a0d5-1cf845e05271 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:54.728037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7444fb-2503-4c30-a0d5-1cf845e05271 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:54.742730 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-f035bcc9-4b8f-4c71-a679-33240ff8f537 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:54.744543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f035bcc9-4b8f-4c71-a679-33240ff8f537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:54.753633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1030/2063] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:54.754489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035bcc9-4b8f-4c71-a679-33240ff8f537 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:54.767475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035bcc9-4b8f-4c71-a679-33240ff8f537 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:54.772844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3970a5-d5bf-409a-8ea0-adc0b1440834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:54.773032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1034/2064] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:54 2022] POST /identity/v3/projects => generated 354 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:54.773874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7444fb-2503-4c30-a0d5-1cf845e05271 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:54.778384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3970a5-d5bf-409a-8ea0-adc0b1440834 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:54.778846 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3970a5-d5bf-409a-8ea0-adc0b1440834 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:54.779387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3970a5-d5bf-409a-8ea0-adc0b1440834 admin admin] PATH_INFO: `/v3/projects/72f74199df4841f5ba118919b517c744/users/b2173cea839348c4a9bfa2819f72232d/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:54.797633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3970a5-d5bf-409a-8ea0-adc0b1440834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f74199df4841f5ba118919b517c744, user_id=b2173cea839348c4a9bfa2819f72232d, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:54.800353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3970a5-d5bf-409a-8ea0-adc0b1440834 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:54.816599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1031/2065] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:54 2022] PUT /identity/v3/projects/72f74199df4841f5ba118919b517c744/users/b2173cea839348c4a9bfa2819f72232d/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:54.817486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3970a5-d5bf-409a-8ea0-adc0b1440834 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:54.844281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:54.874753 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7444fb-2503-4c30-a0d5-1cf845e05271 tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:54.905267 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3970a5-d5bf-409a-8ea0-adc0b1440834 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:54.913881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7a3d6-2e2b-477b-aa0f-ab787961f0ac tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdab92d750b3401e875263fc9f34afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4279cea3cd14182973f02d039842e12', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:54.914948 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7a3d6-2e2b-477b-aa0f-ab787961f0ac tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:54.915488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7a3d6-2e2b-477b-aa0f-ab787961f0ac tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:54.915963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7a3d6-2e2b-477b-aa0f-ab787961f0ac tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:54.917366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7a3d6-2e2b-477b-aa0f-ab787961f0ac tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:54.917965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7a3d6-2e2b-477b-aa0f-ab787961f0ac tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:54.921008 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7a3d6-2e2b-477b-aa0f-ab787961f0ac tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:54.942711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1032/2066] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:54.944566 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7a3d6-2e2b-477b-aa0f-ab787961f0ac tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:54.948122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0eb7a3d6-2e2b-477b-aa0f-ab787961f0ac tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:54.985173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3ae60-1b4b-4f97-9d1e-d76087f2f715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:54.985985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3ae60-1b4b-4f97-9d1e-d76087f2f715 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:54.986276 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3ae60-1b4b-4f97-9d1e-d76087f2f715 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:54.986577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3ae60-1b4b-4f97-9d1e-d76087f2f715 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:54.987301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3ae60-1b4b-4f97-9d1e-d76087f2f715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:54.987611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3ae60-1b4b-4f97-9d1e-d76087f2f715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:54.989246 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3ae60-1b4b-4f97-9d1e-d76087f2f715 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:55.010914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1035/2067] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:55.010914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3ae60-1b4b-4f97-9d1e-d76087f2f715 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:55.021035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3ae60-1b4b-4f97-9d1e-d76087f2f715 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:55.027305 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d9e73-a68e-4d9e-9020-e87c5c93b571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:55.028033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d9e73-a68e-4d9e-9020-e87c5c93b571 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:55.028391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d9e73-a68e-4d9e-9020-e87c5c93b571 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:55.028740 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d9e73-a68e-4d9e-9020-e87c5c93b571 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:55.029554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d9e73-a68e-4d9e-9020-e87c5c93b571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:55.031209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d9e73-a68e-4d9e-9020-e87c5c93b571 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:55.038766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7a3d6-2e2b-477b-aa0f-ab787961f0ac tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:55.044354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cf134-a2fe-4307-bc15-ffd17fe2faf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:55.044942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1036/2068] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:55.045053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cf134-a2fe-4307-bc15-ffd17fe2faf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:55.045285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cf134-a2fe-4307-bc15-ffd17fe2faf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:55.045561 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45cf134-a2fe-4307-bc15-ffd17fe2faf8 admin admin] PATH_INFO: `/v3/users/cf233c558d034ea984161bbe3a5fea39` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:55.045860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d9e73-a68e-4d9e-9020-e87c5c93b571 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:55.049082 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45cf134-a2fe-4307-bc15-ffd17fe2faf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf233c558d034ea984161bbe3a5fea39)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:55.051605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45cf134-a2fe-4307-bc15-ffd17fe2faf8 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:55.060833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d9e73-a68e-4d9e-9020-e87c5c93b571 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:55.067995 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdab92d750b3401e875263fc9f34afc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4279cea3cd14182973f02d039842e12', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:55.068665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:55.069035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:55.069442 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] PATH_INFO: `/v3/projects/5afae13466c7483aadce4e99c4ba7402` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:55.070847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5afae13466c7483aadce4e99c4ba7402)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:55.073243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:55.091963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:55.120522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f45cf134-a2fe-4307-bc15-ffd17fe2faf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf233c558d034ea984161bbe3a5fea39'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.121977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f45cf134-a2fe-4307-bc15-ffd17fe2faf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf233c558d034ea984161bbe3a5fea39'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.134300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f45cf134-a2fe-4307-bc15-ffd17fe2faf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf233c558d034ea984161bbe3a5fea39'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.135148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f45cf134-a2fe-4307-bc15-ffd17fe2faf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf233c558d034ea984161bbe3a5fea39'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.136149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afae13466c7483aadce4e99c4ba7402', 'request_id': 'req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.144409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afae13466c7483aadce4e99c4ba7402', 'request_id': 'req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.146367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f45cf134-a2fe-4307-bc15-ffd17fe2faf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf233c558d034ea984161bbe3a5fea39'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.153421 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afae13466c7483aadce4e99c4ba7402', 'request_id': 'req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.169620 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] The token cache is being invalidate because project 5afae13466c7483aadce4e99c4ba7402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:55.169932 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.170864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.171266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1033/2069] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:54 2022] DELETE /identity/v3/users/cf233c558d034ea984161bbe3a5fea39 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:55.172567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1037/2070] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:55 2022] DELETE /identity/v3/projects/5afae13466c7483aadce4e99c4ba7402 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:55.172808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cf134-a2fe-4307-bc15-ffd17fe2faf8 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:55.175095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f45cf134-a2fe-4307-bc15-ffd17fe2faf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:55.175910 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:55.177780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:55.263027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45cf134-a2fe-4307-bc15-ffd17fe2faf8 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:55.267865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7ca4f-fda8-45d1-ac4d-beeef1a6b98e tempest-VolumeQuotaClassesTest-1524670967 tempest-VolumeQuotaClassesTest-1524670967-project-admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:55.269313 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92726824-5120-449d-b0a9-42b1175575ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:55.270042 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92726824-5120-449d-b0a9-42b1175575ab admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:55.270523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92726824-5120-449d-b0a9-42b1175575ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:55.270922 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92726824-5120-449d-b0a9-42b1175575ab admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:55.271645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92726824-5120-449d-b0a9-42b1175575ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:55.273655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92726824-5120-449d-b0a9-42b1175575ab admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:55.275999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9b753-8db1-49b2-99d1-6ec258939824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:55.276824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9b753-8db1-49b2-99d1-6ec258939824 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:55.277188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9b753-8db1-49b2-99d1-6ec258939824 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:55.277545 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9b753-8db1-49b2-99d1-6ec258939824 admin admin] PATH_INFO: `/v3/projects/72f74199df4841f5ba118919b517c744/users/b2173cea839348c4a9bfa2819f72232d/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:55.279833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9b753-8db1-49b2-99d1-6ec258939824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f74199df4841f5ba118919b517c744, user_id=b2173cea839348c4a9bfa2819f72232d, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:55.282453 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9b753-8db1-49b2-99d1-6ec258939824 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:55.285117 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:55.304754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1038/2071] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:55 2022] PUT /identity/v3/projects/72f74199df4841f5ba118919b517c744/users/b2173cea839348c4a9bfa2819f72232d/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:55.307722 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107130a4-20ea-478f-ad29-d7a8a19c81ed None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:55.307876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107130a4-20ea-478f-ad29-d7a8a19c81ed None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:55.308182 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107130a4-20ea-478f-ad29-d7a8a19c81ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:55.314168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1034/2072] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:55 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:55.316064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b6178-2d4b-44e2-9ead-5ba8ecd1a53d None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:55.316353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b6178-2d4b-44e2-9ead-5ba8ecd1a53d None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:55.316631 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b6178-2d4b-44e2-9ead-5ba8ecd1a53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:55.342033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-107130a4-20ea-478f-ad29-d7a8a19c81ed None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:55.343318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-107130a4-20ea-478f-ad29-d7a8a19c81ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:55.397057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-f24b6178-2d4b-44e2-9ead-5ba8ecd1a53d None None] MFA Rules not processed for user `b2173cea839348c4a9bfa2819f72232d`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:55.398374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f24b6178-2d4b-44e2-9ead-5ba8ecd1a53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:55.460145 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1039/2073] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:55.461081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107130a4-20ea-478f-ad29-d7a8a19c81ed None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:55.463148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-107130a4-20ea-478f-ad29-d7a8a19c81ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:55.477896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107130a4-20ea-478f-ad29-d7a8a19c81ed None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:55.482079 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800a569-1a24-4bb4-ab96-0c6bb26c88f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:55.482770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800a569-1a24-4bb4-ab96-0c6bb26c88f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:55.483048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800a569-1a24-4bb4-ab96-0c6bb26c88f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:55.483329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800a569-1a24-4bb4-ab96-0c6bb26c88f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:55.484027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800a569-1a24-4bb4-ab96-0c6bb26c88f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:55.488105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800a569-1a24-4bb4-ab96-0c6bb26c88f9 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:55.520341 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1040/2074] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:55 2022] POST /identity/v3/users => generated 292 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:50:55.521186 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800a569-1a24-4bb4-ab96-0c6bb26c88f9 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:55.522628 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1035/2075] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:55.523515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b6178-2d4b-44e2-9ead-5ba8ecd1a53d None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:55.531889 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f24b6178-2d4b-44e2-9ead-5ba8ecd1a53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:55.532470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0800a569-1a24-4bb4-ab96-0c6bb26c88f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:55.548109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b6178-2d4b-44e2-9ead-5ba8ecd1a53d None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:55.559217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2cf90-8c83-402a-9872-ba23868138e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:55.560347 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2cf90-8c83-402a-9872-ba23868138e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:55.560851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2cf90-8c83-402a-9872-ba23868138e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:55.562158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2cf90-8c83-402a-9872-ba23868138e8 admin admin] PATH_INFO: `/v3/users/b9e02de13d5a43d28f69d8cae62aa9aa` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:55.564450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2cf90-8c83-402a-9872-ba23868138e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e02de13d5a43d28f69d8cae62aa9aa)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:55.568417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2cf90-8c83-402a-9872-ba23868138e8 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:55.586992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:55.625078 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800a569-1a24-4bb4-ab96-0c6bb26c88f9 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:55.630173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba4b9e-5120-4889-bec0-7c92137e2914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:55.630828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba4b9e-5120-4889-bec0-7c92137e2914 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:55.631115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba4b9e-5120-4889-bec0-7c92137e2914 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:55.631683 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba4b9e-5120-4889-bec0-7c92137e2914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:55.653832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba4b9e-5120-4889-bec0-7c92137e2914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:55.655710 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba4b9e-5120-4889-bec0-7c92137e2914 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:55.668780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-58f2cf90-8c83-402a-9872-ba23868138e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e02de13d5a43d28f69d8cae62aa9aa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.669474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-58f2cf90-8c83-402a-9872-ba23868138e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e02de13d5a43d28f69d8cae62aa9aa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.672413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1041/2076] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:55.674605 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba4b9e-5120-4889-bec0-7c92137e2914 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:55.679392 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-58f2cf90-8c83-402a-9872-ba23868138e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e02de13d5a43d28f69d8cae62aa9aa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.681621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-58f2cf90-8c83-402a-9872-ba23868138e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e02de13d5a43d28f69d8cae62aa9aa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.687961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba4b9e-5120-4889-bec0-7c92137e2914 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:55.693650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d96efa-4044-494f-9ca5-466054ae4857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:55.694756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d96efa-4044-494f-9ca5-466054ae4857 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:55.695193 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d96efa-4044-494f-9ca5-466054ae4857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:55.695537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d96efa-4044-494f-9ca5-466054ae4857 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:55.696533 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d96efa-4044-494f-9ca5-466054ae4857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:55.697233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-58f2cf90-8c83-402a-9872-ba23868138e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e02de13d5a43d28f69d8cae62aa9aa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:55.699400 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d96efa-4044-494f-9ca5-466054ae4857 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:55.722228 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1042/2077] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:55.722228 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d96efa-4044-494f-9ca5-466054ae4857 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:55.735988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-38d96efa-4044-494f-9ca5-466054ae4857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:55.760295 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1036/2078] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:55 2022] DELETE /identity/v3/users/b9e02de13d5a43d28f69d8cae62aa9aa => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:55.765749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2cf90-8c83-402a-9872-ba23868138e8 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:55.770241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-58f2cf90-8c83-402a-9872-ba23868138e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:55.907227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d96efa-4044-494f-9ca5-466054ae4857 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:55.917374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2cf90-8c83-402a-9872-ba23868138e8 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:55.931293 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60918b29-ae51-43e1-be23-47a1d7022f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:55.933123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918b29-ae51-43e1-be23-47a1d7022f43 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:55.933450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918b29-ae51-43e1-be23-47a1d7022f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:55.933800 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918b29-ae51-43e1-be23-47a1d7022f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:55.934648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60918b29-ae51-43e1-be23-47a1d7022f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:55.936370 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60918b29-ae51-43e1-be23-47a1d7022f43 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:55.943824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:55.957943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1037/2079] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:55.961237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d150d-4617-44e9-bc8f-549a2d89a8b7 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:55.961624 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d150d-4617-44e9-bc8f-549a2d89a8b7 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:55.962751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d150d-4617-44e9-bc8f-549a2d89a8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:56.019540 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb124f76-0fdb-461c-ba6b-cba5459a6f2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:56.021076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb124f76-0fdb-461c-ba6b-cba5459a6f2f service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:56.021404 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb124f76-0fdb-461c-ba6b-cba5459a6f2f service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:56.021867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb124f76-0fdb-461c-ba6b-cba5459a6f2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:56.021985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-3b9d150d-4617-44e9-bc8f-549a2d89a8b7 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:56.024208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3b9d150d-4617-44e9-bc8f-549a2d89a8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:56.025811 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-cb124f76-0fdb-461c-ba6b-cba5459a6f2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:56.035385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1038/2080] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:56.041422 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d150d-4617-44e9-bc8f-549a2d89a8b7 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:56.062626 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d150d-4617-44e9-bc8f-549a2d89a8b7 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:56.081202 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acef0b4-9af1-4561-8a6c-d79dd70bf56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:56.082926 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acef0b4-9af1-4561-8a6c-d79dd70bf56a admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:56.084372 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acef0b4-9af1-4561-8a6c-d79dd70bf56a admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:56.085058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acef0b4-9af1-4561-8a6c-d79dd70bf56a admin admin] PATH_INFO: `/v3/projects/b7a887a3ee994e67b05d1386962c7146/users/430c66f26b1e406aa14712bad5ed1e13/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:56.136291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acef0b4-9af1-4561-8a6c-d79dd70bf56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a887a3ee994e67b05d1386962c7146, user_id=430c66f26b1e406aa14712bad5ed1e13, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:56.145032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acef0b4-9af1-4561-8a6c-d79dd70bf56a admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:56.151950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb124f76-0fdb-461c-ba6b-cba5459a6f2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:56.156311 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb124f76-0fdb-461c-ba6b-cba5459a6f2f service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:56.174864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1043/2081] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:56.184124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1039/2082] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:56 2022] PUT /identity/v3/projects/b7a887a3ee994e67b05d1386962c7146/users/430c66f26b1e406aa14712bad5ed1e13/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:56.187210 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acef0b4-9af1-4561-8a6c-d79dd70bf56a admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:56.198018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4a44-ee34-4ad4-8d8c-249eb778a689 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:56.198424 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4a44-ee34-4ad4-8d8c-249eb778a689 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:56.198879 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4a44-ee34-4ad4-8d8c-249eb778a689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:56.199083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6acef0b4-9af1-4561-8a6c-d79dd70bf56a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:56.284917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-73bf4a44-ee34-4ad4-8d8c-249eb778a689 None None] MFA Rules not processed for user `430c66f26b1e406aa14712bad5ed1e13`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:56.287075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-73bf4a44-ee34-4ad4-8d8c-249eb778a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:56.357538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acef0b4-9af1-4561-8a6c-d79dd70bf56a admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:56.364974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2494a4-5def-4770-b5bc-3d560f01d4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:56.366318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2494a4-5def-4770-b5bc-3d560f01d4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:56.366826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2494a4-5def-4770-b5bc-3d560f01d4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:56.367766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2494a4-5def-4770-b5bc-3d560f01d4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:56.377813 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:56.402704 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1044/2083] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:56.408581 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf4a44-ee34-4ad4-8d8c-249eb778a689 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:56.411617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-73bf4a44-ee34-4ad4-8d8c-249eb778a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:56.484202 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2494a4-5def-4770-b5bc-3d560f01d4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:56.486985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2494a4-5def-4770-b5bc-3d560f01d4f0 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:56.505238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf4a44-ee34-4ad4-8d8c-249eb778a689 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:56.508219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1040/2084] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:56.509675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2494a4-5def-4770-b5bc-3d560f01d4f0 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:56.511290 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:56.512028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:56.512560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:56.512923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] PATH_INFO: `/v3/projects/a2ecf39f9ada4e44bb6936260d030a1d` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:56.514343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ecf39f9ada4e44bb6936260d030a1d)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:56.516409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:56.531805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:56.589032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ecf39f9ada4e44bb6936260d030a1d', 'request_id': 'req-5ed02903-a21f-42ff-8e3c-51a399fea94e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:56.601285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ecf39f9ada4e44bb6936260d030a1d', 'request_id': 'req-5ed02903-a21f-42ff-8e3c-51a399fea94e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:56.604784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2494a4-5def-4770-b5bc-3d560f01d4f0 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:56.621486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ecf39f9ada4e44bb6936260d030a1d', 'request_id': 'req-5ed02903-a21f-42ff-8e3c-51a399fea94e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:56.651677 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] The token cache is being invalidate because project a2ecf39f9ada4e44bb6936260d030a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:56.652003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:56.652839 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:56.654554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1045/2085] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:56 2022] DELETE /identity/v3/projects/a2ecf39f9ada4e44bb6936260d030a1d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:56.658879 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:56.660669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:56.696090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612213aa-def5-4f5b-b1dc-55d08910bf55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:56.697560 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612213aa-def5-4f5b-b1dc-55d08910bf55 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:56.697854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612213aa-def5-4f5b-b1dc-55d08910bf55 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:56.698122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612213aa-def5-4f5b-b1dc-55d08910bf55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:56.700090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-612213aa-def5-4f5b-b1dc-55d08910bf55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:56.795320 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed02903-a21f-42ff-8e3c-51a399fea94e admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:56.818548 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27ec51-5f68-4d05-9cfd-52628d5da2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:56.820081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27ec51-5f68-4d05-9cfd-52628d5da2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:56.822777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27ec51-5f68-4d05-9cfd-52628d5da2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:56.823200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27ec51-5f68-4d05-9cfd-52628d5da2e1 admin admin] PATH_INFO: `/v3/users/b926c16be0364e3c9b622971d0d1975f` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:56.825374 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27ec51-5f68-4d05-9cfd-52628d5da2e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b926c16be0364e3c9b622971d0d1975f)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:56.831852 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27ec51-5f68-4d05-9cfd-52628d5da2e1 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:56.878560 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612213aa-def5-4f5b-b1dc-55d08910bf55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:56.880600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612213aa-def5-4f5b-b1dc-55d08910bf55 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:56.905867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1041/2086] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:50:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:50:56.923782 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fa27ec51-5f68-4d05-9cfd-52628d5da2e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b926c16be0364e3c9b622971d0d1975f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:56.924751 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fa27ec51-5f68-4d05-9cfd-52628d5da2e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b926c16be0364e3c9b622971d0d1975f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:56.938926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fa27ec51-5f68-4d05-9cfd-52628d5da2e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b926c16be0364e3c9b622971d0d1975f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:56.952202 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fa27ec51-5f68-4d05-9cfd-52628d5da2e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b926c16be0364e3c9b622971d0d1975f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:56.954555 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fa27ec51-5f68-4d05-9cfd-52628d5da2e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b926c16be0364e3c9b622971d0d1975f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.000480 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1046/2087] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:56 2022] DELETE /identity/v3/users/b926c16be0364e3c9b622971d0d1975f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:57.021019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612213aa-def5-4f5b-b1dc-55d08910bf55 service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:57.022622 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-612213aa-def5-4f5b-b1dc-55d08910bf55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:57.041714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612213aa-def5-4f5b-b1dc-55d08910bf55 service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:57.062325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:57.148818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:57.150321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:57.150924 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:57.151230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] PATH_INFO: `/v3/projects/c20939698ac740779010408577efa71a` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:57.155173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20939698ac740779010408577efa71a)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:57.166826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:57.265590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20939698ac740779010408577efa71a', 'request_id': 'req-e21773fb-c07c-4939-b9be-960a8fe33125'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.277402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20939698ac740779010408577efa71a', 'request_id': 'req-e21773fb-c07c-4939-b9be-960a8fe33125'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.289460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20939698ac740779010408577efa71a', 'request_id': 'req-e21773fb-c07c-4939-b9be-960a8fe33125'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.322366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] The token cache is being invalidate because project c20939698ac740779010408577efa71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:57.322366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.322366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.322366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1042/2088] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:57 2022] DELETE /identity/v3/projects/c20939698ac740779010408577efa71a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:57.322701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27ec51-5f68-4d05-9cfd-52628d5da2e1 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:57.323949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-fa27ec51-5f68-4d05-9cfd-52628d5da2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:57.347864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27ec51-5f68-4d05-9cfd-52628d5da2e1 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:57.369922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:57.412333 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:57.414172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:57.486355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433aad8-46d4-41b1-bde9-924b692127cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:57.487148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433aad8-46d4-41b1-bde9-924b692127cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:57.487685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433aad8-46d4-41b1-bde9-924b692127cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:57.487986 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433aad8-46d4-41b1-bde9-924b692127cf admin admin] PATH_INFO: `/v3/users/cdab92d750b3401e875263fc9f34afc7` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:57.490308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433aad8-46d4-41b1-bde9-924b692127cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdab92d750b3401e875263fc9f34afc7)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:57.492171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433aad8-46d4-41b1-bde9-924b692127cf admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:57.548704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21773fb-c07c-4939-b9be-960a8fe33125 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:57.554071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6433aad8-46d4-41b1-bde9-924b692127cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdab92d750b3401e875263fc9f34afc7'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.554543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:57.554780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6433aad8-46d4-41b1-bde9-924b692127cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdab92d750b3401e875263fc9f34afc7'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.555465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:57.555809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:57.556111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] PATH_INFO: `/v3/projects/272f3f9217d244dfb8ec31828fd4ad25` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:57.557538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=272f3f9217d244dfb8ec31828fd4ad25)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:57.559486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:57.564158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6433aad8-46d4-41b1-bde9-924b692127cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdab92d750b3401e875263fc9f34afc7'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.572773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6433aad8-46d4-41b1-bde9-924b692127cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdab92d750b3401e875263fc9f34afc7'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.573505 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6433aad8-46d4-41b1-bde9-924b692127cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdab92d750b3401e875263fc9f34afc7'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.594060 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1047/2089] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:57 2022] DELETE /identity/v3/users/cdab92d750b3401e875263fc9f34afc7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:57.613031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:57.616814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272f3f9217d244dfb8ec31828fd4ad25', 'request_id': 'req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.625660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272f3f9217d244dfb8ec31828fd4ad25', 'request_id': 'req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.635968 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272f3f9217d244dfb8ec31828fd4ad25', 'request_id': 'req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.655592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] The token cache is being invalidate because project 272f3f9217d244dfb8ec31828fd4ad25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:57.655965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.657050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:57.659853 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1043/2090] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:57 2022] DELETE /identity/v3/projects/272f3f9217d244dfb8ec31828fd4ad25 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:50:57.665520 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433aad8-46d4-41b1-bde9-924b692127cf admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:57.667611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6433aad8-46d4-41b1-bde9-924b692127cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:57.773616 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433aad8-46d4-41b1-bde9-924b692127cf admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:57.825225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:57.849882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651d84c-00e5-4f1b-a2b0-9dc38ce5a4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:57.850668 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651d84c-00e5-4f1b-a2b0-9dc38ce5a4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:57.850951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651d84c-00e5-4f1b-a2b0-9dc38ce5a4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:57.851225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651d84c-00e5-4f1b-a2b0-9dc38ce5a4e3 admin admin] PATH_INFO: `/v3/users/1fb9ab043aad4d4381b48443e4eb8b07` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:57.853161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651d84c-00e5-4f1b-a2b0-9dc38ce5a4e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb9ab043aad4d4381b48443e4eb8b07)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:57.855536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651d84c-00e5-4f1b-a2b0-9dc38ce5a4e3 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:58.024057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8651d84c-00e5-4f1b-a2b0-9dc38ce5a4e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb9ab043aad4d4381b48443e4eb8b07'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.025629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8651d84c-00e5-4f1b-a2b0-9dc38ce5a4e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb9ab043aad4d4381b48443e4eb8b07'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.054866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8651d84c-00e5-4f1b-a2b0-9dc38ce5a4e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb9ab043aad4d4381b48443e4eb8b07'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.068362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8651d84c-00e5-4f1b-a2b0-9dc38ce5a4e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb9ab043aad4d4381b48443e4eb8b07'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.069596 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8651d84c-00e5-4f1b-a2b0-9dc38ce5a4e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb9ab043aad4d4381b48443e4eb8b07'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.081020 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:58.083952 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:58.111292 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ddcd-5e6e-41b6-a08e-2aab77750e56 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:58.125765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c78920-bea2-422e-a901-c3cde41c29e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:58.128829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c78920-bea2-422e-a901-c3cde41c29e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:58.129996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c78920-bea2-422e-a901-c3cde41c29e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:58.130598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c78920-bea2-422e-a901-c3cde41c29e6 admin admin] PATH_INFO: `/v3/projects/f4279cea3cd14182973f02d039842e12` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:58.132238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c78920-bea2-422e-a901-c3cde41c29e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4279cea3cd14182973f02d039842e12)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:58.134940 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c78920-bea2-422e-a901-c3cde41c29e6 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:58.141486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1048/2091] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:57 2022] DELETE /identity/v3/users/1fb9ab043aad4d4381b48443e4eb8b07 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:58.242088 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-41c78920-bea2-422e-a901-c3cde41c29e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4279cea3cd14182973f02d039842e12', 'request_id': 'req-41c78920-bea2-422e-a901-c3cde41c29e6'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.256187 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-41c78920-bea2-422e-a901-c3cde41c29e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4279cea3cd14182973f02d039842e12', 'request_id': 'req-41c78920-bea2-422e-a901-c3cde41c29e6'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.272832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-41c78920-bea2-422e-a901-c3cde41c29e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4279cea3cd14182973f02d039842e12', 'request_id': 'req-41c78920-bea2-422e-a901-c3cde41c29e6'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.288550 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-41c78920-bea2-422e-a901-c3cde41c29e6 admin admin] The token cache is being invalidate because project f4279cea3cd14182973f02d039842e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:58.288944 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-41c78920-bea2-422e-a901-c3cde41c29e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.290650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-41c78920-bea2-422e-a901-c3cde41c29e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.303871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00e7bc-c257-4d53-83d8-7498ca9c26b0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:58.304200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00e7bc-c257-4d53-83d8-7498ca9c26b0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:58.304739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00e7bc-c257-4d53-83d8-7498ca9c26b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:58.314766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1044/2092] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:58 2022] DELETE /identity/v3/projects/f4279cea3cd14182973f02d039842e12 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:58.356986 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6d00e7bc-c257-4d53-83d8-7498ca9c26b0 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:58.359086 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6d00e7bc-c257-4d53-83d8-7498ca9c26b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:58.480870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1049/2093] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:58.501742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77a5d8-c907-4ea9-a8bc-3ec03e4a0bec None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:58.502437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77a5d8-c907-4ea9-a8bc-3ec03e4a0bec None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:58.502647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77a5d8-c907-4ea9-a8bc-3ec03e4a0bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:58.531602 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-cb77a5d8-c907-4ea9-a8bc-3ec03e4a0bec None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:58.532894 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-cb77a5d8-c907-4ea9-a8bc-3ec03e4a0bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:58.546749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1045/2094] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:58.551700 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00e7bc-c257-4d53-83d8-7498ca9c26b0 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:58.566863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00e7bc-c257-4d53-83d8-7498ca9c26b0 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:58.608330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a393c6-fe3a-418b-bf86-d5e736655104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:58.608913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a393c6-fe3a-418b-bf86-d5e736655104 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:58.609200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a393c6-fe3a-418b-bf86-d5e736655104 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:58.609482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a393c6-fe3a-418b-bf86-d5e736655104 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:58.611041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a393c6-fe3a-418b-bf86-d5e736655104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:50:58.611810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a393c6-fe3a-418b-bf86-d5e736655104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:58.616620 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a393c6-fe3a-418b-bf86-d5e736655104 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:58.661076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1050/2095] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:50:58.663428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77a5d8-c907-4ea9-a8bc-3ec03e4a0bec None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:58.681121 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77a5d8-c907-4ea9-a8bc-3ec03e4a0bec None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:58.700134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a393c6-fe3a-418b-bf86-d5e736655104 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:58.702648 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-08a393c6-fe3a-418b-bf86-d5e736655104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:58.709979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87464067-8e88-485e-9ecb-906f3f84b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:58.710743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87464067-8e88-485e-9ecb-906f3f84b8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:58.711023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87464067-8e88-485e-9ecb-906f3f84b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:58.711303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87464067-8e88-485e-9ecb-906f3f84b8c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:58.712704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87464067-8e88-485e-9ecb-906f3f84b8c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:58.715760 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87464067-8e88-485e-9ecb-906f3f84b8c6 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:58.746271 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a393c6-fe3a-418b-bf86-d5e736655104 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:58.772461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:58.773424 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:58.773853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:58.774907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] PATH_INFO: `/v3/projects/31b61b9ef9f1488c93d43e0c231e520e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:58.777900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b61b9ef9f1488c93d43e0c231e520e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:58.783160 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:58.799025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1046/2096] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:58 2022] POST /identity/v3/projects => generated 389 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:58.803773 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87464067-8e88-485e-9ecb-906f3f84b8c6 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:58.897087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:58.915058 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b61b9ef9f1488c93d43e0c231e520e', 'request_id': 'req-400f0157-d174-4371-8a68-338fec6ae6dd'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.926402 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b61b9ef9f1488c93d43e0c231e520e', 'request_id': 'req-400f0157-d174-4371-8a68-338fec6ae6dd'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.935853 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87464067-8e88-485e-9ecb-906f3f84b8c6 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:58.938857 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b61b9ef9f1488c93d43e0c231e520e', 'request_id': 'req-400f0157-d174-4371-8a68-338fec6ae6dd'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.958527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] The token cache is being invalidate because project 31b61b9ef9f1488c93d43e0c231e520e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:50:58.959063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.959948 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:50:58.962794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1051/2097] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:50:58 2022] DELETE /identity/v3/projects/31b61b9ef9f1488c93d43e0c231e520e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:58.990740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:59.047304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b47ea9-a782-4c33-aaef-8d1aab1d777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:59.049157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47ea9-a782-4c33-aaef-8d1aab1d777b admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:59.049705 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47ea9-a782-4c33-aaef-8d1aab1d777b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:59.050486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47ea9-a782-4c33-aaef-8d1aab1d777b admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:59.051702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b47ea9-a782-4c33-aaef-8d1aab1d777b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:59.055439 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b47ea9-a782-4c33-aaef-8d1aab1d777b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:59.099935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1047/2098] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:58 2022] POST /identity/v3/users => generated 295 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:59.106164 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:59.108335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:59.133097 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f0157-d174-4371-8a68-338fec6ae6dd admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:59.139258 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2f6a1-95c2-4a96-a3ee-2808639bee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:59.139914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2f6a1-95c2-4a96-a3ee-2808639bee79 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:59.140192 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2f6a1-95c2-4a96-a3ee-2808639bee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:59.140470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2f6a1-95c2-4a96-a3ee-2808639bee79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:59.141294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2f6a1-95c2-4a96-a3ee-2808639bee79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:59.144293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2f6a1-95c2-4a96-a3ee-2808639bee79 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:59.161856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1052/2099] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:59.166480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b47ea9-a782-4c33-aaef-8d1aab1d777b admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:59.183586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b47ea9-a782-4c33-aaef-8d1aab1d777b admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:59.190619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede95151-0f0c-4384-93bb-aba7496977d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:59.192002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede95151-0f0c-4384-93bb-aba7496977d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:59.192002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede95151-0f0c-4384-93bb-aba7496977d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:59.192002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede95151-0f0c-4384-93bb-aba7496977d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:59.192607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede95151-0f0c-4384-93bb-aba7496977d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:59.194351 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede95151-0f0c-4384-93bb-aba7496977d5 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:59.207802 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1048/2100] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:59.212674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2f6a1-95c2-4a96-a3ee-2808639bee79 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:59.226911 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2f6a1-95c2-4a96-a3ee-2808639bee79 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:59.232262 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610397c-a459-449f-b600-d045ff4a6cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:59.233079 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610397c-a459-449f-b600-d045ff4a6cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:59.233303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610397c-a459-449f-b600-d045ff4a6cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:59.233629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610397c-a459-449f-b600-d045ff4a6cc7 admin admin] PATH_INFO: `/v3/projects/69d35504bf0743da8d330dce285618dc/users/3c59ebddaf0f40a48512b20b217e0f31/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:59.252087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610397c-a459-449f-b600-d045ff4a6cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d35504bf0743da8d330dce285618dc, user_id=3c59ebddaf0f40a48512b20b217e0f31, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:59.255435 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610397c-a459-449f-b600-d045ff4a6cc7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:59.271717 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1053/2101] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:59 2022] PUT /identity/v3/projects/69d35504bf0743da8d330dce285618dc/users/3c59ebddaf0f40a48512b20b217e0f31/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:59.284962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da302637-01ca-49af-b5d5-abfefa138896 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:59.285361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da302637-01ca-49af-b5d5-abfefa138896 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:59.285632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da302637-01ca-49af-b5d5-abfefa138896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:59.328301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-da302637-01ca-49af-b5d5-abfefa138896 None None] MFA Rules not processed for user `3c59ebddaf0f40a48512b20b217e0f31`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:50:59.330128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-da302637-01ca-49af-b5d5-abfefa138896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:59.468520 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1049/2102] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:50:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:50:59.472978 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610397c-a459-449f-b600-d045ff4a6cc7 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:59.580183 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610397c-a459-449f-b600-d045ff4a6cc7 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:59.585273 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f1c1d-e8a6-4437-9487-63bd0c817d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:59.585792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f1c1d-e8a6-4437-9487-63bd0c817d0b admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:59.586076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f1c1d-e8a6-4437-9487-63bd0c817d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:59.586391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f1c1d-e8a6-4437-9487-63bd0c817d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:59.587669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f1c1d-e8a6-4437-9487-63bd0c817d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:59.589641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f1c1d-e8a6-4437-9487-63bd0c817d0b admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:59.621604 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1054/2103] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:50:59 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:59.626990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da302637-01ca-49af-b5d5-abfefa138896 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:59.642271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da302637-01ca-49af-b5d5-abfefa138896 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:59.706620 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341a3a9-3ba9-47c1-93c5-f14908263e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:59.707170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341a3a9-3ba9-47c1-93c5-f14908263e42 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:59.707456 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341a3a9-3ba9-47c1-93c5-f14908263e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:59.707733 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341a3a9-3ba9-47c1-93c5-f14908263e42 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:59.708419 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341a3a9-3ba9-47c1-93c5-f14908263e42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:59.710389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341a3a9-3ba9-47c1-93c5-f14908263e42 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:59.747282 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1050/2104] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:50:59 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:50:59.752806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f1c1d-e8a6-4437-9487-63bd0c817d0b admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:59.768349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f1c1d-e8a6-4437-9487-63bd0c817d0b admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:59.773462 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a1095-2c4c-46db-857e-0a34e4abeca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:59.774097 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a1095-2c4c-46db-857e-0a34e4abeca4 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:59.775152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a1095-2c4c-46db-857e-0a34e4abeca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:59.775493 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a1095-2c4c-46db-857e-0a34e4abeca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:59.776331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a1095-2c4c-46db-857e-0a34e4abeca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:59.777973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a1095-2c4c-46db-857e-0a34e4abeca4 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:59.793303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1055/2105] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:50:59.799244 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341a3a9-3ba9-47c1-93c5-f14908263e42 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:59.809548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341a3a9-3ba9-47c1-93c5-f14908263e42 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:59.814656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef84f53-89fd-40ed-b6df-a2133be05bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:59.815146 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef84f53-89fd-40ed-b6df-a2133be05bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:59.815456 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef84f53-89fd-40ed-b6df-a2133be05bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:59.815736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef84f53-89fd-40ed-b6df-a2133be05bc6 admin admin] PATH_INFO: `/v3/projects/57226b4b51a74f82b60b32a07668b292/users/d0db761ffeef40be82c2b8dc6938e096/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:59.833423 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef84f53-89fd-40ed-b6df-a2133be05bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57226b4b51a74f82b60b32a07668b292, user_id=d0db761ffeef40be82c2b8dc6938e096, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:59.836124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef84f53-89fd-40ed-b6df-a2133be05bc6 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:59.852074 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1051/2106] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:59 2022] PUT /identity/v3/projects/57226b4b51a74f82b60b32a07668b292/users/d0db761ffeef40be82c2b8dc6938e096/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:50:59.856345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a1095-2c4c-46db-857e-0a34e4abeca4 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:59.868094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a1095-2c4c-46db-857e-0a34e4abeca4 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:50:59.940623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef84f53-89fd-40ed-b6df-a2133be05bc6 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:50:59.942303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4ef84f53-89fd-40ed-b6df-a2133be05bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:50:59.961173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:50:59.967573 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab5b05-f4ce-4669-9732-4783dfe0a4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:50:59.968719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab5b05-f4ce-4669-9732-4783dfe0a4ea admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:50:59.969259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab5b05-f4ce-4669-9732-4783dfe0a4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:50:59.969549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab5b05-f4ce-4669-9732-4783dfe0a4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:50:59.971446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab5b05-f4ce-4669-9732-4783dfe0a4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:50:59.974582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab5b05-f4ce-4669-9732-4783dfe0a4ea admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:50:59.988008 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1056/2107] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:50:59.995236 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab5b05-f4ce-4669-9732-4783dfe0a4ea admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:00.011810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab5b05-f4ce-4669-9732-4783dfe0a4ea admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:00.023690 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b6e86-18fb-4b63-a44b-3d72339da006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:00.026536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b6e86-18fb-4b63-a44b-3d72339da006 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:00.026985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b6e86-18fb-4b63-a44b-3d72339da006 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:00.027580 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b6e86-18fb-4b63-a44b-3d72339da006 admin admin] PATH_INFO: `/v3/projects/57226b4b51a74f82b60b32a07668b292/users/d0db761ffeef40be82c2b8dc6938e096/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:00.030678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b6e86-18fb-4b63-a44b-3d72339da006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57226b4b51a74f82b60b32a07668b292, user_id=d0db761ffeef40be82c2b8dc6938e096, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:00.033777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b6e86-18fb-4b63-a44b-3d72339da006 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:00.038752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:00.062419 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1057/2108] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:50:59 2022] PUT /identity/v3/projects/57226b4b51a74f82b60b32a07668b292/users/d0db761ffeef40be82c2b8dc6938e096/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:00.074140 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df387d-ab8e-450e-a8ca-39a43ff7a230 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:00.075382 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df387d-ab8e-450e-a8ca-39a43ff7a230 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:00.075828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df387d-ab8e-450e-a8ca-39a43ff7a230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:00.075946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef84f53-89fd-40ed-b6df-a2133be05bc6 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:00.121439 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-38df387d-ab8e-450e-a8ca-39a43ff7a230 None None] MFA Rules not processed for user `d0db761ffeef40be82c2b8dc6938e096`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:00.123100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-38df387d-ab8e-450e-a8ca-39a43ff7a230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:00.201489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8cdb6-4752-469c-8497-6d743c1f2e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:00.202840 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8cdb6-4752-469c-8497-6d743c1f2e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:00.203552 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8cdb6-4752-469c-8497-6d743c1f2e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:00.204028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8cdb6-4752-469c-8497-6d743c1f2e6f admin admin] PATH_INFO: `/v3/users/430c66f26b1e406aa14712bad5ed1e13` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:00.205901 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8cdb6-4752-469c-8497-6d743c1f2e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=430c66f26b1e406aa14712bad5ed1e13)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:00.209035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8cdb6-4752-469c-8497-6d743c1f2e6f admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:00.280355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1058/2109] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:00.294151 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df387d-ab8e-450e-a8ca-39a43ff7a230 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:00.301145 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-38df387d-ab8e-450e-a8ca-39a43ff7a230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:00.312783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c3d8cdb6-4752-469c-8497-6d743c1f2e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '430c66f26b1e406aa14712bad5ed1e13'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:00.314586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c3d8cdb6-4752-469c-8497-6d743c1f2e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '430c66f26b1e406aa14712bad5ed1e13'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:00.333799 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c3d8cdb6-4752-469c-8497-6d743c1f2e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '430c66f26b1e406aa14712bad5ed1e13'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:00.337164 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c3d8cdb6-4752-469c-8497-6d743c1f2e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '430c66f26b1e406aa14712bad5ed1e13'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:00.350448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c3d8cdb6-4752-469c-8497-6d743c1f2e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '430c66f26b1e406aa14712bad5ed1e13'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:00.374946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1052/2110] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:50:59 2022] DELETE /identity/v3/users/430c66f26b1e406aa14712bad5ed1e13 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:51:00.380362 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3acb64-4d2a-4acc-9827-661605599300 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:00.380651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3acb64-4d2a-4acc-9827-661605599300 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:00.380933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3acb64-4d2a-4acc-9827-661605599300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:00.384807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df387d-ab8e-450e-a8ca-39a43ff7a230 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:00.407769 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-ce3acb64-4d2a-4acc-9827-661605599300 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:00.407769 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ce3acb64-4d2a-4acc-9827-661605599300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:00.441782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:00.454096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f3e14-7788-4983-861e-a661d2796fa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:00.455059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f3e14-7788-4983-861e-a661d2796fa5 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:00.455389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f3e14-7788-4983-861e-a661d2796fa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:00.455772 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f3e14-7788-4983-861e-a661d2796fa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:00.463406 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f71f3e14-7788-4983-861e-a661d2796fa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:00.493401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1053/2111] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:51:00.504854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3acb64-4d2a-4acc-9827-661605599300 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:00.506349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ce3acb64-4d2a-4acc-9827-661605599300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:00.519870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:00.536396 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f3e14-7788-4983-861e-a661d2796fa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:00.538090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f3e14-7788-4983-861e-a661d2796fa5 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:00.551795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1059/2112] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:00.585014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3acb64-4d2a-4acc-9827-661605599300 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:00.589092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b0b07-574d-4b73-ac02-e243125d74d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:00.589769 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b0b07-574d-4b73-ac02-e243125d74d4 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:00.590057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b0b07-574d-4b73-ac02-e243125d74d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:00.590380 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b0b07-574d-4b73-ac02-e243125d74d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:00.606591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b0b07-574d-4b73-ac02-e243125d74d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:00.608069 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b0b07-574d-4b73-ac02-e243125d74d4 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:00.620118 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1054/2113] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:51:00.854297 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f3e14-7788-4983-861e-a661d2796fa5 service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:00.856337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f71f3e14-7788-4983-861e-a661d2796fa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:00.870940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f3e14-7788-4983-861e-a661d2796fa5 service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:00.880204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab8df7-fa2b-4280-a6b9-6bcf9bdfb6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:00.880889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab8df7-fa2b-4280-a6b9-6bcf9bdfb6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:00.881368 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab8df7-fa2b-4280-a6b9-6bcf9bdfb6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:00.881700 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab8df7-fa2b-4280-a6b9-6bcf9bdfb6bb admin admin] PATH_INFO: `/v3/users/3c59ebddaf0f40a48512b20b217e0f31` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:00.882949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab8df7-fa2b-4280-a6b9-6bcf9bdfb6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c59ebddaf0f40a48512b20b217e0f31)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:00.886033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab8df7-fa2b-4280-a6b9-6bcf9bdfb6bb admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:00.947302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-34ab8df7-fa2b-4280-a6b9-6bcf9bdfb6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c59ebddaf0f40a48512b20b217e0f31'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:00.948136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-34ab8df7-fa2b-4280-a6b9-6bcf9bdfb6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c59ebddaf0f40a48512b20b217e0f31'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:00.957071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-34ab8df7-fa2b-4280-a6b9-6bcf9bdfb6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c59ebddaf0f40a48512b20b217e0f31'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:00.966089 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-34ab8df7-fa2b-4280-a6b9-6bcf9bdfb6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c59ebddaf0f40a48512b20b217e0f31'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:00.966872 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-34ab8df7-fa2b-4280-a6b9-6bcf9bdfb6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c59ebddaf0f40a48512b20b217e0f31'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:00.988363 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1060/2114] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:51:00 2022] DELETE /identity/v3/users/3c59ebddaf0f40a48512b20b217e0f31 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:00.993494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afd7c4-d0e9-4ae5-886b-4e5fb73e38a0 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:00.994372 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afd7c4-d0e9-4ae5-886b-4e5fb73e38a0 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:00.994372 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afd7c4-d0e9-4ae5-886b-4e5fb73e38a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:01.016714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-57afd7c4-d0e9-4ae5-886b-4e5fb73e38a0 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:01.017981 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-57afd7c4-d0e9-4ae5-886b-4e5fb73e38a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:01.038348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab8df7-fa2b-4280-a6b9-6bcf9bdfb6bb admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:01.041087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-34ab8df7-fa2b-4280-a6b9-6bcf9bdfb6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:01.126349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1055/2115] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:51:01.137038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afd7c4-d0e9-4ae5-886b-4e5fb73e38a0 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:01.138540 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab8df7-fa2b-4280-a6b9-6bcf9bdfb6bb admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:01.139790 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-57afd7c4-d0e9-4ae5-886b-4e5fb73e38a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:01.146539 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:01.146949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:01.147236 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:01.147593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] PATH_INFO: `/v3/projects/b7a887a3ee994e67b05d1386962c7146` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:01.149507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a887a3ee994e67b05d1386962c7146)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:01.152568 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:01.218781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a887a3ee994e67b05d1386962c7146', 'request_id': 'req-816feb4f-dd87-4f7a-b57e-515e5a73be20'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:01.228637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a887a3ee994e67b05d1386962c7146', 'request_id': 'req-816feb4f-dd87-4f7a-b57e-515e5a73be20'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:01.237340 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:01.237675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afd7c4-d0e9-4ae5-886b-4e5fb73e38a0 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:01.240677 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a887a3ee994e67b05d1386962c7146', 'request_id': 'req-816feb4f-dd87-4f7a-b57e-515e5a73be20'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:01.263889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] The token cache is being invalidate because project b7a887a3ee994e67b05d1386962c7146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:51:01.263889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:01.264715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:01.267648 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1061/2116] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:51:01 2022] DELETE /identity/v3/projects/b7a887a3ee994e67b05d1386962c7146 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:01.295527 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:01.339160 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc80e1-e0be-4ffb-a799-708df455bd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:01.340762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc80e1-e0be-4ffb-a799-708df455bd23 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:01.341262 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc80e1-e0be-4ffb-a799-708df455bd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:01.341683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc80e1-e0be-4ffb-a799-708df455bd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:01.348952 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-bacc80e1-e0be-4ffb-a799-708df455bd23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:01.495216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc80e1-e0be-4ffb-a799-708df455bd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:01.495996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:01.497606 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc80e1-e0be-4ffb-a799-708df455bd23 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:01.498010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:01.515832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1056/2117] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:01.580185 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816feb4f-dd87-4f7a-b57e-515e5a73be20 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:01.584087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ba2b6-745b-42eb-bb6f-a864d61305fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:01.584686 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ba2b6-745b-42eb-bb6f-a864d61305fb service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:01.585011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ba2b6-745b-42eb-bb6f-a864d61305fb service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:01.585242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ba2b6-745b-42eb-bb6f-a864d61305fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:01.587355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8c4ba2b6-745b-42eb-bb6f-a864d61305fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:01.661061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ba2b6-745b-42eb-bb6f-a864d61305fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:01.662556 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ba2b6-745b-42eb-bb6f-a864d61305fb service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:01.674508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1062/2118] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:51:01.857605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc80e1-e0be-4ffb-a799-708df455bd23 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:01.860171 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-bacc80e1-e0be-4ffb-a799-708df455bd23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:01.885599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc80e1-e0be-4ffb-a799-708df455bd23 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:01.910044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:01.911999 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:01.912299 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:01.913138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] PATH_INFO: `/v3/projects/69d35504bf0743da8d330dce285618dc` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:01.919584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d35504bf0743da8d330dce285618dc)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:01.925876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:02.007089 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d35504bf0743da8d330dce285618dc', 'request_id': 'req-d9a320f7-7aab-4756-8e11-62ba73a73513'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.017129 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d35504bf0743da8d330dce285618dc', 'request_id': 'req-d9a320f7-7aab-4756-8e11-62ba73a73513'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.034239 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d35504bf0743da8d330dce285618dc', 'request_id': 'req-d9a320f7-7aab-4756-8e11-62ba73a73513'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.048566 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] The token cache is being invalidate because project 69d35504bf0743da8d330dce285618dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:51:02.049547 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.049934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.051753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1057/2119] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:51:01 2022] DELETE /identity/v3/projects/69d35504bf0743da8d330dce285618dc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:02.056774 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ba2b6-745b-42eb-bb6f-a864d61305fb service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:02.070830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ba2b6-745b-42eb-bb6f-a864d61305fb service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:02.169349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01ed01-52cf-48d4-b99b-2b060d308b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:02.170061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01ed01-52cf-48d4-b99b-2b060d308b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:02.170375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01ed01-52cf-48d4-b99b-2b060d308b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:02.170657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01ed01-52cf-48d4-b99b-2b060d308b13 admin admin] PATH_INFO: `/v3/users/d0db761ffeef40be82c2b8dc6938e096` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:02.172496 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01ed01-52cf-48d4-b99b-2b060d308b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0db761ffeef40be82c2b8dc6938e096)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:02.174483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01ed01-52cf-48d4-b99b-2b060d308b13 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:02.232987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:02.239813 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fb01ed01-52cf-48d4-b99b-2b060d308b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0db761ffeef40be82c2b8dc6938e096'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.240864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fb01ed01-52cf-48d4-b99b-2b060d308b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0db761ffeef40be82c2b8dc6938e096'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.250010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fb01ed01-52cf-48d4-b99b-2b060d308b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0db761ffeef40be82c2b8dc6938e096'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.257483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fb01ed01-52cf-48d4-b99b-2b060d308b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0db761ffeef40be82c2b8dc6938e096'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.258210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fb01ed01-52cf-48d4-b99b-2b060d308b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0db761ffeef40be82c2b8dc6938e096'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.278920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1063/2120] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:51:02 2022] DELETE /identity/v3/users/d0db761ffeef40be82c2b8dc6938e096 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:02.658364 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:02.659840 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:02.676966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a320f7-7aab-4756-8e11-62ba73a73513 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:02.755580 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:02.756243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:02.756654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:02.756829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5 admin admin] PATH_INFO: `/v3/projects/57226b4b51a74f82b60b32a07668b292` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:02.758201 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57226b4b51a74f82b60b32a07668b292)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:02.760900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:02.774917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:02.816681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57226b4b51a74f82b60b32a07668b292', 'request_id': 'req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.824203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57226b4b51a74f82b60b32a07668b292', 'request_id': 'req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.834598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57226b4b51a74f82b60b32a07668b292', 'request_id': 'req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.849415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5 admin admin] The token cache is being invalidate because project 57226b4b51a74f82b60b32a07668b292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:51:02.849720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.850474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-1ccdac7e-a04a-418a-9de5-c7de3b07f6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:02.852168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1058/2121] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:51:02 2022] DELETE /identity/v3/projects/57226b4b51a74f82b60b32a07668b292 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:02.857337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa3476-bb61-47d2-bfa6-6edd17aeb8ad None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:02.857635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa3476-bb61-47d2-bfa6-6edd17aeb8ad None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:02.857960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa3476-bb61-47d2-bfa6-6edd17aeb8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:02.880509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-bffa3476-bb61-47d2-bfa6-6edd17aeb8ad None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:02.882056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-bffa3476-bb61-47d2-bfa6-6edd17aeb8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:02.956866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1064/2122] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:51:02.966804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148353a6-16cc-4239-a2c6-2e8467e66cca None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:02.967142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148353a6-16cc-4239-a2c6-2e8467e66cca None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:02.967462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148353a6-16cc-4239-a2c6-2e8467e66cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:02.989794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-148353a6-16cc-4239-a2c6-2e8467e66cca None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:02.991433 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-148353a6-16cc-4239-a2c6-2e8467e66cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:03.000805 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1059/2123] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:51:03.006367 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa3476-bb61-47d2-bfa6-6edd17aeb8ad None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:03.021869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa3476-bb61-47d2-bfa6-6edd17aeb8ad None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:03.027207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fcea4-25a2-4bf5-a022-41a6ba3b7446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:03.027879 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fcea4-25a2-4bf5-a022-41a6ba3b7446 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:03.028276 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fcea4-25a2-4bf5-a022-41a6ba3b7446 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:03.028590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fcea4-25a2-4bf5-a022-41a6ba3b7446 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:03.029300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fcea4-25a2-4bf5-a022-41a6ba3b7446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:51:03.029601 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fcea4-25a2-4bf5-a022-41a6ba3b7446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:03.031599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fcea4-25a2-4bf5-a022-41a6ba3b7446 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:03.044973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1065/2124] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:51:03.049471 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148353a6-16cc-4239-a2c6-2e8467e66cca None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:03.060632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148353a6-16cc-4239-a2c6-2e8467e66cca None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:03.065523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d586f-b854-451c-9ce4-0680ffae3494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:03.066154 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d586f-b854-451c-9ce4-0680ffae3494 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:03.066491 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d586f-b854-451c-9ce4-0680ffae3494 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:03.066826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d586f-b854-451c-9ce4-0680ffae3494 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:03.067450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d586f-b854-451c-9ce4-0680ffae3494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:03.069367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d586f-b854-451c-9ce4-0680ffae3494 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:03.105458 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1060/2125] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:51:03 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:03.106709 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fcea4-25a2-4bf5-a022-41a6ba3b7446 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:03.117389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fcea4-25a2-4bf5-a022-41a6ba3b7446 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:03.185812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c297b-350b-4035-aab2-bf540b58ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:03.186501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c297b-350b-4035-aab2-bf540b58ed8d admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:03.186756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c297b-350b-4035-aab2-bf540b58ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:03.187031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c297b-350b-4035-aab2-bf540b58ed8d admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:03.187708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c297b-350b-4035-aab2-bf540b58ed8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:03.189789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c297b-350b-4035-aab2-bf540b58ed8d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:03.221935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1066/2126] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:51:03 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:03.223842 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d586f-b854-451c-9ce4-0680ffae3494 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:03.237022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d586f-b854-451c-9ce4-0680ffae3494 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:03.242254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cd888-422b-47a4-9a46-6ce952010f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:03.243564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cd888-422b-47a4-9a46-6ce952010f13 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:03.243858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cd888-422b-47a4-9a46-6ce952010f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:03.244135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cd888-422b-47a4-9a46-6ce952010f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:03.244847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cd888-422b-47a4-9a46-6ce952010f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:03.246509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cd888-422b-47a4-9a46-6ce952010f13 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:03.261006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1061/2127] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:03.262890 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c297b-350b-4035-aab2-bf540b58ed8d admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:03.285192 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c297b-350b-4035-aab2-bf540b58ed8d admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:03.288487 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dffbf9-9bd0-4940-a5bf-b4e8e03f164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:03.289108 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dffbf9-9bd0-4940-a5bf-b4e8e03f164c admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:03.289397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dffbf9-9bd0-4940-a5bf-b4e8e03f164c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:03.289703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dffbf9-9bd0-4940-a5bf-b4e8e03f164c admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:03.290953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dffbf9-9bd0-4940-a5bf-b4e8e03f164c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:03.292582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dffbf9-9bd0-4940-a5bf-b4e8e03f164c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:03.310510 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1067/2128] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:03.316316 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cd888-422b-47a4-9a46-6ce952010f13 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:03.332741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cd888-422b-47a4-9a46-6ce952010f13 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:03.340562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61847e5b-ab9a-445c-b2a3-c49968f463e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:03.341582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61847e5b-ab9a-445c-b2a3-c49968f463e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:03.342000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61847e5b-ab9a-445c-b2a3-c49968f463e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:03.342469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61847e5b-ab9a-445c-b2a3-c49968f463e0 admin admin] PATH_INFO: `/v3/projects/2a73524bf8eb4204bd7011a13ab69c47/users/29987e33cad646629f825ea662b10728/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:03.360276 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61847e5b-ab9a-445c-b2a3-c49968f463e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a73524bf8eb4204bd7011a13ab69c47, user_id=29987e33cad646629f825ea662b10728, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:03.363463 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61847e5b-ab9a-445c-b2a3-c49968f463e0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:03.379749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1062/2129] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:51:03 2022] PUT /identity/v3/projects/2a73524bf8eb4204bd7011a13ab69c47/users/29987e33cad646629f825ea662b10728/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:03.390519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb000a7a-3dde-4191-adad-ff4885db7fc0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:03.390809 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb000a7a-3dde-4191-adad-ff4885db7fc0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:03.391095 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb000a7a-3dde-4191-adad-ff4885db7fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:03.426449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-cb000a7a-3dde-4191-adad-ff4885db7fc0 None None] MFA Rules not processed for user `29987e33cad646629f825ea662b10728`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:03.427678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-cb000a7a-3dde-4191-adad-ff4885db7fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:03.445297 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:03.516046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1068/2130] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:51:03.521889 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61847e5b-ab9a-445c-b2a3-c49968f463e0 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:03.600092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61847e5b-ab9a-445c-b2a3-c49968f463e0 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:03.606700 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd12d2d-ca1e-4614-abe7-6ed7f1193676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:03.607665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd12d2d-ca1e-4614-abe7-6ed7f1193676 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:03.608227 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd12d2d-ca1e-4614-abe7-6ed7f1193676 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:03.608710 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd12d2d-ca1e-4614-abe7-6ed7f1193676 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:03.609667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd12d2d-ca1e-4614-abe7-6ed7f1193676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:03.611774 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd12d2d-ca1e-4614-abe7-6ed7f1193676 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:03.646244 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1063/2131] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:51:03 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:51:03.647965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb000a7a-3dde-4191-adad-ff4885db7fc0 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:03.659621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb000a7a-3dde-4191-adad-ff4885db7fc0 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:03.737575 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e770-a11f-45e6-9c0b-01751c96461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:03.738338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e770-a11f-45e6-9c0b-01751c96461a admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:03.738543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e770-a11f-45e6-9c0b-01751c96461a admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:03.739567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e770-a11f-45e6-9c0b-01751c96461a admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:03.739694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0e770-a11f-45e6-9c0b-01751c96461a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:03.741599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0e770-a11f-45e6-9c0b-01751c96461a admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:03.771019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1069/2132] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:51:03 2022] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:03.775847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd12d2d-ca1e-4614-abe7-6ed7f1193676 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:03.787167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd12d2d-ca1e-4614-abe7-6ed7f1193676 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:03.794049 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b28ee-81ec-4919-bde2-f22686de459c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:03.794767 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b28ee-81ec-4919-bde2-f22686de459c admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:03.795087 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b28ee-81ec-4919-bde2-f22686de459c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:03.795318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b28ee-81ec-4919-bde2-f22686de459c admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:03.796043 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b28ee-81ec-4919-bde2-f22686de459c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:03.797707 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b28ee-81ec-4919-bde2-f22686de459c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:03.812636 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1064/2133] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:03.818245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e770-a11f-45e6-9c0b-01751c96461a admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:03.830161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e770-a11f-45e6-9c0b-01751c96461a admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:03.835860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8eab3-bdc3-41cc-9a03-42278dd30b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:03.837080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8eab3-bdc3-41cc-9a03-42278dd30b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:03.837712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8eab3-bdc3-41cc-9a03-42278dd30b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:03.837993 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8eab3-bdc3-41cc-9a03-42278dd30b8e admin admin] PATH_INFO: `/v3/projects/0dce39bd6379486a8b5b47b93e97a3c5/users/1530d650daab43159cedff874a97e660/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:03.856348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8eab3-bdc3-41cc-9a03-42278dd30b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dce39bd6379486a8b5b47b93e97a3c5, user_id=1530d650daab43159cedff874a97e660, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:03.859260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8eab3-bdc3-41cc-9a03-42278dd30b8e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:03.879802 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1070/2134] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:51:03 2022] PUT /identity/v3/projects/0dce39bd6379486a8b5b47b93e97a3c5/users/1530d650daab43159cedff874a97e660/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:51:03.884717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b28ee-81ec-4919-bde2-f22686de459c admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:03.896830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b28ee-81ec-4919-bde2-f22686de459c admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:03.903087 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:03.969443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437538f7-21f7-44e1-ae30-818bc4400e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:03.970067 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437538f7-21f7-44e1-ae30-818bc4400e16 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:03.970382 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437538f7-21f7-44e1-ae30-818bc4400e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:03.970654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437538f7-21f7-44e1-ae30-818bc4400e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:03.971432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437538f7-21f7-44e1-ae30-818bc4400e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:03.973038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437538f7-21f7-44e1-ae30-818bc4400e16 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:03.994270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1065/2135] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:51:03.996344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8eab3-bdc3-41cc-9a03-42278dd30b8e admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:04.016211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8eab3-bdc3-41cc-9a03-42278dd30b8e admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:04.025308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809633bd-10d0-4169-9715-08bf1e83fb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:04.026755 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809633bd-10d0-4169-9715-08bf1e83fb1a admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:04.027353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809633bd-10d0-4169-9715-08bf1e83fb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:04.027928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809633bd-10d0-4169-9715-08bf1e83fb1a admin admin] PATH_INFO: `/v3/projects/0dce39bd6379486a8b5b47b93e97a3c5/users/1530d650daab43159cedff874a97e660/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:04.031635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809633bd-10d0-4169-9715-08bf1e83fb1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dce39bd6379486a8b5b47b93e97a3c5, user_id=1530d650daab43159cedff874a97e660, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:04.037393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809633bd-10d0-4169-9715-08bf1e83fb1a admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:04.056459 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1071/2136] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:51:03 2022] PUT /identity/v3/projects/0dce39bd6379486a8b5b47b93e97a3c5/users/1530d650daab43159cedff874a97e660/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:04.068168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa640d-0ca6-408b-8589-b23ba5a1ffa5 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:04.068632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa640d-0ca6-408b-8589-b23ba5a1ffa5 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:04.068723 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa640d-0ca6-408b-8589-b23ba5a1ffa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:04.102336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-bcfa640d-0ca6-408b-8589-b23ba5a1ffa5 None None] MFA Rules not processed for user `1530d650daab43159cedff874a97e660`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:04.104055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-bcfa640d-0ca6-408b-8589-b23ba5a1ffa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:04.188652 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1066/2137] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:51:04.200981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809633bd-10d0-4169-9715-08bf1e83fb1a admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:04.202781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-809633bd-10d0-4169-9715-08bf1e83fb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:04.266052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809633bd-10d0-4169-9715-08bf1e83fb1a admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:04.269829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b646d-43dd-4d6e-961c-28276bcd1ee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:04.270509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b646d-43dd-4d6e-961c-28276bcd1ee9 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:04.270805 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b646d-43dd-4d6e-961c-28276bcd1ee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:04.271111 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b646d-43dd-4d6e-961c-28276bcd1ee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:04.281664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b646d-43dd-4d6e-961c-28276bcd1ee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:04.283200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b646d-43dd-4d6e-961c-28276bcd1ee9 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:04.294332 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1072/2138] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:04.376260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa640d-0ca6-408b-8589-b23ba5a1ffa5 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:04.386142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa640d-0ca6-408b-8589-b23ba5a1ffa5 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:04.393143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb288d-8215-4c0b-b54e-8076ea389569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:04.394240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb288d-8215-4c0b-b54e-8076ea389569 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:04.394662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb288d-8215-4c0b-b54e-8076ea389569 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:04.395003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb288d-8215-4c0b-b54e-8076ea389569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:04.459489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb288d-8215-4c0b-b54e-8076ea389569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:04.460976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb288d-8215-4c0b-b54e-8076ea389569 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:04.471445 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1067/2139] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:04.766879 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b646d-43dd-4d6e-961c-28276bcd1ee9 service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:04.777342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:04.834951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b646d-43dd-4d6e-961c-28276bcd1ee9 service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:04.840114 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8c82a-6392-4e4f-a876-ac15cc69d33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:04.840784 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8c82a-6392-4e4f-a876-ac15cc69d33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:04.841072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8c82a-6392-4e4f-a876-ac15cc69d33a admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:04.841343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8c82a-6392-4e4f-a876-ac15cc69d33a admin admin] PATH_INFO: `/v3/users/29987e33cad646629f825ea662b10728` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:04.842710 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8c82a-6392-4e4f-a876-ac15cc69d33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29987e33cad646629f825ea662b10728)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:04.844735 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8c82a-6392-4e4f-a876-ac15cc69d33a admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:04.907325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c5c8c82a-6392-4e4f-a876-ac15cc69d33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29987e33cad646629f825ea662b10728'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:04.908015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c5c8c82a-6392-4e4f-a876-ac15cc69d33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29987e33cad646629f825ea662b10728'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:04.915958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c5c8c82a-6392-4e4f-a876-ac15cc69d33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29987e33cad646629f825ea662b10728'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:04.924058 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c5c8c82a-6392-4e4f-a876-ac15cc69d33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29987e33cad646629f825ea662b10728'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:04.924774 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c5c8c82a-6392-4e4f-a876-ac15cc69d33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29987e33cad646629f825ea662b10728'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:04.943754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1073/2140] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:51:04 2022] DELETE /identity/v3/users/29987e33cad646629f825ea662b10728 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:04.949021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629c3da-6389-4b23-915c-305e44e4bde1 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:04.949319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629c3da-6389-4b23-915c-305e44e4bde1 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:04.949600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629c3da-6389-4b23-915c-305e44e4bde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:04.970598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-1629c3da-6389-4b23-915c-305e44e4bde1 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:04.971832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1629c3da-6389-4b23-915c-305e44e4bde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:05.016183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:05.060974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1068/2141] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:05.072887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8c82a-6392-4e4f-a876-ac15cc69d33a admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:05.074523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c5c8c82a-6392-4e4f-a876-ac15cc69d33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:05.135762 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8c82a-6392-4e4f-a876-ac15cc69d33a admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:05.140084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ba680-7df2-4d7f-8803-74340622827e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:05.140721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ba680-7df2-4d7f-8803-74340622827e service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:05.141006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ba680-7df2-4d7f-8803-74340622827e service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:05.141286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ba680-7df2-4d7f-8803-74340622827e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:05.152548 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ba680-7df2-4d7f-8803-74340622827e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:05.153924 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ba680-7df2-4d7f-8803-74340622827e service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:05.166129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1074/2142] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:05.461648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629c3da-6389-4b23-915c-305e44e4bde1 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:05.463238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1629c3da-6389-4b23-915c-305e44e4bde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:05.481339 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629c3da-6389-4b23-915c-305e44e4bde1 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:05.486657 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:05.487531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:05.487991 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:05.488425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] PATH_INFO: `/v3/projects/2a73524bf8eb4204bd7011a13ab69c47` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:05.490114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a73524bf8eb4204bd7011a13ab69c47)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:05.493502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:05.550908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a73524bf8eb4204bd7011a13ab69c47', 'request_id': 'req-318d0ee4-221c-44b0-9bee-28276a1fcf32'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:05.558144 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a73524bf8eb4204bd7011a13ab69c47', 'request_id': 'req-318d0ee4-221c-44b0-9bee-28276a1fcf32'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:05.566521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a73524bf8eb4204bd7011a13ab69c47', 'request_id': 'req-318d0ee4-221c-44b0-9bee-28276a1fcf32'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:05.579024 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] The token cache is being invalidate because project 2a73524bf8eb4204bd7011a13ab69c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:51:05.579325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:05.580019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:05.581640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1069/2143] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:51:05 2022] DELETE /identity/v3/projects/2a73524bf8eb4204bd7011a13ab69c47 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:05.585749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ba680-7df2-4d7f-8803-74340622827e service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:05.596766 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ba680-7df2-4d7f-8803-74340622827e service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:05.628360 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:05.660871 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8c842-a388-408b-868a-f8ba2b6f1347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:05.661595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8c842-a388-408b-868a-f8ba2b6f1347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:05.661880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8c842-a388-408b-868a-f8ba2b6f1347 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:05.662161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8c842-a388-408b-868a-f8ba2b6f1347 admin admin] PATH_INFO: `/v3/users/1530d650daab43159cedff874a97e660` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:05.663420 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8c842-a388-408b-868a-f8ba2b6f1347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1530d650daab43159cedff874a97e660)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:05.665425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8c842-a388-408b-868a-f8ba2b6f1347 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:05.715406 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6ef8c842-a388-408b-868a-f8ba2b6f1347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1530d650daab43159cedff874a97e660'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:05.716557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6ef8c842-a388-408b-868a-f8ba2b6f1347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1530d650daab43159cedff874a97e660'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:05.725416 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6ef8c842-a388-408b-868a-f8ba2b6f1347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1530d650daab43159cedff874a97e660'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:05.733583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6ef8c842-a388-408b-868a-f8ba2b6f1347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1530d650daab43159cedff874a97e660'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:05.734331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6ef8c842-a388-408b-868a-f8ba2b6f1347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1530d650daab43159cedff874a97e660'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:05.752822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1075/2144] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:51:05 2022] DELETE /identity/v3/users/1530d650daab43159cedff874a97e660 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:06.109330 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:06.110921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:06.145502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d0ee4-221c-44b0-9bee-28276a1fcf32 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:06.227886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51898df5-3558-4460-9acd-70fe81bd2af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:06.228344 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51898df5-3558-4460-9acd-70fe81bd2af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:06.228623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51898df5-3558-4460-9acd-70fe81bd2af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:06.228899 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51898df5-3558-4460-9acd-70fe81bd2af9 admin admin] PATH_INFO: `/v3/projects/0dce39bd6379486a8b5b47b93e97a3c5` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:06.230094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51898df5-3558-4460-9acd-70fe81bd2af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dce39bd6379486a8b5b47b93e97a3c5)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:06.232090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51898df5-3558-4460-9acd-70fe81bd2af9 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:06.296879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-51898df5-3558-4460-9acd-70fe81bd2af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dce39bd6379486a8b5b47b93e97a3c5', 'request_id': 'req-51898df5-3558-4460-9acd-70fe81bd2af9'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:06.304700 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-51898df5-3558-4460-9acd-70fe81bd2af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dce39bd6379486a8b5b47b93e97a3c5', 'request_id': 'req-51898df5-3558-4460-9acd-70fe81bd2af9'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:06.307365 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:06.320668 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-51898df5-3558-4460-9acd-70fe81bd2af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dce39bd6379486a8b5b47b93e97a3c5', 'request_id': 'req-51898df5-3558-4460-9acd-70fe81bd2af9'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:06.335155 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-51898df5-3558-4460-9acd-70fe81bd2af9 admin admin] The token cache is being invalidate because project 0dce39bd6379486a8b5b47b93e97a3c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:51:06.335444 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-51898df5-3558-4460-9acd-70fe81bd2af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:06.336341 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-51898df5-3558-4460-9acd-70fe81bd2af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:06.339336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1070/2145] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:51:06 2022] DELETE /identity/v3/projects/0dce39bd6379486a8b5b47b93e97a3c5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:06.347028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aeae2-01cf-4b44-8307-13447f1f46e6 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:06.347322 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aeae2-01cf-4b44-8307-13447f1f46e6 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:06.348732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aeae2-01cf-4b44-8307-13447f1f46e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:06.370413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6d3aeae2-01cf-4b44-8307-13447f1f46e6 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:06.371674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6d3aeae2-01cf-4b44-8307-13447f1f46e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:06.494401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1076/2146] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:51:06.500959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617aa48-8c80-4aaf-a80d-68849dacfebe None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:06.502304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617aa48-8c80-4aaf-a80d-68849dacfebe None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:06.502591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617aa48-8c80-4aaf-a80d-68849dacfebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:06.528879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-1617aa48-8c80-4aaf-a80d-68849dacfebe None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:06.530277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1617aa48-8c80-4aaf-a80d-68849dacfebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:06.540317 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1071/2147] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:06.544201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3aeae2-01cf-4b44-8307-13447f1f46e6 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:06.554638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3aeae2-01cf-4b44-8307-13447f1f46e6 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:06.562693 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e749d-c8ab-4099-a5e1-882bca242dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:06.563339 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e749d-c8ab-4099-a5e1-882bca242dcd admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:06.563618 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e749d-c8ab-4099-a5e1-882bca242dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:06.563977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e749d-c8ab-4099-a5e1-882bca242dcd admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:06.564605 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e749d-c8ab-4099-a5e1-882bca242dcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:51:06.564912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e749d-c8ab-4099-a5e1-882bca242dcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:06.568585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e749d-c8ab-4099-a5e1-882bca242dcd admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:06.588443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1077/2148] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:51:06.592907 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617aa48-8c80-4aaf-a80d-68849dacfebe None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:06.603157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617aa48-8c80-4aaf-a80d-68849dacfebe None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:06.608132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956bfb2-b706-4114-9a11-9d02db8673e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:06.608793 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956bfb2-b706-4114-9a11-9d02db8673e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:06.609106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956bfb2-b706-4114-9a11-9d02db8673e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:06.609385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956bfb2-b706-4114-9a11-9d02db8673e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:06.610073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956bfb2-b706-4114-9a11-9d02db8673e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:06.612045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956bfb2-b706-4114-9a11-9d02db8673e0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:06.660242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1072/2149] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:51:06 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:51:06.665352 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e749d-c8ab-4099-a5e1-882bca242dcd admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:06.685665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e749d-c8ab-4099-a5e1-882bca242dcd admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:06.753577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:06.792489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a3c2b-617d-4982-b7a9-2033df6143b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:06.793194 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a3c2b-617d-4982-b7a9-2033df6143b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:06.793480 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a3c2b-617d-4982-b7a9-2033df6143b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:06.793752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a3c2b-617d-4982-b7a9-2033df6143b7 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:06.794457 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a3c2b-617d-4982-b7a9-2033df6143b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:06.796388 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a3c2b-617d-4982-b7a9-2033df6143b7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:06.826761 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1078/2150] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:51:06 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:06.830847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956bfb2-b706-4114-9a11-9d02db8673e0 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:06.846319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956bfb2-b706-4114-9a11-9d02db8673e0 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:06.852972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063d7de-bab7-4c9e-9018-942ec7a8333b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:06.853708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063d7de-bab7-4c9e-9018-942ec7a8333b admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:06.854053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063d7de-bab7-4c9e-9018-942ec7a8333b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:06.854372 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063d7de-bab7-4c9e-9018-942ec7a8333b admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:06.855077 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063d7de-bab7-4c9e-9018-942ec7a8333b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:06.864596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063d7de-bab7-4c9e-9018-942ec7a8333b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:06.900724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1073/2151] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:06.901503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a3c2b-617d-4982-b7a9-2033df6143b7 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:06.904024 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-695a3c2b-617d-4982-b7a9-2033df6143b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:06.906078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063d7de-bab7-4c9e-9018-942ec7a8333b admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:06.924928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a3c2b-617d-4982-b7a9-2033df6143b7 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:06.925148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063d7de-bab7-4c9e-9018-942ec7a8333b admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:06.933162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab34dda-5428-4248-9cbb-7433201ea4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:06.934229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab34dda-5428-4248-9cbb-7433201ea4b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:06.934714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab34dda-5428-4248-9cbb-7433201ea4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:06.935178 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab34dda-5428-4248-9cbb-7433201ea4b9 admin admin] PATH_INFO: `/v3/users/dbae05c70063413cb0382364444ca56f` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:06.937048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab34dda-5428-4248-9cbb-7433201ea4b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbae05c70063413cb0382364444ca56f)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:06.937960 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413916c-2bd7-4da1-b26f-eddfea3a00f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:06.938901 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413916c-2bd7-4da1-b26f-eddfea3a00f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:06.939440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413916c-2bd7-4da1-b26f-eddfea3a00f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:06.939973 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413916c-2bd7-4da1-b26f-eddfea3a00f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:06.941530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab34dda-5428-4248-9cbb-7433201ea4b9 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:06.941666 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413916c-2bd7-4da1-b26f-eddfea3a00f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:06.944768 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413916c-2bd7-4da1-b26f-eddfea3a00f4 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:06.967635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1074/2152] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:06.972205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413916c-2bd7-4da1-b26f-eddfea3a00f4 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:06.994098 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413916c-2bd7-4da1-b26f-eddfea3a00f4 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:07.000976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4c250-aa4e-40fe-b84d-ab840b4774ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:07.002490 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4c250-aa4e-40fe-b84d-ab840b4774ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:07.004408 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4c250-aa4e-40fe-b84d-ab840b4774ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:07.004408 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4c250-aa4e-40fe-b84d-ab840b4774ad admin admin] PATH_INFO: `/v3/projects/8aa9b633224d44568a9dcc42b6de7b54/users/0f1f5fc7efdf4f34ac215520663fa3e9/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:07.030078 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fab34dda-5428-4248-9cbb-7433201ea4b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbae05c70063413cb0382364444ca56f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:07.030974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fab34dda-5428-4248-9cbb-7433201ea4b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbae05c70063413cb0382364444ca56f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:07.031574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4c250-aa4e-40fe-b84d-ab840b4774ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa9b633224d44568a9dcc42b6de7b54, user_id=0f1f5fc7efdf4f34ac215520663fa3e9, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:07.034809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4c250-aa4e-40fe-b84d-ab840b4774ad admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:07.047612 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fab34dda-5428-4248-9cbb-7433201ea4b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbae05c70063413cb0382364444ca56f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:07.058623 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fab34dda-5428-4248-9cbb-7433201ea4b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbae05c70063413cb0382364444ca56f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:07.058940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fab34dda-5428-4248-9cbb-7433201ea4b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbae05c70063413cb0382364444ca56f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:07.063751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1075/2153] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:51:06 2022] PUT /identity/v3/projects/8aa9b633224d44568a9dcc42b6de7b54/users/0f1f5fc7efdf4f34ac215520663fa3e9/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:51:07.075228 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f829f3-3e5c-4b94-b4e3-1df5b9c3032c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:07.075578 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f829f3-3e5c-4b94-b4e3-1df5b9c3032c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:07.075861 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f829f3-3e5c-4b94-b4e3-1df5b9c3032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:07.081691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1079/2154] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:51:06 2022] DELETE /identity/v3/users/dbae05c70063413cb0382364444ca56f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:07.086500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44c6d1-2859-462f-9b81-361c8dbb5d73 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:07.087291 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44c6d1-2859-462f-9b81-361c8dbb5d73 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:07.087602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44c6d1-2859-462f-9b81-361c8dbb5d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:07.108118 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-ef44c6d1-2859-462f-9b81-361c8dbb5d73 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:07.109371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ef44c6d1-2859-462f-9b81-361c8dbb5d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:07.113396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-36f829f3-3e5c-4b94-b4e3-1df5b9c3032c None None] MFA Rules not processed for user `0f1f5fc7efdf4f34ac215520663fa3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:07.115012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-36f829f3-3e5c-4b94-b4e3-1df5b9c3032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:07.182150 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1080/2155] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:51:07.198500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44c6d1-2859-462f-9b81-361c8dbb5d73 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:07.199992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ef44c6d1-2859-462f-9b81-361c8dbb5d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:07.207011 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1076/2156] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:07.216656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f829f3-3e5c-4b94-b4e3-1df5b9c3032c None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:07.217991 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-36f829f3-3e5c-4b94-b4e3-1df5b9c3032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:07.268331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:07.286748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f829f3-3e5c-4b94-b4e3-1df5b9c3032c None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:07.290457 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44c6d1-2859-462f-9b81-361c8dbb5d73 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:07.292303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ac238-1fbb-4a0f-bdf2-a09bdb2b0882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:07.293415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ac238-1fbb-4a0f-bdf2-a09bdb2b0882 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:07.294015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ac238-1fbb-4a0f-bdf2-a09bdb2b0882 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:07.294305 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899d2e8-172f-49eb-812f-883acf97db73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:07.294775 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ac238-1fbb-4a0f-bdf2-a09bdb2b0882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:07.294943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899d2e8-172f-49eb-812f-883acf97db73 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:07.295252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899d2e8-172f-49eb-812f-883acf97db73 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:07.295667 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899d2e8-172f-49eb-812f-883acf97db73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:07.306862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ac238-1fbb-4a0f-bdf2-a09bdb2b0882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:07.308361 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899d2e8-172f-49eb-812f-883acf97db73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:07.308925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ac238-1fbb-4a0f-bdf2-a09bdb2b0882 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:07.309813 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899d2e8-172f-49eb-812f-883acf97db73 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:07.315431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:07.321370 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1077/2157] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:51:07.325060 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1081/2158] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:07.711187 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ac238-1fbb-4a0f-bdf2-a09bdb2b0882 service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:07.713604 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-700ac238-1fbb-4a0f-bdf2-a09bdb2b0882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:07.769710 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ac238-1fbb-4a0f-bdf2-a09bdb2b0882 service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:07.782577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:07.783247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:07.783615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:07.783897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] PATH_INFO: `/v3/projects/ee1739e73bc348a58e756679a5d13839` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:07.787756 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee1739e73bc348a58e756679a5d13839)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:07.788642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:07.906631 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee1739e73bc348a58e756679a5d13839', 'request_id': 'req-560aebf4-c12e-4912-8035-b2911c91e882'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:07.915986 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee1739e73bc348a58e756679a5d13839', 'request_id': 'req-560aebf4-c12e-4912-8035-b2911c91e882'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:07.928455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee1739e73bc348a58e756679a5d13839', 'request_id': 'req-560aebf4-c12e-4912-8035-b2911c91e882'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:07.942470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] The token cache is being invalidate because project ee1739e73bc348a58e756679a5d13839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:51:07.942881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:07.943652 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:07.946469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1078/2159] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:51:07 2022] DELETE /identity/v3/projects/ee1739e73bc348a58e756679a5d13839 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:07.950722 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899d2e8-172f-49eb-812f-883acf97db73 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:07.961244 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899d2e8-172f-49eb-812f-883acf97db73 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:08.034505 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab35e3d-064e-40fc-a633-266c5e74a5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:08.035287 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab35e3d-064e-40fc-a633-266c5e74a5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:08.035637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab35e3d-064e-40fc-a633-266c5e74a5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:08.035988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab35e3d-064e-40fc-a633-266c5e74a5fc admin admin] PATH_INFO: `/v3/users/b2173cea839348c4a9bfa2819f72232d` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:08.037265 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab35e3d-064e-40fc-a633-266c5e74a5fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2173cea839348c4a9bfa2819f72232d)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:08.039334 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab35e3d-064e-40fc-a633-266c5e74a5fc admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:08.103660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-0ab35e3d-064e-40fc-a633-266c5e74a5fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2173cea839348c4a9bfa2819f72232d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:08.104378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-0ab35e3d-064e-40fc-a633-266c5e74a5fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2173cea839348c4a9bfa2819f72232d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:08.115482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-0ab35e3d-064e-40fc-a633-266c5e74a5fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2173cea839348c4a9bfa2819f72232d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:08.124355 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-0ab35e3d-064e-40fc-a633-266c5e74a5fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2173cea839348c4a9bfa2819f72232d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:08.125073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-0ab35e3d-064e-40fc-a633-266c5e74a5fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2173cea839348c4a9bfa2819f72232d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:08.144260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1082/2160] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:51:07 2022] DELETE /identity/v3/users/b2173cea839348c4a9bfa2819f72232d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:08.474912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:08.476832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:08.496601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560aebf4-c12e-4912-8035-b2911c91e882 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:08.576097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccace7c1-d343-4069-9bdc-32e0fb1c7927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:08.577113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccace7c1-d343-4069-9bdc-32e0fb1c7927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:08.577620 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccace7c1-d343-4069-9bdc-32e0fb1c7927 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:08.578116 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccace7c1-d343-4069-9bdc-32e0fb1c7927 admin admin] PATH_INFO: `/v3/projects/72f74199df4841f5ba118919b517c744` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:08.580005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccace7c1-d343-4069-9bdc-32e0fb1c7927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72f74199df4841f5ba118919b517c744)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:08.582279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccace7c1-d343-4069-9bdc-32e0fb1c7927 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:08.637831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ccace7c1-d343-4069-9bdc-32e0fb1c7927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72f74199df4841f5ba118919b517c744', 'request_id': 'req-ccace7c1-d343-4069-9bdc-32e0fb1c7927'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:08.644667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ccace7c1-d343-4069-9bdc-32e0fb1c7927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72f74199df4841f5ba118919b517c744', 'request_id': 'req-ccace7c1-d343-4069-9bdc-32e0fb1c7927'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:08.654061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ccace7c1-d343-4069-9bdc-32e0fb1c7927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72f74199df4841f5ba118919b517c744', 'request_id': 'req-ccace7c1-d343-4069-9bdc-32e0fb1c7927'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:08.667516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ccace7c1-d343-4069-9bdc-32e0fb1c7927 admin admin] The token cache is being invalidate because project 72f74199df4841f5ba118919b517c744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:51:08.667809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ccace7c1-d343-4069-9bdc-32e0fb1c7927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:08.668485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ccace7c1-d343-4069-9bdc-32e0fb1c7927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:08.670051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1079/2161] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:51:08 2022] DELETE /identity/v3/projects/72f74199df4841f5ba118919b517c744 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:51:08.675929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047f11a-8738-48a0-8bbc-e57b49b03f44 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:08.676291 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047f11a-8738-48a0-8bbc-e57b49b03f44 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:08.676598 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047f11a-8738-48a0-8bbc-e57b49b03f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:08.698759 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-f047f11a-8738-48a0-8bbc-e57b49b03f44 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:08.699985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f047f11a-8738-48a0-8bbc-e57b49b03f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:08.761275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1083/2162] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:08.771047 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e616c4-734f-420d-9ae8-126e4f9372c8 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:08.771572 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e616c4-734f-420d-9ae8-126e4f9372c8 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:08.771572 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e616c4-734f-420d-9ae8-126e4f9372c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:08.794308 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-04e616c4-734f-420d-9ae8-126e4f9372c8 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:08.795699 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-04e616c4-734f-420d-9ae8-126e4f9372c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:08.814688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1080/2163] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:08.819044 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047f11a-8738-48a0-8bbc-e57b49b03f44 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:08.824726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:08.833698 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047f11a-8738-48a0-8bbc-e57b49b03f44 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:08.856592 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b19a17-6e24-44ce-844c-3e21795f1bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:08.857251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b19a17-6e24-44ce-844c-3e21795f1bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:08.857617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b19a17-6e24-44ce-844c-3e21795f1bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:08.857902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b19a17-6e24-44ce-844c-3e21795f1bd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:08.858677 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b19a17-6e24-44ce-844c-3e21795f1bd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:51:08.858991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b19a17-6e24-44ce-844c-3e21795f1bd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:08.860652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b19a17-6e24-44ce-844c-3e21795f1bd1 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:08.893507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1084/2164] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:51:08.896169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e616c4-734f-420d-9ae8-126e4f9372c8 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:08.932279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e616c4-734f-420d-9ae8-126e4f9372c8 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:08.932503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89230a1-b0ef-476e-8471-7f58f3ced718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:08.933199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89230a1-b0ef-476e-8471-7f58f3ced718 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:08.933486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89230a1-b0ef-476e-8471-7f58f3ced718 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:08.933762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89230a1-b0ef-476e-8471-7f58f3ced718 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:08.934564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89230a1-b0ef-476e-8471-7f58f3ced718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:08.936488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89230a1-b0ef-476e-8471-7f58f3ced718 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:08.941831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:08.991814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1081/2165] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:51:08 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:08.997470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b19a17-6e24-44ce-844c-3e21795f1bd1 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:09.013086 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b19a17-6e24-44ce-844c-3e21795f1bd1 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:09.114770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2117683-bc7f-4eb7-84c5-b105148e9044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:09.115204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2117683-bc7f-4eb7-84c5-b105148e9044 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:09.115394 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2117683-bc7f-4eb7-84c5-b105148e9044 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:09.115743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2117683-bc7f-4eb7-84c5-b105148e9044 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:09.117284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2117683-bc7f-4eb7-84c5-b105148e9044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:09.119068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2117683-bc7f-4eb7-84c5-b105148e9044 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:09.143042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1085/2166] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:51:08 2022] POST /identity/v3/users => generated 284 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:09.147326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89230a1-b0ef-476e-8471-7f58f3ced718 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:09.161903 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89230a1-b0ef-476e-8471-7f58f3ced718 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:09.193468 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d9c22-71c1-4d78-977c-5b66a8aef2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:09.193468 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d9c22-71c1-4d78-977c-5b66a8aef2eb admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:09.193819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d9c22-71c1-4d78-977c-5b66a8aef2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:09.194272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d9c22-71c1-4d78-977c-5b66a8aef2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:09.195248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d9c22-71c1-4d78-977c-5b66a8aef2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:09.200321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d9c22-71c1-4d78-977c-5b66a8aef2eb admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:09.227338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1082/2167] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:09.231706 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2117683-bc7f-4eb7-84c5-b105148e9044 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:09.244175 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2117683-bc7f-4eb7-84c5-b105148e9044 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:09.251035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a25cf-b8d8-4040-9a10-68d5db9c73fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:09.251827 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a25cf-b8d8-4040-9a10-68d5db9c73fa admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:09.252122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a25cf-b8d8-4040-9a10-68d5db9c73fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:09.252394 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a25cf-b8d8-4040-9a10-68d5db9c73fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:09.253104 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a25cf-b8d8-4040-9a10-68d5db9c73fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:09.255399 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a25cf-b8d8-4040-9a10-68d5db9c73fa admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:09.277726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1086/2168] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:51:09.279257 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d9c22-71c1-4d78-977c-5b66a8aef2eb admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:09.294252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d9c22-71c1-4d78-977c-5b66a8aef2eb admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:09.296012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf72c9-d659-45fd-b922-497f2b5d8d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:09.296735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf72c9-d659-45fd-b922-497f2b5d8d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:09.297021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf72c9-d659-45fd-b922-497f2b5d8d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:09.297295 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf72c9-d659-45fd-b922-497f2b5d8d21 admin admin] PATH_INFO: `/v3/projects/29ff41fb924a473c9861a74ad0cb995f/users/56220d6f900345baa88a3d10f108d780/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:09.315625 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf72c9-d659-45fd-b922-497f2b5d8d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ff41fb924a473c9861a74ad0cb995f, user_id=56220d6f900345baa88a3d10f108d780, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:09.318368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf72c9-d659-45fd-b922-497f2b5d8d21 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:09.342443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1083/2169] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:51:09 2022] PUT /identity/v3/projects/29ff41fb924a473c9861a74ad0cb995f/users/56220d6f900345baa88a3d10f108d780/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:09.354825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db046e-de32-46fe-9344-1807c30d437e None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:09.355115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db046e-de32-46fe-9344-1807c30d437e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:09.355397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db046e-de32-46fe-9344-1807c30d437e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:09.386408 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-60db046e-de32-46fe-9344-1807c30d437e None None] MFA Rules not processed for user `56220d6f900345baa88a3d10f108d780`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:09.387642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-60db046e-de32-46fe-9344-1807c30d437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:09.462136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1087/2170] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:51:09.473955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf72c9-d659-45fd-b922-497f2b5d8d21 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:09.475746 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-bbbf72c9-d659-45fd-b922-497f2b5d8d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:09.573508 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf72c9-d659-45fd-b922-497f2b5d8d21 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:09.579484 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bc643-8a5c-46b8-976f-7e339e9d74f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4e81eb81934784b8632248ecf0894f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:09.580510 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bc643-8a5c-46b8-976f-7e339e9d74f1 service glance] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:09.580981 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bc643-8a5c-46b8-976f-7e339e9d74f1 service glance] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:09.581469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bc643-8a5c-46b8-976f-7e339e9d74f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:09.597095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bc643-8a5c-46b8-976f-7e339e9d74f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:09.599761 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bc643-8a5c-46b8-976f-7e339e9d74f1 service glance] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:09.613489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1084/2171] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:15.831661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e33c4-941e-42b5-9141-c5267b67764f None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:15.832248 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e33c4-941e-42b5-9141-c5267b67764f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:15.832248 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e33c4-941e-42b5-9141-c5267b67764f None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:15.833882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1088/2172] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jul 27 10:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 10:51:15.864741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c4c8-0c2e-41ca-b81d-82c975e494c9 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:15.865923 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c4c8-0c2e-41ca-b81d-82c975e494c9 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:15.866343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c4c8-0c2e-41ca-b81d-82c975e494c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:15.890398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-de66c4c8-0c2e-41ca-b81d-82c975e494c9 None None] MFA Rules not processed for user `39830a354dee41b5b210d80807886299`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:15.891844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-de66c4c8-0c2e-41ca-b81d-82c975e494c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:15.961450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e33c4-941e-42b5-9141-c5267b67764f None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:15.964545 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ed3e33c4-941e-42b5-9141-c5267b67764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:15.989584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1085/2173] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jul 27 10:51:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:16.016016 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66c4c8-0c2e-41ca-b81d-82c975e494c9 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:16.017577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-de66c4c8-0c2e-41ca-b81d-82c975e494c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:16.030938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66c4c8-0c2e-41ca-b81d-82c975e494c9 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:16.037543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dea62-0f71-4023-aa0e-b064c528452c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:16.038664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dea62-0f71-4023-aa0e-b064c528452c service placement] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:16.039135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dea62-0f71-4023-aa0e-b064c528452c service placement] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:16.039600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dea62-0f71-4023-aa0e-b064c528452c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:16.046264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:16.050866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dea62-0f71-4023-aa0e-b064c528452c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:16.052204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e33c4-941e-42b5-9141-c5267b67764f None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:16.052528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dea62-0f71-4023-aa0e-b064c528452c service placement] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:16.058879 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00261bfb-02d2-4be5-acac-6509f80ecfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:16.059528 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00261bfb-02d2-4be5-acac-6509f80ecfdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:16.059809 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00261bfb-02d2-4be5-acac-6509f80ecfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:16.060081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00261bfb-02d2-4be5-acac-6509f80ecfdd admin admin] PATH_INFO: `/v3/users/5797a18d030644c29a946de8a7602d37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:16.061255 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00261bfb-02d2-4be5-acac-6509f80ecfdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5797a18d030644c29a946de8a7602d37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:16.063192 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00261bfb-02d2-4be5-acac-6509f80ecfdd admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:16.064875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1086/2174] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:51:16.119771 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-00261bfb-02d2-4be5-acac-6509f80ecfdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5797a18d030644c29a946de8a7602d37'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:16.120720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-00261bfb-02d2-4be5-acac-6509f80ecfdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5797a18d030644c29a946de8a7602d37'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:16.128900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-00261bfb-02d2-4be5-acac-6509f80ecfdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5797a18d030644c29a946de8a7602d37'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:16.137354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-00261bfb-02d2-4be5-acac-6509f80ecfdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5797a18d030644c29a946de8a7602d37'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:16.138134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-00261bfb-02d2-4be5-acac-6509f80ecfdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5797a18d030644c29a946de8a7602d37'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:16.158730 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1089/2175] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:51:15 2022] DELETE /identity/v3/users/5797a18d030644c29a946de8a7602d37 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:51:16.366130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dea62-0f71-4023-aa0e-b064c528452c service placement] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:16.379602 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dea62-0f71-4023-aa0e-b064c528452c service placement] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:16.394872 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:16.449610 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92043-b3d0-4ee2-b412-944f181a0503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:16.450322 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92043-b3d0-4ee2-b412-944f181a0503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:16.450611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92043-b3d0-4ee2-b412-944f181a0503 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:16.450922 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92043-b3d0-4ee2-b412-944f181a0503 admin admin] PATH_INFO: `/v3/projects/a69aab1543094ede91409a577afee072` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:16.452101 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b92043-b3d0-4ee2-b412-944f181a0503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69aab1543094ede91409a577afee072)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:16.454023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b92043-b3d0-4ee2-b412-944f181a0503 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:16.521855 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-44b92043-b3d0-4ee2-b412-944f181a0503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69aab1543094ede91409a577afee072', 'request_id': 'req-44b92043-b3d0-4ee2-b412-944f181a0503'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:16.531262 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-44b92043-b3d0-4ee2-b412-944f181a0503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69aab1543094ede91409a577afee072', 'request_id': 'req-44b92043-b3d0-4ee2-b412-944f181a0503'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:16.539505 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-44b92043-b3d0-4ee2-b412-944f181a0503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69aab1543094ede91409a577afee072', 'request_id': 'req-44b92043-b3d0-4ee2-b412-944f181a0503'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:16.553714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-44b92043-b3d0-4ee2-b412-944f181a0503 admin admin] The token cache is being invalidate because project a69aab1543094ede91409a577afee072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:51:16.554079 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-44b92043-b3d0-4ee2-b412-944f181a0503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:16.555136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-44b92043-b3d0-4ee2-b412-944f181a0503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:16.557752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1087/2176] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:51:16 2022] DELETE /identity/v3/projects/a69aab1543094ede91409a577afee072 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:16.563079 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb989-6130-44b8-ac17-7b6319fafaea None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:16.563378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb989-6130-44b8-ac17-7b6319fafaea None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:16.563661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb989-6130-44b8-ac17-7b6319fafaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:16.584808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-8d9cb989-6130-44b8-ac17-7b6319fafaea None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:16.586139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8d9cb989-6130-44b8-ac17-7b6319fafaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:16.685182 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1090/2177] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:16.693142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b7fef-d746-431d-aaab-18855f2cc4af None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:16.693437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b7fef-d746-431d-aaab-18855f2cc4af None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:16.693746 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b7fef-d746-431d-aaab-18855f2cc4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:16.716804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-ea9b7fef-d746-431d-aaab-18855f2cc4af None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:16.718031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ea9b7fef-d746-431d-aaab-18855f2cc4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:16.726357 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1088/2178] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:16.731562 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb989-6130-44b8-ac17-7b6319fafaea None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:16.742151 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb989-6130-44b8-ac17-7b6319fafaea None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:16.750057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459af78-25dc-4873-b0e6-73077acbf786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:16.750770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459af78-25dc-4873-b0e6-73077acbf786 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:16.751064 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459af78-25dc-4873-b0e6-73077acbf786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:16.751338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459af78-25dc-4873-b0e6-73077acbf786 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:16.752070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459af78-25dc-4873-b0e6-73077acbf786 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:51:16.752378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459af78-25dc-4873-b0e6-73077acbf786 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:16.754159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459af78-25dc-4873-b0e6-73077acbf786 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:16.768123 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1091/2179] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:51:16.772855 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b7fef-d746-431d-aaab-18855f2cc4af None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:16.784052 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b7fef-d746-431d-aaab-18855f2cc4af None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:16.788881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742666f5-e4df-4719-a34d-9d5216733f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:16.789510 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742666f5-e4df-4719-a34d-9d5216733f7b admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:16.790441 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742666f5-e4df-4719-a34d-9d5216733f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:16.790716 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742666f5-e4df-4719-a34d-9d5216733f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:16.791482 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742666f5-e4df-4719-a34d-9d5216733f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:16.793380 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742666f5-e4df-4719-a34d-9d5216733f7b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:16.822735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1089/2180] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:51:16 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:16.827188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459af78-25dc-4873-b0e6-73077acbf786 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:16.837942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459af78-25dc-4873-b0e6-73077acbf786 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:16.898489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db5b78-f80a-4a99-a766-c810d5eb171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:16.899214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db5b78-f80a-4a99-a766-c810d5eb171e admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:16.899502 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db5b78-f80a-4a99-a766-c810d5eb171e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:16.899965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db5b78-f80a-4a99-a766-c810d5eb171e admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:16.900679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db5b78-f80a-4a99-a766-c810d5eb171e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:16.902834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db5b78-f80a-4a99-a766-c810d5eb171e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:16.913234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:16.927290 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1092/2181] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:51:16 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:16.931997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742666f5-e4df-4719-a34d-9d5216733f7b admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:16.942666 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742666f5-e4df-4719-a34d-9d5216733f7b admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:16.947523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cdab0-6e08-427b-abfe-aff836d6c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:16.948150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cdab0-6e08-427b-abfe-aff836d6c67a admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:16.948432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cdab0-6e08-427b-abfe-aff836d6c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:16.948707 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cdab0-6e08-427b-abfe-aff836d6c67a admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:16.949409 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cdab0-6e08-427b-abfe-aff836d6c67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:16.951055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1cdab0-6e08-427b-abfe-aff836d6c67a admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:16.961382 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1090/2182] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:51:16.966063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db5b78-f80a-4a99-a766-c810d5eb171e admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:16.979755 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db5b78-f80a-4a99-a766-c810d5eb171e admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:16.993602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08f6f2-c474-4f21-aad4-ea8289ef5762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:16.994372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08f6f2-c474-4f21-aad4-ea8289ef5762 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:16.994683 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08f6f2-c474-4f21-aad4-ea8289ef5762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:16.994962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08f6f2-c474-4f21-aad4-ea8289ef5762 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:16.995689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08f6f2-c474-4f21-aad4-ea8289ef5762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:16.997348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08f6f2-c474-4f21-aad4-ea8289ef5762 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:17.010282 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1093/2183] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:17.015239 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cdab0-6e08-427b-abfe-aff836d6c67a admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:17.026582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cdab0-6e08-427b-abfe-aff836d6c67a admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:17.031598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b1a92-117e-42f9-9929-4e0f4403ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:17.032103 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b1a92-117e-42f9-9929-4e0f4403ca17 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:17.032391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b1a92-117e-42f9-9929-4e0f4403ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:17.032679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b1a92-117e-42f9-9929-4e0f4403ca17 admin admin] PATH_INFO: `/v3/projects/3d065529e89a4cdab42a40ebfb97e9fc/users/f128f075372346209c6b641d7de27ceb/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:17.050092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b1a92-117e-42f9-9929-4e0f4403ca17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d065529e89a4cdab42a40ebfb97e9fc, user_id=f128f075372346209c6b641d7de27ceb, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:17.053675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b1a92-117e-42f9-9929-4e0f4403ca17 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:17.072390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1091/2184] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:51:17 2022] PUT /identity/v3/projects/3d065529e89a4cdab42a40ebfb97e9fc/users/f128f075372346209c6b641d7de27ceb/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:51:17.083488 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b64cd-c063-4505-99d1-1487dce12d1f None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:17.083899 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b64cd-c063-4505-99d1-1487dce12d1f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:17.084183 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b64cd-c063-4505-99d1-1487dce12d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:17.119187 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-d98b64cd-c063-4505-99d1-1487dce12d1f None None] MFA Rules not processed for user `f128f075372346209c6b641d7de27ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:17.120449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-d98b64cd-c063-4505-99d1-1487dce12d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:17.210752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1094/2185] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:17.223690 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b1a92-117e-42f9-9929-4e0f4403ca17 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:17.225800 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-9c0b1a92-117e-42f9-9929-4e0f4403ca17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:17.277013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:17.292661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b1a92-117e-42f9-9929-4e0f4403ca17 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:17.296720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63096402-ef5a-4b60-894a-fa3c84d1dbb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:17.297349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096402-ef5a-4b60-894a-fa3c84d1dbb7 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:17.298751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096402-ef5a-4b60-894a-fa3c84d1dbb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:17.298751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096402-ef5a-4b60-894a-fa3c84d1dbb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:17.307699 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63096402-ef5a-4b60-894a-fa3c84d1dbb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:17.309160 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63096402-ef5a-4b60-894a-fa3c84d1dbb7 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:17.318259 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1092/2186] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:23.845824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b64cd-c063-4505-99d1-1487dce12d1f None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:23.847311 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-d98b64cd-c063-4505-99d1-1487dce12d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:23.942810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b64cd-c063-4505-99d1-1487dce12d1f None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:23.948429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35bc27-37ba-4f70-b5b6-2ce6ecd7aa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:23.949093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35bc27-37ba-4f70-b5b6-2ce6ecd7aa12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:23.949381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35bc27-37ba-4f70-b5b6-2ce6ecd7aa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:23.949657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35bc27-37ba-4f70-b5b6-2ce6ecd7aa12 admin admin] PATH_INFO: `/v3/users/0f1f5fc7efdf4f34ac215520663fa3e9` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:23.950946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35bc27-37ba-4f70-b5b6-2ce6ecd7aa12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f1f5fc7efdf4f34ac215520663fa3e9)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:23.952898 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35bc27-37ba-4f70-b5b6-2ce6ecd7aa12 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:24.012353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3e35bc27-37ba-4f70-b5b6-2ce6ecd7aa12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f1f5fc7efdf4f34ac215520663fa3e9'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:24.013035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3e35bc27-37ba-4f70-b5b6-2ce6ecd7aa12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f1f5fc7efdf4f34ac215520663fa3e9'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:24.022231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3e35bc27-37ba-4f70-b5b6-2ce6ecd7aa12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f1f5fc7efdf4f34ac215520663fa3e9'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:24.030307 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3e35bc27-37ba-4f70-b5b6-2ce6ecd7aa12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f1f5fc7efdf4f34ac215520663fa3e9'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:24.031019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3e35bc27-37ba-4f70-b5b6-2ce6ecd7aa12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f1f5fc7efdf4f34ac215520663fa3e9'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:24.040071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:24.052774 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1095/2187] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:51:23 2022] DELETE /identity/v3/users/0f1f5fc7efdf4f34ac215520663fa3e9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:24.058319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d3aac-8246-4ee1-9947-063088629fbd None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:24.058874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d3aac-8246-4ee1-9947-063088629fbd None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:24.058976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d3aac-8246-4ee1-9947-063088629fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:24.079471 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-257d3aac-8246-4ee1-9947-063088629fbd None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:24.080709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-257d3aac-8246-4ee1-9947-063088629fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:24.147173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1093/2188] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:24.157861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35bc27-37ba-4f70-b5b6-2ce6ecd7aa12 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:24.158946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3e35bc27-37ba-4f70-b5b6-2ce6ecd7aa12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:24.228875 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35bc27-37ba-4f70-b5b6-2ce6ecd7aa12 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:24.232824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2330b5b-2177-4b17-9595-fd100bdba1b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:24.233446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2330b5b-2177-4b17-9595-fd100bdba1b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:24.233726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2330b5b-2177-4b17-9595-fd100bdba1b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:24.233999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2330b5b-2177-4b17-9595-fd100bdba1b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:24.244992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2330b5b-2177-4b17-9595-fd100bdba1b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:24.246664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2330b5b-2177-4b17-9595-fd100bdba1b7 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:24.257465 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1096/2189] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:24.608985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d3aac-8246-4ee1-9947-063088629fbd None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:24.614386 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-257d3aac-8246-4ee1-9947-063088629fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:24.626080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d3aac-8246-4ee1-9947-063088629fbd None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:24.632243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae0134-f886-4c8c-8172-9bf45bbec3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:24.635525 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0134-f886-4c8c-8172-9bf45bbec3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:24.635525 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0134-f886-4c8c-8172-9bf45bbec3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:24.635525 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0134-f886-4c8c-8172-9bf45bbec3f8 admin admin] PATH_INFO: `/v3/projects/8aa9b633224d44568a9dcc42b6de7b54` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:24.635525 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae0134-f886-4c8c-8172-9bf45bbec3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa9b633224d44568a9dcc42b6de7b54)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:24.637507 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae0134-f886-4c8c-8172-9bf45bbec3f8 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:24.697743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-23ae0134-f886-4c8c-8172-9bf45bbec3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa9b633224d44568a9dcc42b6de7b54', 'request_id': 'req-23ae0134-f886-4c8c-8172-9bf45bbec3f8'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:24.704710 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-23ae0134-f886-4c8c-8172-9bf45bbec3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa9b633224d44568a9dcc42b6de7b54', 'request_id': 'req-23ae0134-f886-4c8c-8172-9bf45bbec3f8'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:24.714407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-23ae0134-f886-4c8c-8172-9bf45bbec3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa9b633224d44568a9dcc42b6de7b54', 'request_id': 'req-23ae0134-f886-4c8c-8172-9bf45bbec3f8'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:24.733582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-23ae0134-f886-4c8c-8172-9bf45bbec3f8 admin admin] The token cache is being invalidate because project 8aa9b633224d44568a9dcc42b6de7b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:51:24.734311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-23ae0134-f886-4c8c-8172-9bf45bbec3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:24.735255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-23ae0134-f886-4c8c-8172-9bf45bbec3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:24.736930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1094/2190] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:51:24 2022] DELETE /identity/v3/projects/8aa9b633224d44568a9dcc42b6de7b54 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:24.744728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309257c-725f-4052-bdbb-6d0f382b11e5 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:24.744728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309257c-725f-4052-bdbb-6d0f382b11e5 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:24.744728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309257c-725f-4052-bdbb-6d0f382b11e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:24.767172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-9309257c-725f-4052-bdbb-6d0f382b11e5 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:24.768399 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9309257c-725f-4052-bdbb-6d0f382b11e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:24.835678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1097/2191] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:24.845209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c3868-d8db-462c-84b8-fb594a69f5f5 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:24.845492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c3868-d8db-462c-84b8-fb594a69f5f5 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:24.845765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c3868-d8db-462c-84b8-fb594a69f5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:24.866348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-fd3c3868-d8db-462c-84b8-fb594a69f5f5 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:24.868299 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-fd3c3868-d8db-462c-84b8-fb594a69f5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:24.877055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1095/2192] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:24.881479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309257c-725f-4052-bdbb-6d0f382b11e5 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:24.894812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309257c-725f-4052-bdbb-6d0f382b11e5 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:24.900722 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f79fb-bf50-4fea-84fb-2acf928f8c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:24.901394 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f79fb-bf50-4fea-84fb-2acf928f8c5c admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:24.901678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f79fb-bf50-4fea-84fb-2acf928f8c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:24.901954 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f79fb-bf50-4fea-84fb-2acf928f8c5c admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:24.902710 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f79fb-bf50-4fea-84fb-2acf928f8c5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:51:24.903059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f79fb-bf50-4fea-84fb-2acf928f8c5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:24.904698 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f79fb-bf50-4fea-84fb-2acf928f8c5c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:24.921695 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1098/2193] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:51:24.923665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c3868-d8db-462c-84b8-fb594a69f5f5 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:24.935970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c3868-d8db-462c-84b8-fb594a69f5f5 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:24.940827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8e68f-6989-4f0d-bbf1-35b7a826c3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:24.941454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8e68f-6989-4f0d-bbf1-35b7a826c3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:24.941743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8e68f-6989-4f0d-bbf1-35b7a826c3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:24.942085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8e68f-6989-4f0d-bbf1-35b7a826c3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:24.942801 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8e68f-6989-4f0d-bbf1-35b7a826c3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:24.944723 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8e68f-6989-4f0d-bbf1-35b7a826c3e7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:24.982798 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1096/2194] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:51:24 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:24.984238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f79fb-bf50-4fea-84fb-2acf928f8c5c admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:24.997657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f79fb-bf50-4fea-84fb-2acf928f8c5c admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:25.070903 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991336e-35f0-449c-abcc-35d0f9f74b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:25.071541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991336e-35f0-449c-abcc-35d0f9f74b63 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:25.071827 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991336e-35f0-449c-abcc-35d0f9f74b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:25.072105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991336e-35f0-449c-abcc-35d0f9f74b63 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:25.072813 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991336e-35f0-449c-abcc-35d0f9f74b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:25.074904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991336e-35f0-449c-abcc-35d0f9f74b63 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:25.099375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1099/2195] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:51:24 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:25.104110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8e68f-6989-4f0d-bbf1-35b7a826c3e7 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:25.115179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8e68f-6989-4f0d-bbf1-35b7a826c3e7 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:25.122281 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3052239-073e-44a6-997d-150aeb679064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:25.122281 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3052239-073e-44a6-997d-150aeb679064 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:25.122281 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3052239-073e-44a6-997d-150aeb679064 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:25.122281 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3052239-073e-44a6-997d-150aeb679064 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:25.122724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3052239-073e-44a6-997d-150aeb679064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:25.124199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3052239-073e-44a6-997d-150aeb679064 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:25.135832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1097/2196] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:25.139955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991336e-35f0-449c-abcc-35d0f9f74b63 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:25.150741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991336e-35f0-449c-abcc-35d0f9f74b63 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:25.155745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4149c-f0fb-42bf-ad84-810d25c6b112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:25.156372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4149c-f0fb-42bf-ad84-810d25c6b112 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:25.156674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4149c-f0fb-42bf-ad84-810d25c6b112 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:25.156932 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4149c-f0fb-42bf-ad84-810d25c6b112 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:25.157636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4149c-f0fb-42bf-ad84-810d25c6b112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:25.159274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4149c-f0fb-42bf-ad84-810d25c6b112 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:25.167428 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:25.178477 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1100/2197] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:25.180938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3052239-073e-44a6-997d-150aeb679064 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:25.191718 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3052239-073e-44a6-997d-150aeb679064 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:25.196513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3c761-3567-4d2c-aff0-dd70596b575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:25.197197 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3c761-3567-4d2c-aff0-dd70596b575b admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:25.197485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3c761-3567-4d2c-aff0-dd70596b575b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:25.197766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3c761-3567-4d2c-aff0-dd70596b575b admin admin] PATH_INFO: `/v3/projects/63f533e19f0b469585feb1d7ee77db20/users/7580bb98324b491e96934d89d5bdfc63/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:25.213850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3c761-3567-4d2c-aff0-dd70596b575b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f533e19f0b469585feb1d7ee77db20, user_id=7580bb98324b491e96934d89d5bdfc63, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:25.216820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3c761-3567-4d2c-aff0-dd70596b575b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:25.233831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1098/2198] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:51:25 2022] PUT /identity/v3/projects/63f533e19f0b469585feb1d7ee77db20/users/7580bb98324b491e96934d89d5bdfc63/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:51:25.239122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc4e14-3069-4038-a5aa-1bbb7fdb769e None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:25.239409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc4e14-3069-4038-a5aa-1bbb7fdb769e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:25.239695 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc4e14-3069-4038-a5aa-1bbb7fdb769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:25.261475 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-84fc4e14-3069-4038-a5aa-1bbb7fdb769e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:25.262741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-84fc4e14-3069-4038-a5aa-1bbb7fdb769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:25.340143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1101/2199] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:25.350619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3c761-3567-4d2c-aff0-dd70596b575b admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:25.355063 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0ce3c761-3567-4d2c-aff0-dd70596b575b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:25.361547 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:25.438297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3c761-3567-4d2c-aff0-dd70596b575b admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:25.442615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818e4f8-e846-4320-9612-d6d39a38a506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:25.443401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818e4f8-e846-4320-9612-d6d39a38a506 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:25.443703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818e4f8-e846-4320-9612-d6d39a38a506 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:25.443986 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818e4f8-e846-4320-9612-d6d39a38a506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:25.456126 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818e4f8-e846-4320-9612-d6d39a38a506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:25.457617 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818e4f8-e846-4320-9612-d6d39a38a506 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:25.469436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1099/2200] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:51:26.150858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aff087-88bc-45a3-94e9-c8bdfde95d1f None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:26.151529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aff087-88bc-45a3-94e9-c8bdfde95d1f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:26.151529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aff087-88bc-45a3-94e9-c8bdfde95d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:26.182249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-64aff087-88bc-45a3-94e9-c8bdfde95d1f None None] MFA Rules not processed for user `7580bb98324b491e96934d89d5bdfc63`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:26.183568 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-64aff087-88bc-45a3-94e9-c8bdfde95d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:26.260269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1102/2201] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:26.271161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818e4f8-e846-4320-9612-d6d39a38a506 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:26.272738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-9818e4f8-e846-4320-9612-d6d39a38a506 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:26.350885 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818e4f8-e846-4320-9612-d6d39a38a506 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:26.355093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613101a8-ec28-462a-bf23-c98ae4fc0e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:26.355724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613101a8-ec28-462a-bf23-c98ae4fc0e92 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:26.356006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613101a8-ec28-462a-bf23-c98ae4fc0e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:26.356281 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613101a8-ec28-462a-bf23-c98ae4fc0e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:26.365301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613101a8-ec28-462a-bf23-c98ae4fc0e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:26.366778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613101a8-ec28-462a-bf23-c98ae4fc0e92 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:26.376887 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1100/2202] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:27.003327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aff087-88bc-45a3-94e9-c8bdfde95d1f None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:27.005615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-64aff087-88bc-45a3-94e9-c8bdfde95d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:27.021820 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aff087-88bc-45a3-94e9-c8bdfde95d1f None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:27.027586 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67649e21-2a8b-4655-8e1c-2270391ea67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:27.028384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67649e21-2a8b-4655-8e1c-2270391ea67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:27.028549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67649e21-2a8b-4655-8e1c-2270391ea67b admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:27.028822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67649e21-2a8b-4655-8e1c-2270391ea67b admin admin] PATH_INFO: `/v3/users/f128f075372346209c6b641d7de27ceb` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:27.030001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67649e21-2a8b-4655-8e1c-2270391ea67b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f128f075372346209c6b641d7de27ceb)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:27.031950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67649e21-2a8b-4655-8e1c-2270391ea67b admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:27.099982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-67649e21-2a8b-4655-8e1c-2270391ea67b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f128f075372346209c6b641d7de27ceb'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:27.100891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-67649e21-2a8b-4655-8e1c-2270391ea67b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f128f075372346209c6b641d7de27ceb'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:27.116977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-67649e21-2a8b-4655-8e1c-2270391ea67b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f128f075372346209c6b641d7de27ceb'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:27.127451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-67649e21-2a8b-4655-8e1c-2270391ea67b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f128f075372346209c6b641d7de27ceb'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:27.128449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-67649e21-2a8b-4655-8e1c-2270391ea67b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f128f075372346209c6b641d7de27ceb'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:27.150743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1103/2203] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:51:27 2022] DELETE /identity/v3/users/f128f075372346209c6b641d7de27ceb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:27.155403 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a039d6-019a-4ab1-aa49-48bc02bd2462 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:27.155698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a039d6-019a-4ab1-aa49-48bc02bd2462 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:27.156010 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a039d6-019a-4ab1-aa49-48bc02bd2462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:27.177502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-27a039d6-019a-4ab1-aa49-48bc02bd2462 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:27.178790 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-27a039d6-019a-4ab1-aa49-48bc02bd2462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:27.246861 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1101/2204] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:27.256489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67649e21-2a8b-4655-8e1c-2270391ea67b admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:27.257993 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-67649e21-2a8b-4655-8e1c-2270391ea67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:27.264053 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:27.329813 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67649e21-2a8b-4655-8e1c-2270391ea67b admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:27.333831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c041e-f873-4409-9f77-5f8803b9e887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:27.334504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c041e-f873-4409-9f77-5f8803b9e887 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:27.334787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c041e-f873-4409-9f77-5f8803b9e887 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:27.335060 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c041e-f873-4409-9f77-5f8803b9e887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:27.345779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c041e-f873-4409-9f77-5f8803b9e887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:27.347265 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c041e-f873-4409-9f77-5f8803b9e887 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:27.360439 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1104/2205] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:27.698053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a039d6-019a-4ab1-aa49-48bc02bd2462 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:27.699597 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-27a039d6-019a-4ab1-aa49-48bc02bd2462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:27.714847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a039d6-019a-4ab1-aa49-48bc02bd2462 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:27.735383 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:27.736167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:27.736530 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:27.736887 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91 admin admin] PATH_INFO: `/v3/projects/3d065529e89a4cdab42a40ebfb97e9fc` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:27.738941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d065529e89a4cdab42a40ebfb97e9fc)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:27.741374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:27.828317 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:27.832024 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d065529e89a4cdab42a40ebfb97e9fc', 'request_id': 'req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:27.841327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d065529e89a4cdab42a40ebfb97e9fc', 'request_id': 'req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:27.854432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d065529e89a4cdab42a40ebfb97e9fc', 'request_id': 'req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:27.876946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91 admin admin] The token cache is being invalidate because project 3d065529e89a4cdab42a40ebfb97e9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:51:27.877286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:27.878037 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9cd64a8b-9ba2-4034-83a1-5147e00cfd91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:27.880097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1102/2206] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:51:27 2022] DELETE /identity/v3/projects/3d065529e89a4cdab42a40ebfb97e9fc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:27.886207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2f8e5-594a-447f-b3e5-394477fb221e None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:27.886559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2f8e5-594a-447f-b3e5-394477fb221e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:27.886773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2f8e5-594a-447f-b3e5-394477fb221e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:27.908609 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-e1e2f8e5-594a-447f-b3e5-394477fb221e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:27.909874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-e1e2f8e5-594a-447f-b3e5-394477fb221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:28.009064 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1105/2207] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:28.012406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804eae7-c0d3-4c1e-9c7d-e2529bd87bb3 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:28.012690 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804eae7-c0d3-4c1e-9c7d-e2529bd87bb3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:28.012965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804eae7-c0d3-4c1e-9c7d-e2529bd87bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:28.047919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-d804eae7-c0d3-4c1e-9c7d-e2529bd87bb3 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:28.047919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d804eae7-c0d3-4c1e-9c7d-e2529bd87bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:28.060730 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1103/2208] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:28.068207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2f8e5-594a-447f-b3e5-394477fb221e None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:28.083003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2f8e5-594a-447f-b3e5-394477fb221e None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:28.089698 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2efd5e-f7ef-44b2-9ec7-943d518277d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:28.090395 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2efd5e-f7ef-44b2-9ec7-943d518277d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:28.090680 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2efd5e-f7ef-44b2-9ec7-943d518277d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:28.091555 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2efd5e-f7ef-44b2-9ec7-943d518277d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:28.092331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2efd5e-f7ef-44b2-9ec7-943d518277d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:51:28.092893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2efd5e-f7ef-44b2-9ec7-943d518277d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:28.094657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2efd5e-f7ef-44b2-9ec7-943d518277d6 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:28.108206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1106/2209] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:51:28.112801 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804eae7-c0d3-4c1e-9c7d-e2529bd87bb3 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:28.130488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804eae7-c0d3-4c1e-9c7d-e2529bd87bb3 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:28.134797 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba9441-35e6-4980-9c95-0c894e032f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:28.135445 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba9441-35e6-4980-9c95-0c894e032f98 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:28.135727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba9441-35e6-4980-9c95-0c894e032f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:28.136039 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba9441-35e6-4980-9c95-0c894e032f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:28.136722 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba9441-35e6-4980-9c95-0c894e032f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:28.138817 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba9441-35e6-4980-9c95-0c894e032f98 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:28.180041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1104/2210] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:51:28 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:28.184727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2efd5e-f7ef-44b2-9ec7-943d518277d6 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:28.197764 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2efd5e-f7ef-44b2-9ec7-943d518277d6 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:28.260750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9637f2-bab1-4200-afe6-2f186b4823f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:28.261428 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9637f2-bab1-4200-afe6-2f186b4823f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:28.261650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9637f2-bab1-4200-afe6-2f186b4823f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:28.261926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9637f2-bab1-4200-afe6-2f186b4823f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:28.262706 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9637f2-bab1-4200-afe6-2f186b4823f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:28.264584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9637f2-bab1-4200-afe6-2f186b4823f1 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:28.290226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1107/2211] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:51:28 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:28.294953 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba9441-35e6-4980-9c95-0c894e032f98 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:28.307441 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba9441-35e6-4980-9c95-0c894e032f98 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:28.312343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c1a58-73a2-453a-acca-a4a88b941404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:28.312971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c1a58-73a2-453a-acca-a4a88b941404 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:28.313261 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c1a58-73a2-453a-acca-a4a88b941404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:28.313539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c1a58-73a2-453a-acca-a4a88b941404 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:28.314316 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c1a58-73a2-453a-acca-a4a88b941404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:28.315937 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c1a58-73a2-453a-acca-a4a88b941404 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:28.328640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1105/2212] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:51:28.332775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9637f2-bab1-4200-afe6-2f186b4823f1 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:28.343482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9637f2-bab1-4200-afe6-2f186b4823f1 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:28.352368 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb2fe7-ccea-4443-b98a-320c38cc88ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:28.353019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb2fe7-ccea-4443-b98a-320c38cc88ff admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:28.353299 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb2fe7-ccea-4443-b98a-320c38cc88ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:28.353573 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb2fe7-ccea-4443-b98a-320c38cc88ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:28.354330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb2fe7-ccea-4443-b98a-320c38cc88ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:28.355967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb2fe7-ccea-4443-b98a-320c38cc88ff admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:28.368601 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1108/2213] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:28.374222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c1a58-73a2-453a-acca-a4a88b941404 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:28.385823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c1a58-73a2-453a-acca-a4a88b941404 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:28.391293 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551a066-a37a-4cf5-a4a5-ed763b13836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:28.392019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551a066-a37a-4cf5-a4a5-ed763b13836e admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:28.392298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551a066-a37a-4cf5-a4a5-ed763b13836e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:28.392580 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551a066-a37a-4cf5-a4a5-ed763b13836e admin admin] PATH_INFO: `/v3/projects/10a93c247aad45d8a9656192ddf34077/users/6bd934d9d14c4b19950490deb20d81b2/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:28.411970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551a066-a37a-4cf5-a4a5-ed763b13836e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a93c247aad45d8a9656192ddf34077, user_id=6bd934d9d14c4b19950490deb20d81b2, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:28.415067 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551a066-a37a-4cf5-a4a5-ed763b13836e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:28.430621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1106/2214] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:51:28 2022] PUT /identity/v3/projects/10a93c247aad45d8a9656192ddf34077/users/6bd934d9d14c4b19950490deb20d81b2/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:51:28.443600 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac27b87-c8c3-4237-880d-a9007f1afeb5 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:28.444022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac27b87-c8c3-4237-880d-a9007f1afeb5 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:28.444310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac27b87-c8c3-4237-880d-a9007f1afeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:28.474515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:28.488268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-6ac27b87-c8c3-4237-880d-a9007f1afeb5 None None] MFA Rules not processed for user `6bd934d9d14c4b19950490deb20d81b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:28.489649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6ac27b87-c8c3-4237-880d-a9007f1afeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:28.561214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1109/2215] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:28.566174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551a066-a37a-4cf5-a4a5-ed763b13836e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:28.645060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551a066-a37a-4cf5-a4a5-ed763b13836e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:28.650800 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c92af9-bfc8-4003-8c55-84412bb0c14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:28.651437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92af9-bfc8-4003-8c55-84412bb0c14c admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:28.651720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92af9-bfc8-4003-8c55-84412bb0c14c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:28.651997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92af9-bfc8-4003-8c55-84412bb0c14c admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:28.652677 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c92af9-bfc8-4003-8c55-84412bb0c14c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:28.654651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c92af9-bfc8-4003-8c55-84412bb0c14c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:28.686141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1107/2216] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:51:28 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:28.689439 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac27b87-c8c3-4237-880d-a9007f1afeb5 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:28.701444 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac27b87-c8c3-4237-880d-a9007f1afeb5 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:28.762215 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f35d2-8382-476a-a5ea-32e9e97aa8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:28.762874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f35d2-8382-476a-a5ea-32e9e97aa8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:28.763156 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f35d2-8382-476a-a5ea-32e9e97aa8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:28.763436 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f35d2-8382-476a-a5ea-32e9e97aa8f6 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:28.764114 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f35d2-8382-476a-a5ea-32e9e97aa8f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:28.766023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f35d2-8382-476a-a5ea-32e9e97aa8f6 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:28.789498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1110/2217] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:51:28 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:28.793661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c92af9-bfc8-4003-8c55-84412bb0c14c admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:28.804326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c92af9-bfc8-4003-8c55-84412bb0c14c admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:28.809253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079a4cc-4aeb-4858-8c4e-372e82e4fa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:28.809878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a4cc-4aeb-4858-8c4e-372e82e4fa65 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:28.810158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a4cc-4aeb-4858-8c4e-372e82e4fa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:28.810465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079a4cc-4aeb-4858-8c4e-372e82e4fa65 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:28.811167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079a4cc-4aeb-4858-8c4e-372e82e4fa65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:28.812760 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079a4cc-4aeb-4858-8c4e-372e82e4fa65 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:28.825658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1108/2218] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:28.830621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f35d2-8382-476a-a5ea-32e9e97aa8f6 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:28.844235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f35d2-8382-476a-a5ea-32e9e97aa8f6 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:28.846817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2b7ef-95d1-4504-bb1d-92d9569710ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:28.847505 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2b7ef-95d1-4504-bb1d-92d9569710ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:28.847786 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2b7ef-95d1-4504-bb1d-92d9569710ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:28.848091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2b7ef-95d1-4504-bb1d-92d9569710ab admin admin] PATH_INFO: `/v3/projects/cf993491926b427b80d3c271e1f090c6/users/fc9cf04e2fba4134865080d30a4c7428/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:28.863865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2b7ef-95d1-4504-bb1d-92d9569710ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf993491926b427b80d3c271e1f090c6, user_id=fc9cf04e2fba4134865080d30a4c7428, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:28.866567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2b7ef-95d1-4504-bb1d-92d9569710ab admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:28.888911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e2bd3-712f-459e-859a-168c551e594a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:28.889286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e2bd3-712f-459e-859a-168c551e594a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:28.889486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e2bd3-712f-459e-859a-168c551e594a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:28.890100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1111/2219] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:51:28 2022] PUT /identity/v3/projects/cf993491926b427b80d3c271e1f090c6/users/fc9cf04e2fba4134865080d30a4c7428/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:28.893895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2b7ef-95d1-4504-bb1d-92d9569710ab admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:28.913594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-929e2bd3-712f-459e-859a-168c551e594a None None] MFA Rules not processed for user `7580bb98324b491e96934d89d5bdfc63`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:28.914984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-929e2bd3-712f-459e-859a-168c551e594a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:28.958681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:28.965019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2b7ef-95d1-4504-bb1d-92d9569710ab admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:28.970395 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2590e7-eb1d-4f1d-94a9-6e675e1bc53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:28.971060 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2590e7-eb1d-4f1d-94a9-6e675e1bc53c admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:28.971345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2590e7-eb1d-4f1d-94a9-6e675e1bc53c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:28.971629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2590e7-eb1d-4f1d-94a9-6e675e1bc53c admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:28.972429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2590e7-eb1d-4f1d-94a9-6e675e1bc53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:28.974176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2590e7-eb1d-4f1d-94a9-6e675e1bc53c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:28.977851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1109/2220] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:28.985177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1112/2221] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:28.989283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e2bd3-712f-459e-859a-168c551e594a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:29.002947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e2bd3-712f-459e-859a-168c551e594a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:29.009150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced81a91-c54c-42dd-ac3d-3b238b6d8515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:29.009869 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced81a91-c54c-42dd-ac3d-3b238b6d8515 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:29.010152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced81a91-c54c-42dd-ac3d-3b238b6d8515 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:29.010526 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced81a91-c54c-42dd-ac3d-3b238b6d8515 admin admin] PATH_INFO: `/v3/projects/cf993491926b427b80d3c271e1f090c6/users/fc9cf04e2fba4134865080d30a4c7428/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:29.012571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced81a91-c54c-42dd-ac3d-3b238b6d8515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf993491926b427b80d3c271e1f090c6, user_id=fc9cf04e2fba4134865080d30a4c7428, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:29.015291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced81a91-c54c-42dd-ac3d-3b238b6d8515 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:29.028868 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1110/2222] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:51:28 2022] PUT /identity/v3/projects/cf993491926b427b80d3c271e1f090c6/users/fc9cf04e2fba4134865080d30a4c7428/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:29.040875 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d204ca-6350-4684-a23e-11ee5f698bc1 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:29.041164 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d204ca-6350-4684-a23e-11ee5f698bc1 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:29.041442 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d204ca-6350-4684-a23e-11ee5f698bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:29.049329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:29.075068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-82d204ca-6350-4684-a23e-11ee5f698bc1 None None] MFA Rules not processed for user `fc9cf04e2fba4134865080d30a4c7428`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:29.077364 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-82d204ca-6350-4684-a23e-11ee5f698bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:29.163837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1113/2223] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:29.177650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced81a91-c54c-42dd-ac3d-3b238b6d8515 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:29.179439 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ced81a91-c54c-42dd-ac3d-3b238b6d8515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:29.255413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced81a91-c54c-42dd-ac3d-3b238b6d8515 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:29.264784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbca734-64d5-4c23-98fe-1dcaa92dcfea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:29.265823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbca734-64d5-4c23-98fe-1dcaa92dcfea service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:29.265823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbca734-64d5-4c23-98fe-1dcaa92dcfea service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:29.268477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbca734-64d5-4c23-98fe-1dcaa92dcfea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:29.279050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbca734-64d5-4c23-98fe-1dcaa92dcfea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:29.280615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbca734-64d5-4c23-98fe-1dcaa92dcfea service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:29.293057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1111/2224] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:29.396354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d204ca-6350-4684-a23e-11ee5f698bc1 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:29.407019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d204ca-6350-4684-a23e-11ee5f698bc1 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:29.411010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7376458-aeeb-4121-8465-0808bf476282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:29.411718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7376458-aeeb-4121-8465-0808bf476282 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:29.412068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7376458-aeeb-4121-8465-0808bf476282 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:29.412417 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7376458-aeeb-4121-8465-0808bf476282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:29.491308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7376458-aeeb-4121-8465-0808bf476282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:29.494009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7376458-aeeb-4121-8465-0808bf476282 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:29.507515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1114/2225] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:37.784203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbca734-64d5-4c23-98fe-1dcaa92dcfea service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:37.847787 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbca734-64d5-4c23-98fe-1dcaa92dcfea service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:37.853331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fbead-7090-4b07-a3a1-175c314e216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:37.853993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fbead-7090-4b07-a3a1-175c314e216c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:37.854314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fbead-7090-4b07-a3a1-175c314e216c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:37.854594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fbead-7090-4b07-a3a1-175c314e216c admin admin] PATH_INFO: `/v3/users/6bd934d9d14c4b19950490deb20d81b2` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:37.855792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fbead-7090-4b07-a3a1-175c314e216c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bd934d9d14c4b19950490deb20d81b2)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:37.857783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fbead-7090-4b07-a3a1-175c314e216c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:37.905212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-953fbead-7090-4b07-a3a1-175c314e216c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd934d9d14c4b19950490deb20d81b2'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:37.905866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-953fbead-7090-4b07-a3a1-175c314e216c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd934d9d14c4b19950490deb20d81b2'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:37.912735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-953fbead-7090-4b07-a3a1-175c314e216c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd934d9d14c4b19950490deb20d81b2'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:37.913368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-953fbead-7090-4b07-a3a1-175c314e216c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd934d9d14c4b19950490deb20d81b2'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:37.921499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-953fbead-7090-4b07-a3a1-175c314e216c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd934d9d14c4b19950490deb20d81b2'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:37.934963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:37.940581 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1112/2226] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:51:37 2022] DELETE /identity/v3/users/6bd934d9d14c4b19950490deb20d81b2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:37.945190 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e836a4-224b-4a17-a281-00a8d4cae1ca None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:37.945711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e836a4-224b-4a17-a281-00a8d4cae1ca None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:37.945824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e836a4-224b-4a17-a281-00a8d4cae1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:37.964942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-a1e836a4-224b-4a17-a281-00a8d4cae1ca None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:37.966145 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a1e836a4-224b-4a17-a281-00a8d4cae1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:38.025141 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1115/2227] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:38.034877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fbead-7090-4b07-a3a1-175c314e216c admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:38.036326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-953fbead-7090-4b07-a3a1-175c314e216c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:38.094082 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fbead-7090-4b07-a3a1-175c314e216c admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:38.097724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a9bbc-7621-4d8c-b332-3dad0e4af2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:38.098369 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a9bbc-7621-4d8c-b332-3dad0e4af2fe service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:38.098653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a9bbc-7621-4d8c-b332-3dad0e4af2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:38.098929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a9bbc-7621-4d8c-b332-3dad0e4af2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:38.108810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a9bbc-7621-4d8c-b332-3dad0e4af2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:38.110281 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a9bbc-7621-4d8c-b332-3dad0e4af2fe service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:38.120683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1113/2228] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:38.505984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e836a4-224b-4a17-a281-00a8d4cae1ca None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:38.508211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a1e836a4-224b-4a17-a281-00a8d4cae1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:38.521072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e836a4-224b-4a17-a281-00a8d4cae1ca None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:38.526296 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:38.526948 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:38.527241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:38.527512 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] PATH_INFO: `/v3/projects/10a93c247aad45d8a9656192ddf34077` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:38.528691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a93c247aad45d8a9656192ddf34077)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:38.530665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:38.556321 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=100 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:38.579829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a93c247aad45d8a9656192ddf34077', 'request_id': 'req-075d0b61-5396-4a16-b56d-3286115ea139'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:38.586006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a93c247aad45d8a9656192ddf34077', 'request_id': 'req-075d0b61-5396-4a16-b56d-3286115ea139'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:38.591554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a93c247aad45d8a9656192ddf34077', 'request_id': 'req-075d0b61-5396-4a16-b56d-3286115ea139'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:38.604194 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] The token cache is being invalidate because project 10a93c247aad45d8a9656192ddf34077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:51:38.604480 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:38.605115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:38.606709 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1116/2229] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:51:38 2022] DELETE /identity/v3/projects/10a93c247aad45d8a9656192ddf34077 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:38.611039 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a9bbc-7621-4d8c-b332-3dad0e4af2fe service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:38.621920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a9bbc-7621-4d8c-b332-3dad0e4af2fe service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:38.678780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99699af-959f-4537-bbfa-fca322edbe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:38.680060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99699af-959f-4537-bbfa-fca322edbe13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:38.680363 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99699af-959f-4537-bbfa-fca322edbe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:38.680642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99699af-959f-4537-bbfa-fca322edbe13 admin admin] PATH_INFO: `/v3/users/fc9cf04e2fba4134865080d30a4c7428` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:38.681833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99699af-959f-4537-bbfa-fca322edbe13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9cf04e2fba4134865080d30a4c7428)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:38.683811 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99699af-959f-4537-bbfa-fca322edbe13 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:38.730707 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c99699af-959f-4537-bbfa-fca322edbe13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9cf04e2fba4134865080d30a4c7428'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:38.731416 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c99699af-959f-4537-bbfa-fca322edbe13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9cf04e2fba4134865080d30a4c7428'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:38.738409 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c99699af-959f-4537-bbfa-fca322edbe13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9cf04e2fba4134865080d30a4c7428'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:38.739150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c99699af-959f-4537-bbfa-fca322edbe13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9cf04e2fba4134865080d30a4c7428'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:38.747492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c99699af-959f-4537-bbfa-fca322edbe13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9cf04e2fba4134865080d30a4c7428'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:38.771176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1114/2230] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:51:38 2022] DELETE /identity/v3/users/fc9cf04e2fba4134865080d30a4c7428 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:39.098557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:39.100036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:39.121882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d0b61-5396-4a16-b56d-3286115ea139 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:39.194779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9103f8-692c-497d-a6b1-b3b9ae202962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:39.196005 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9103f8-692c-497d-a6b1-b3b9ae202962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:39.196421 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9103f8-692c-497d-a6b1-b3b9ae202962 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:39.196702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9103f8-692c-497d-a6b1-b3b9ae202962 admin admin] PATH_INFO: `/v3/projects/cf993491926b427b80d3c271e1f090c6` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:39.197897 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9103f8-692c-497d-a6b1-b3b9ae202962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf993491926b427b80d3c271e1f090c6)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:39.199885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9103f8-692c-497d-a6b1-b3b9ae202962 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:39.247504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3c9103f8-692c-497d-a6b1-b3b9ae202962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf993491926b427b80d3c271e1f090c6', 'request_id': 'req-3c9103f8-692c-497d-a6b1-b3b9ae202962'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:39.253763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3c9103f8-692c-497d-a6b1-b3b9ae202962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf993491926b427b80d3c271e1f090c6', 'request_id': 'req-3c9103f8-692c-497d-a6b1-b3b9ae202962'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:39.260318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3c9103f8-692c-497d-a6b1-b3b9ae202962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf993491926b427b80d3c271e1f090c6', 'request_id': 'req-3c9103f8-692c-497d-a6b1-b3b9ae202962'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:39.273698 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3c9103f8-692c-497d-a6b1-b3b9ae202962 admin admin] The token cache is being invalidate because project cf993491926b427b80d3c271e1f090c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:51:39.274040 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3c9103f8-692c-497d-a6b1-b3b9ae202962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:39.274652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3c9103f8-692c-497d-a6b1-b3b9ae202962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:39.276204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1117/2231] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:51:39 2022] DELETE /identity/v3/projects/cf993491926b427b80d3c271e1f090c6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:51:39.281100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7f057-ab12-42ec-aa02-ca113570bada None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:39.281599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7f057-ab12-42ec-aa02-ca113570bada None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:39.281708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7f057-ab12-42ec-aa02-ca113570bada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:39.302686 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-83d7f057-ab12-42ec-aa02-ca113570bada None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:39.303972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-83d7f057-ab12-42ec-aa02-ca113570bada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:39.326102 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:39.375345 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1115/2232] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:39.384295 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bc1cf-ce0b-407c-bbc4-a739f326d124 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:39.384564 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bc1cf-ce0b-407c-bbc4-a739f326d124 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:39.384836 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bc1cf-ce0b-407c-bbc4-a739f326d124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:39.406590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-dc0bc1cf-ce0b-407c-bbc4-a739f326d124 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:39.407807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-dc0bc1cf-ce0b-407c-bbc4-a739f326d124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:39.416752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1118/2233] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:39.421206 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7f057-ab12-42ec-aa02-ca113570bada None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:39.432154 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7f057-ab12-42ec-aa02-ca113570bada None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:39.437326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb76000-e598-43c8-8daa-d5cdab556d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:39.437954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb76000-e598-43c8-8daa-d5cdab556d06 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:39.438284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb76000-e598-43c8-8daa-d5cdab556d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:39.438567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb76000-e598-43c8-8daa-d5cdab556d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:39.439283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb76000-e598-43c8-8daa-d5cdab556d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:51:39.439600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb76000-e598-43c8-8daa-d5cdab556d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:39.441211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb76000-e598-43c8-8daa-d5cdab556d06 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:39.455814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1116/2234] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:51:39.462592 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bc1cf-ce0b-407c-bbc4-a739f326d124 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:39.471585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bc1cf-ce0b-407c-bbc4-a739f326d124 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:39.476680 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0129b-dfff-46c1-81df-30bdbd228216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:39.477470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0129b-dfff-46c1-81df-30bdbd228216 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:39.477749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0129b-dfff-46c1-81df-30bdbd228216 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:39.478025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0129b-dfff-46c1-81df-30bdbd228216 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:39.478740 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0129b-dfff-46c1-81df-30bdbd228216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:39.480631 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0129b-dfff-46c1-81df-30bdbd228216 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:39.521046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1119/2235] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:51:39 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:39.522673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb76000-e598-43c8-8daa-d5cdab556d06 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:39.533736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb76000-e598-43c8-8daa-d5cdab556d06 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:39.595991 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57465761-1f81-4bc9-b034-dfcc387d3b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:39.596661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57465761-1f81-4bc9-b034-dfcc387d3b82 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:39.596908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57465761-1f81-4bc9-b034-dfcc387d3b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:39.597184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57465761-1f81-4bc9-b034-dfcc387d3b82 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:39.597852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57465761-1f81-4bc9-b034-dfcc387d3b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:39.599838 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57465761-1f81-4bc9-b034-dfcc387d3b82 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:39.623820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1117/2236] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:51:39 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:39.628016 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0129b-dfff-46c1-81df-30bdbd228216 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:39.638792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0129b-dfff-46c1-81df-30bdbd228216 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:39.643739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec2c38-d273-448b-a7a1-56106f154eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:39.644362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec2c38-d273-448b-a7a1-56106f154eeb admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:39.644648 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec2c38-d273-448b-a7a1-56106f154eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:39.644923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec2c38-d273-448b-a7a1-56106f154eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:39.645631 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec2c38-d273-448b-a7a1-56106f154eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:39.647280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec2c38-d273-448b-a7a1-56106f154eeb admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:39.653558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:39.659304 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1120/2237] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:39.664478 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57465761-1f81-4bc9-b034-dfcc387d3b82 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:39.674640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57465761-1f81-4bc9-b034-dfcc387d3b82 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:39.679321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baa475-d924-4350-968d-29d56c1e4dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:39.680195 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa475-d924-4350-968d-29d56c1e4dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:39.680484 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa475-d924-4350-968d-29d56c1e4dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:39.680761 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa475-d924-4350-968d-29d56c1e4dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:39.681494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baa475-d924-4350-968d-29d56c1e4dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:39.683120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baa475-d924-4350-968d-29d56c1e4dc1 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:39.694648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1118/2238] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:39.698957 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec2c38-d273-448b-a7a1-56106f154eeb admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:39.709737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec2c38-d273-448b-a7a1-56106f154eeb admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:39.714944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e182842-7879-4d45-ac42-fed319b44ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:39.715620 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e182842-7879-4d45-ac42-fed319b44ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:39.715907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e182842-7879-4d45-ac42-fed319b44ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:39.716187 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e182842-7879-4d45-ac42-fed319b44ac9 admin admin] PATH_INFO: `/v3/projects/1fe624adeb854e47bbe86ae6e249d501/users/fe334c55af5242a3953782fa62f94e0b/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:39.731982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e182842-7879-4d45-ac42-fed319b44ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe624adeb854e47bbe86ae6e249d501, user_id=fe334c55af5242a3953782fa62f94e0b, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:39.734686 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e182842-7879-4d45-ac42-fed319b44ac9 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:39.747833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1121/2239] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:51:39 2022] PUT /identity/v3/projects/1fe624adeb854e47bbe86ae6e249d501/users/fe334c55af5242a3953782fa62f94e0b/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:39.752989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690c37f-0709-4659-91fa-d25853f3f434 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:39.753279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690c37f-0709-4659-91fa-d25853f3f434 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:39.753563 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690c37f-0709-4659-91fa-d25853f3f434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:39.772210 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-c690c37f-0709-4659-91fa-d25853f3f434 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:39.774084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c690c37f-0709-4659-91fa-d25853f3f434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:39.833311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1119/2240] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:39.843644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e182842-7879-4d45-ac42-fed319b44ac9 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:39.845392 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1e182842-7879-4d45-ac42-fed319b44ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:39.907358 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e182842-7879-4d45-ac42-fed319b44ac9 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:39.911818 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fc96d-3214-41f4-8f45-8790c4a340a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:39.912449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fc96d-3214-41f4-8f45-8790c4a340a2 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:39.912768 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fc96d-3214-41f4-8f45-8790c4a340a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:39.913046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fc96d-3214-41f4-8f45-8790c4a340a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:39.923118 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fc96d-3214-41f4-8f45-8790c4a340a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:39.924593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006fc96d-3214-41f4-8f45-8790c4a340a2 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:39.935313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1122/2241] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:40.645018 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7bc9-a2ab-46d8-96e8-b3adeb66d95a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:40.645965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7bc9-a2ab-46d8-96e8-b3adeb66d95a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:40.646424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c7bc9-a2ab-46d8-96e8-b3adeb66d95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:40.697486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e34c7bc9-a2ab-46d8-96e8-b3adeb66d95a None None] MFA Rules not processed for user `fe334c55af5242a3953782fa62f94e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:40.698831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e34c7bc9-a2ab-46d8-96e8-b3adeb66d95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:40.717807 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:40.802391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1120/2242] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:40.803607 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fc96d-3214-41f4-8f45-8790c4a340a2 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:40.816311 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fc96d-3214-41f4-8f45-8790c4a340a2 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:40.831648 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58db86-7c60-4caf-ae50-717cf6c04657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:40.832686 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58db86-7c60-4caf-ae50-717cf6c04657 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:40.833178 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58db86-7c60-4caf-ae50-717cf6c04657 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:40.834310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58db86-7c60-4caf-ae50-717cf6c04657 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:40.836237 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58db86-7c60-4caf-ae50-717cf6c04657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:40.838897 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58db86-7c60-4caf-ae50-717cf6c04657 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:40.887448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1123/2243] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:51:40 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:40.891769 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7bc9-a2ab-46d8-96e8-b3adeb66d95a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:40.907601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c7bc9-a2ab-46d8-96e8-b3adeb66d95a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:40.986529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6affe81-2e4f-4eb8-9cea-f22470629a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:40.987178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6affe81-2e4f-4eb8-9cea-f22470629a58 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:40.987538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6affe81-2e4f-4eb8-9cea-f22470629a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:40.987823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6affe81-2e4f-4eb8-9cea-f22470629a58 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:40.988521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6affe81-2e4f-4eb8-9cea-f22470629a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:40.990537 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6affe81-2e4f-4eb8-9cea-f22470629a58 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:41.020502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1121/2244] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:51:40 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:41.021756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58db86-7c60-4caf-ae50-717cf6c04657 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:41.032596 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58db86-7c60-4caf-ae50-717cf6c04657 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:41.037453 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040cd52-7c90-4bda-a736-22cd5b5188dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:41.038086 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040cd52-7c90-4bda-a736-22cd5b5188dc admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:41.038339 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040cd52-7c90-4bda-a736-22cd5b5188dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:41.039298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040cd52-7c90-4bda-a736-22cd5b5188dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:41.040121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040cd52-7c90-4bda-a736-22cd5b5188dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:41.041739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040cd52-7c90-4bda-a736-22cd5b5188dc admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:41.053189 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1124/2245] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:41.058429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6affe81-2e4f-4eb8-9cea-f22470629a58 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:41.068839 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6affe81-2e4f-4eb8-9cea-f22470629a58 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:41.074779 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc14a8a-a5a0-43bd-ba8e-22122db5d6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:41.075720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc14a8a-a5a0-43bd-ba8e-22122db5d6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:41.075858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc14a8a-a5a0-43bd-ba8e-22122db5d6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:41.076372 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc14a8a-a5a0-43bd-ba8e-22122db5d6e2 admin admin] PATH_INFO: `/v3/projects/269f63c364a5498cb9a8334a1b415c94/users/b10bb9aae76341659c96f25b43d07467/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:41.097970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc14a8a-a5a0-43bd-ba8e-22122db5d6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=269f63c364a5498cb9a8334a1b415c94, user_id=b10bb9aae76341659c96f25b43d07467, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:41.100944 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc14a8a-a5a0-43bd-ba8e-22122db5d6e2 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:41.118571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1122/2246] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:51:41 2022] PUT /identity/v3/projects/269f63c364a5498cb9a8334a1b415c94/users/b10bb9aae76341659c96f25b43d07467/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:41.122174 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040cd52-7c90-4bda-a736-22cd5b5188dc admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:41.133144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040cd52-7c90-4bda-a736-22cd5b5188dc admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:41.206795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d15077-29d3-40c4-8171-40d603a92041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:41.207566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d15077-29d3-40c4-8171-40d603a92041 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:41.207930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d15077-29d3-40c4-8171-40d603a92041 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:41.208330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d15077-29d3-40c4-8171-40d603a92041 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:41.209448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d15077-29d3-40c4-8171-40d603a92041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:41.211994 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d15077-29d3-40c4-8171-40d603a92041 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:41.225338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1125/2247] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:41.230168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc14a8a-a5a0-43bd-ba8e-22122db5d6e2 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:41.243182 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc14a8a-a5a0-43bd-ba8e-22122db5d6e2 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:41.248188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d3a99-e4cc-4fe6-8e34-812d92a8292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:41.248881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d3a99-e4cc-4fe6-8e34-812d92a8292f admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:41.249168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d3a99-e4cc-4fe6-8e34-812d92a8292f admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:41.249449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d3a99-e4cc-4fe6-8e34-812d92a8292f admin admin] PATH_INFO: `/v3/projects/269f63c364a5498cb9a8334a1b415c94/users/b10bb9aae76341659c96f25b43d07467/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:41.251448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d3a99-e4cc-4fe6-8e34-812d92a8292f admin admin] RBAC: Authorizing `identity:create_grant(project_id=269f63c364a5498cb9a8334a1b415c94, user_id=b10bb9aae76341659c96f25b43d07467, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:41.254122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d3a99-e4cc-4fe6-8e34-812d92a8292f admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:41.268197 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1123/2248] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:51:41 2022] PUT /identity/v3/projects/269f63c364a5498cb9a8334a1b415c94/users/b10bb9aae76341659c96f25b43d07467/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:42.084185 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5c20-e728-443d-b466-ea1943296420 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:42.084702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5c20-e728-443d-b466-ea1943296420 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:42.084702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5c20-e728-443d-b466-ea1943296420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:42.118563 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-4beb5c20-e728-443d-b466-ea1943296420 None None] MFA Rules not processed for user `b10bb9aae76341659c96f25b43d07467`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:42.119906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-4beb5c20-e728-443d-b466-ea1943296420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:42.155911 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:42.207854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1126/2249] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:42.220834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d3b69-dfdc-4a21-b900-258bff888d3a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:42.221389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d3b69-dfdc-4a21-b900-258bff888d3a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:42.221389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d3b69-dfdc-4a21-b900-258bff888d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:42.249594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-204d3b69-dfdc-4a21-b900-258bff888d3a None None] MFA Rules not processed for user `fe334c55af5242a3953782fa62f94e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:42.251330 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-204d3b69-dfdc-4a21-b900-258bff888d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:42.335015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1124/2250] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:42.347321 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb5c20-e728-443d-b466-ea1943296420 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:42.348980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-4beb5c20-e728-443d-b466-ea1943296420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:42.434478 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb5c20-e728-443d-b466-ea1943296420 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:42.440111 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0290a-c1f5-4dc4-a19a-d9d9e883ae0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:42.440740 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0290a-c1f5-4dc4-a19a-d9d9e883ae0b service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:42.441024 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0290a-c1f5-4dc4-a19a-d9d9e883ae0b service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:42.441301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0290a-c1f5-4dc4-a19a-d9d9e883ae0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:42.449983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0290a-c1f5-4dc4-a19a-d9d9e883ae0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:42.451798 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0290a-c1f5-4dc4-a19a-d9d9e883ae0b service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:42.461737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1127/2251] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:51.951979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d3b69-dfdc-4a21-b900-258bff888d3a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:51.953449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-204d3b69-dfdc-4a21-b900-258bff888d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:51.971252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:52.042964 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d3b69-dfdc-4a21-b900-258bff888d3a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:52.048068 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6150225-298e-4305-a926-fb260f556a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:52.048978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6150225-298e-4305-a926-fb260f556a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:52.049342 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6150225-298e-4305-a926-fb260f556a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:52.049536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6150225-298e-4305-a926-fb260f556a92 admin admin] PATH_INFO: `/v3/users/56220d6f900345baa88a3d10f108d780` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:52.050942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6150225-298e-4305-a926-fb260f556a92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56220d6f900345baa88a3d10f108d780)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:52.052911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6150225-298e-4305-a926-fb260f556a92 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:52.118532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a6150225-298e-4305-a926-fb260f556a92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56220d6f900345baa88a3d10f108d780'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:52.119232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a6150225-298e-4305-a926-fb260f556a92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56220d6f900345baa88a3d10f108d780'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:52.126773 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a6150225-298e-4305-a926-fb260f556a92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56220d6f900345baa88a3d10f108d780'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:52.127577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a6150225-298e-4305-a926-fb260f556a92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56220d6f900345baa88a3d10f108d780'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:52.136356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a6150225-298e-4305-a926-fb260f556a92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56220d6f900345baa88a3d10f108d780'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:52.156378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1125/2252] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:51:51 2022] DELETE /identity/v3/users/56220d6f900345baa88a3d10f108d780 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:52.161101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1c902-74b8-4d0a-8c60-7a7934ccde99 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:52.161727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1c902-74b8-4d0a-8c60-7a7934ccde99 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:52.161727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1c902-74b8-4d0a-8c60-7a7934ccde99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:52.182999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-28f1c902-74b8-4d0a-8c60-7a7934ccde99 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:52.184480 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-28f1c902-74b8-4d0a-8c60-7a7934ccde99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:52.253528 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1128/2253] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:52.264313 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6150225-298e-4305-a926-fb260f556a92 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:52.265917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a6150225-298e-4305-a926-fb260f556a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:52.325027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6150225-298e-4305-a926-fb260f556a92 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:52.328772 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3151a-e3a0-4931-9d12-b1fc2c9068cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:52.329432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3151a-e3a0-4931-9d12-b1fc2c9068cd service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:52.329714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3151a-e3a0-4931-9d12-b1fc2c9068cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:52.329985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3151a-e3a0-4931-9d12-b1fc2c9068cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:52.340207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3151a-e3a0-4931-9d12-b1fc2c9068cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:52.341726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3151a-e3a0-4931-9d12-b1fc2c9068cd service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:52.352664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1126/2254] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:52.650538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1c902-74b8-4d0a-8c60-7a7934ccde99 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:52.652023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-28f1c902-74b8-4d0a-8c60-7a7934ccde99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:52.673192 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1c902-74b8-4d0a-8c60-7a7934ccde99 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:52.679746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c81f9-2f78-4196-bb42-f8dad871a96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:52.680674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c81f9-2f78-4196-bb42-f8dad871a96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:52.680862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c81f9-2f78-4196-bb42-f8dad871a96f admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:52.681212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c81f9-2f78-4196-bb42-f8dad871a96f admin admin] PATH_INFO: `/v3/projects/29ff41fb924a473c9861a74ad0cb995f` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:52.682840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c81f9-2f78-4196-bb42-f8dad871a96f admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ff41fb924a473c9861a74ad0cb995f)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:52.685076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c81f9-2f78-4196-bb42-f8dad871a96f admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:52.736173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:52.737714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-072c81f9-2f78-4196-bb42-f8dad871a96f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ff41fb924a473c9861a74ad0cb995f', 'request_id': 'req-072c81f9-2f78-4196-bb42-f8dad871a96f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:52.747077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-072c81f9-2f78-4196-bb42-f8dad871a96f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ff41fb924a473c9861a74ad0cb995f', 'request_id': 'req-072c81f9-2f78-4196-bb42-f8dad871a96f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:52.753866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-072c81f9-2f78-4196-bb42-f8dad871a96f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ff41fb924a473c9861a74ad0cb995f', 'request_id': 'req-072c81f9-2f78-4196-bb42-f8dad871a96f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:52.768344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-072c81f9-2f78-4196-bb42-f8dad871a96f admin admin] The token cache is being invalidate because project 29ff41fb924a473c9861a74ad0cb995f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:51:52.768638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-072c81f9-2f78-4196-bb42-f8dad871a96f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:52.769308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-072c81f9-2f78-4196-bb42-f8dad871a96f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:51:52.770892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1129/2255] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:51:52 2022] DELETE /identity/v3/projects/29ff41fb924a473c9861a74ad0cb995f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:52.776156 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d36b4-a7c8-4c41-b630-00d93324f559 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:52.776468 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d36b4-a7c8-4c41-b630-00d93324f559 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:52.776767 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d36b4-a7c8-4c41-b630-00d93324f559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:52.797398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-445d36b4-a7c8-4c41-b630-00d93324f559 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:52.798740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-445d36b4-a7c8-4c41-b630-00d93324f559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:52.834371 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:52.874231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1127/2256] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:52.875937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9563b8-4a5c-4dbb-ad1b-3744d9ca2c08 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:52.876235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9563b8-4a5c-4dbb-ad1b-3744d9ca2c08 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:52.876521 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9563b8-4a5c-4dbb-ad1b-3744d9ca2c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:52.897997 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-0e9563b8-4a5c-4dbb-ad1b-3744d9ca2c08 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:52.899170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0e9563b8-4a5c-4dbb-ad1b-3744d9ca2c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:52.912565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1130/2257] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:51:52.914485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d36b4-a7c8-4c41-b630-00d93324f559 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:52.924945 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d36b4-a7c8-4c41-b630-00d93324f559 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:52.932180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a937614-a462-4e10-b911-f6d17c265383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:52.932851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a937614-a462-4e10-b911-f6d17c265383 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:52.933140 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a937614-a462-4e10-b911-f6d17c265383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:52.933458 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a937614-a462-4e10-b911-f6d17c265383 admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:52.934169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a937614-a462-4e10-b911-f6d17c265383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:51:52.934504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a937614-a462-4e10-b911-f6d17c265383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:52.936196 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a937614-a462-4e10-b911-f6d17c265383 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:52.949675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1128/2258] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:51:52.954068 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9563b8-4a5c-4dbb-ad1b-3744d9ca2c08 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:52.964504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9563b8-4a5c-4dbb-ad1b-3744d9ca2c08 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:52.969862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402c0eb-f4cb-4c78-b239-d66964ea41f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:52.970536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402c0eb-f4cb-4c78-b239-d66964ea41f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:52.970847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402c0eb-f4cb-4c78-b239-d66964ea41f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:52.971161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402c0eb-f4cb-4c78-b239-d66964ea41f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:52.976982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402c0eb-f4cb-4c78-b239-d66964ea41f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:52.979029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402c0eb-f4cb-4c78-b239-d66964ea41f8 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:53.009144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1131/2259] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:51:52 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:51:53.014279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a937614-a462-4e10-b911-f6d17c265383 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:53.025827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a937614-a462-4e10-b911-f6d17c265383 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:53.086675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d32fa6-06c0-4be7-8557-e92afb70805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:53.087359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d32fa6-06c0-4be7-8557-e92afb70805e admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:53.087752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d32fa6-06c0-4be7-8557-e92afb70805e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:53.088054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d32fa6-06c0-4be7-8557-e92afb70805e admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:53.088832 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d32fa6-06c0-4be7-8557-e92afb70805e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:53.090901 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d32fa6-06c0-4be7-8557-e92afb70805e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:53.113913 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1129/2260] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:51:53 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:51:53.118804 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402c0eb-f4cb-4c78-b239-d66964ea41f8 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:53.129502 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402c0eb-f4cb-4c78-b239-d66964ea41f8 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:53.134919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea5a3a-d25f-4429-b979-33e356796b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:53.135569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea5a3a-d25f-4429-b979-33e356796b6c admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:53.135955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea5a3a-d25f-4429-b979-33e356796b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:53.136203 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea5a3a-d25f-4429-b979-33e356796b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:53.136974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea5a3a-d25f-4429-b979-33e356796b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:53.138598 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea5a3a-d25f-4429-b979-33e356796b6c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:53.150053 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1132/2261] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:53.154031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d32fa6-06c0-4be7-8557-e92afb70805e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:53.164557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d32fa6-06c0-4be7-8557-e92afb70805e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:53.169325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b5088-b66b-483e-a274-f0dd8910a789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:53.169934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b5088-b66b-483e-a274-f0dd8910a789 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:53.170252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b5088-b66b-483e-a274-f0dd8910a789 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:53.170536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b5088-b66b-483e-a274-f0dd8910a789 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:53.171242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b5088-b66b-483e-a274-f0dd8910a789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:53.172846 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b5088-b66b-483e-a274-f0dd8910a789 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:53.184677 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1130/2262] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:51:53.188971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea5a3a-d25f-4429-b979-33e356796b6c admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:53.200224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea5a3a-d25f-4429-b979-33e356796b6c admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:53.205025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9883bc-ec9e-471d-a8af-fdc58647a6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:53.205693 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9883bc-ec9e-471d-a8af-fdc58647a6c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:53.205977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9883bc-ec9e-471d-a8af-fdc58647a6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:53.206399 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9883bc-ec9e-471d-a8af-fdc58647a6c0 admin admin] PATH_INFO: `/v3/projects/2a1feb7456464600b1ab7cc86d162f08/users/778a505d6a8a453eae0c67fd84cbea35/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:53.223798 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9883bc-ec9e-471d-a8af-fdc58647a6c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1feb7456464600b1ab7cc86d162f08, user_id=778a505d6a8a453eae0c67fd84cbea35, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:53.227504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9883bc-ec9e-471d-a8af-fdc58647a6c0 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:53.242851 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1133/2263] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:51:53 2022] PUT /identity/v3/projects/2a1feb7456464600b1ab7cc86d162f08/users/778a505d6a8a453eae0c67fd84cbea35/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:51:53.253076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c0be-c420-4f9a-b085-2d1ffedc60f0 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:53.253366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c0be-c420-4f9a-b085-2d1ffedc60f0 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:53.253642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c0be-c420-4f9a-b085-2d1ffedc60f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:53.284798 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-2a67c0be-c420-4f9a-b085-2d1ffedc60f0 None None] MFA Rules not processed for user `778a505d6a8a453eae0c67fd84cbea35`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:53.286139 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-2a67c0be-c420-4f9a-b085-2d1ffedc60f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:53.360398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1131/2264] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:51:53.372354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9883bc-ec9e-471d-a8af-fdc58647a6c0 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:51:53.374152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7d9883bc-ec9e-471d-a8af-fdc58647a6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:53.434379 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9883bc-ec9e-471d-a8af-fdc58647a6c0 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:51:53.437950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c7e71-ecd6-4dd0-82a5-d009fe5d58c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:51:53.438628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c7e71-ecd6-4dd0-82a5-d009fe5d58c0 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:53.438907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c7e71-ecd6-4dd0-82a5-d009fe5d58c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:53.439184 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c7e71-ecd6-4dd0-82a5-d009fe5d58c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:53.448662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c7e71-ecd6-4dd0-82a5-d009fe5d58c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:51:53.450238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c7e71-ecd6-4dd0-82a5-d009fe5d58c0 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:51:53.459345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1134/2265] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:51:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:51:54.463068 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98225a54-f7d1-4d60-96fb-82f602ca6e33 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:51:54.463731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98225a54-f7d1-4d60-96fb-82f602ca6e33 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:51:54.463731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98225a54-f7d1-4d60-96fb-82f602ca6e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:51:54.482800 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-98225a54-f7d1-4d60-96fb-82f602ca6e33 None None] MFA Rules not processed for user `7580bb98324b491e96934d89d5bdfc63`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:51:54.484007 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-98225a54-f7d1-4d60-96fb-82f602ca6e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:51:54.513315 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:51:54.549528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1132/2266] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:51:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:03.123033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c7e71-ecd6-4dd0-82a5-d009fe5d58c0 service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:03.139352 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c7e71-ecd6-4dd0-82a5-d009fe5d58c0 service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:03.145747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee29f8-498e-47ac-bbd7-18185ab98b2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:03.146609 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee29f8-498e-47ac-bbd7-18185ab98b2c service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:03.147034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee29f8-498e-47ac-bbd7-18185ab98b2c service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:03.147956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee29f8-498e-47ac-bbd7-18185ab98b2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:03.150179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-94ee29f8-498e-47ac-bbd7-18185ab98b2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:03.245188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee29f8-498e-47ac-bbd7-18185ab98b2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:03.248752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee29f8-498e-47ac-bbd7-18185ab98b2c service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:03.264210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1135/2267] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:52:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:52:04.542486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=11 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:13.258616 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=90,keystone:DELETE=3,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:15.752365 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ab0db-fa05-442d-96af-122d0f8f33e2 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:15.752993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ab0db-fa05-442d-96af-122d0f8f33e2 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:15.752993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ab0db-fa05-442d-96af-122d0f8f33e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:15.773788 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-4c9ab0db-fa05-442d-96af-122d0f8f33e2 None None] MFA Rules not processed for user `71fcdfd05fb146e88f43fb29c4b0232c`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:15.775060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4c9ab0db-fa05-442d-96af-122d0f8f33e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:15.834824 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1133/2268] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:22.366996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e4b0c-5c64-4e71-928d-fe58be441ca8 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:22.367501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e4b0c-5c64-4e71-928d-fe58be441ca8 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:22.367501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e4b0c-5c64-4e71-928d-fe58be441ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:22.389263 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-f32e4b0c-5c64-4e71-928d-fe58be441ca8 None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:22.389263 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f32e4b0c-5c64-4e71-928d-fe58be441ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:22.459324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1136/2269] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 10:52:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:22.503875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ab0db-fa05-442d-96af-122d0f8f33e2 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:22.505469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4c9ab0db-fa05-442d-96af-122d0f8f33e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:22.591649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ab0db-fa05-442d-96af-122d0f8f33e2 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:22.597727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748511b-1b21-4026-af23-1107c48d1a3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:22.598450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748511b-1b21-4026-af23-1107c48d1a3c service swift] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:22.598776 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748511b-1b21-4026-af23-1107c48d1a3c service swift] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:22.599136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748511b-1b21-4026-af23-1107c48d1a3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:22.610717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748511b-1b21-4026-af23-1107c48d1a3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:22.612574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748511b-1b21-4026-af23-1107c48d1a3c service swift] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:22.622048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1134/2270] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 10:52:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 10:52:32.451559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=25 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:32.627041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=57 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:36.290945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e4b0c-5c64-4e71-928d-fe58be441ca8 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:36.414733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e4b0c-5c64-4e71-928d-fe58be441ca8 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:36.421212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32362657-baf1-409d-9309-c57aa5b1d26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:36.422211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32362657-baf1-409d-9309-c57aa5b1d26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:36.422767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32362657-baf1-409d-9309-c57aa5b1d26b admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:36.423264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32362657-baf1-409d-9309-c57aa5b1d26b admin admin] PATH_INFO: `/v3/users/778a505d6a8a453eae0c67fd84cbea35` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:36.425035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32362657-baf1-409d-9309-c57aa5b1d26b admin admin] RBAC: Authorizing `identity:delete_user(user_id=778a505d6a8a453eae0c67fd84cbea35)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:36.427582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32362657-baf1-409d-9309-c57aa5b1d26b admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:36.548563 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-32362657-baf1-409d-9309-c57aa5b1d26b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '778a505d6a8a453eae0c67fd84cbea35'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:36.549923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-32362657-baf1-409d-9309-c57aa5b1d26b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '778a505d6a8a453eae0c67fd84cbea35'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:36.567242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-32362657-baf1-409d-9309-c57aa5b1d26b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '778a505d6a8a453eae0c67fd84cbea35'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:36.590909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-32362657-baf1-409d-9309-c57aa5b1d26b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '778a505d6a8a453eae0c67fd84cbea35'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:36.592553 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-32362657-baf1-409d-9309-c57aa5b1d26b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '778a505d6a8a453eae0c67fd84cbea35'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:36.647412 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1137/2271] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:52:36 2022] DELETE /identity/v3/users/778a505d6a8a453eae0c67fd84cbea35 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:52:36.649345 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d0bc2-2327-42fe-85f8-2557ad950996 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:36.649893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d0bc2-2327-42fe-85f8-2557ad950996 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:36.649986 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d0bc2-2327-42fe-85f8-2557ad950996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:36.687711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-c61d0bc2-2327-42fe-85f8-2557ad950996 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:36.689035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c61d0bc2-2327-42fe-85f8-2557ad950996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:36.833996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1135/2272] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:36.873190 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32362657-baf1-409d-9309-c57aa5b1d26b admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:36.880110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-32362657-baf1-409d-9309-c57aa5b1d26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:37.015441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32362657-baf1-409d-9309-c57aa5b1d26b admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:37.026063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc4614-9c1d-4fcb-9796-391109464bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:37.027588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc4614-9c1d-4fcb-9796-391109464bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:37.028368 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc4614-9c1d-4fcb-9796-391109464bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:37.029333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc4614-9c1d-4fcb-9796-391109464bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:37.052499 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc4614-9c1d-4fcb-9796-391109464bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:37.057165 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc4614-9c1d-4fcb-9796-391109464bd6 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:37.083381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1138/2273] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:52:37.555400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1df71e-c85c-4d43-8b98-17bcc7b66e6b None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:37.555879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1df71e-c85c-4d43-8b98-17bcc7b66e6b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:37.556446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1df71e-c85c-4d43-8b98-17bcc7b66e6b None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:37.558969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1136/2274] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jul 27 10:52:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:52:37.599087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220342-faa4-44cd-85c1-2f69fe67d531 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:37.599583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220342-faa4-44cd-85c1-2f69fe67d531 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:37.600413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43220342-faa4-44cd-85c1-2f69fe67d531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:37.652920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-43220342-faa4-44cd-85c1-2f69fe67d531 None None] MFA Rules not processed for user `39830a354dee41b5b210d80807886299`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:37.657461 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-43220342-faa4-44cd-85c1-2f69fe67d531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:37.723783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:37.796172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1139/2275] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jul 27 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:37.808401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1df71e-c85c-4d43-8b98-17bcc7b66e6b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:37.810880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0c1df71e-c85c-4d43-8b98-17bcc7b66e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:37.841811 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1df71e-c85c-4d43-8b98-17bcc7b66e6b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:37.849907 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bd438-05f4-4594-8289-5168b6123c30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:37.850875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bd438-05f4-4594-8289-5168b6123c30 service placement] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:37.851950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bd438-05f4-4594-8289-5168b6123c30 service placement] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:37.852438 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bd438-05f4-4594-8289-5168b6123c30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:37.867453 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bd438-05f4-4594-8289-5168b6123c30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:37.870357 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bd438-05f4-4594-8289-5168b6123c30 service placement] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:37.884887 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1137/2276] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:52:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:52:38.060426 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43220342-faa4-44cd-85c1-2f69fe67d531 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:38.062112 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-43220342-faa4-44cd-85c1-2f69fe67d531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:38.110378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43220342-faa4-44cd-85c1-2f69fe67d531 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:38.124135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68caf204-57cb-4464-8cf9-064eebab815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:38.125218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf204-57cb-4464-8cf9-064eebab815a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:38.125751 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf204-57cb-4464-8cf9-064eebab815a admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:38.127158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caf204-57cb-4464-8cf9-064eebab815a admin admin] PATH_INFO: `/v3/projects/2a1feb7456464600b1ab7cc86d162f08` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:38.128705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68caf204-57cb-4464-8cf9-064eebab815a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1feb7456464600b1ab7cc86d162f08)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:38.130992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68caf204-57cb-4464-8cf9-064eebab815a admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:38.221731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-68caf204-57cb-4464-8cf9-064eebab815a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1feb7456464600b1ab7cc86d162f08', 'request_id': 'req-68caf204-57cb-4464-8cf9-064eebab815a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:38.234619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-68caf204-57cb-4464-8cf9-064eebab815a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1feb7456464600b1ab7cc86d162f08', 'request_id': 'req-68caf204-57cb-4464-8cf9-064eebab815a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:38.261567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-68caf204-57cb-4464-8cf9-064eebab815a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1feb7456464600b1ab7cc86d162f08', 'request_id': 'req-68caf204-57cb-4464-8cf9-064eebab815a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:38.289244 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-68caf204-57cb-4464-8cf9-064eebab815a admin admin] The token cache is being invalidate because project 2a1feb7456464600b1ab7cc86d162f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:52:38.289929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-68caf204-57cb-4464-8cf9-064eebab815a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:38.291006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-68caf204-57cb-4464-8cf9-064eebab815a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:38.293137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1140/2277] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:52:38 2022] DELETE /identity/v3/projects/2a1feb7456464600b1ab7cc86d162f08 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:52:38.300713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc7d81-4e06-4a12-9d83-e31fd9cfd8bf None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:38.300931 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc7d81-4e06-4a12-9d83-e31fd9cfd8bf None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:38.301452 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc7d81-4e06-4a12-9d83-e31fd9cfd8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:38.327325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-3ecc7d81-4e06-4a12-9d83-e31fd9cfd8bf None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:38.328663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3ecc7d81-4e06-4a12-9d83-e31fd9cfd8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:38.422217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1138/2278] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:38.496741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525caf5b-0225-4e1f-94ed-58c1168e5d8e None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:38.497060 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525caf5b-0225-4e1f-94ed-58c1168e5d8e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:38.497534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525caf5b-0225-4e1f-94ed-58c1168e5d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:38.531603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-525caf5b-0225-4e1f-94ed-58c1168e5d8e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:38.533510 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-525caf5b-0225-4e1f-94ed-58c1168e5d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:38.546742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1141/2279] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:38.548518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc7d81-4e06-4a12-9d83-e31fd9cfd8bf None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:38.564017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc7d81-4e06-4a12-9d83-e31fd9cfd8bf None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:38.576322 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106c711-b3da-46d5-ae6d-4ff11200199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:38.577644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106c711-b3da-46d5-ae6d-4ff11200199d admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:38.577950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106c711-b3da-46d5-ae6d-4ff11200199d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:38.578439 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106c711-b3da-46d5-ae6d-4ff11200199d admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:38.579102 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106c711-b3da-46d5-ae6d-4ff11200199d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:52:38.579414 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106c711-b3da-46d5-ae6d-4ff11200199d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:38.581510 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106c711-b3da-46d5-ae6d-4ff11200199d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:38.604306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1139/2280] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:52:38.609361 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525caf5b-0225-4e1f-94ed-58c1168e5d8e None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:38.640928 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106c711-b3da-46d5-ae6d-4ff11200199d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:38.643117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c106c711-b3da-46d5-ae6d-4ff11200199d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:38.646810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525caf5b-0225-4e1f-94ed-58c1168e5d8e None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:38.662576 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac071b0c-54ee-4b71-9e0d-06189ef9374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:38.663214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071b0c-54ee-4b71-9e0d-06189ef9374d admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:38.663717 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071b0c-54ee-4b71-9e0d-06189ef9374d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:38.663989 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071b0c-54ee-4b71-9e0d-06189ef9374d admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:38.664845 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac071b0c-54ee-4b71-9e0d-06189ef9374d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:38.668223 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106c711-b3da-46d5-ae6d-4ff11200199d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:38.671565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac071b0c-54ee-4b71-9e0d-06189ef9374d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:38.683002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131caa4-6843-443c-a085-b96b22ec4abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:38.684634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131caa4-6843-443c-a085-b96b22ec4abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:38.685966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131caa4-6843-443c-a085-b96b22ec4abf admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:38.686424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131caa4-6843-443c-a085-b96b22ec4abf admin admin] PATH_INFO: `/v3/users/fe334c55af5242a3953782fa62f94e0b` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:38.693645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131caa4-6843-443c-a085-b96b22ec4abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe334c55af5242a3953782fa62f94e0b)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:38.697876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131caa4-6843-443c-a085-b96b22ec4abf admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:38.728897 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1142/2281] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:52:38 2022] POST /identity/v3/projects => generated 399 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:52:38.730808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac071b0c-54ee-4b71-9e0d-06189ef9374d admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:38.776906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7131caa4-6843-443c-a085-b96b22ec4abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe334c55af5242a3953782fa62f94e0b'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:38.777610 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7131caa4-6843-443c-a085-b96b22ec4abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe334c55af5242a3953782fa62f94e0b'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:38.786601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7131caa4-6843-443c-a085-b96b22ec4abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe334c55af5242a3953782fa62f94e0b'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:38.787320 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7131caa4-6843-443c-a085-b96b22ec4abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe334c55af5242a3953782fa62f94e0b'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:38.798727 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7131caa4-6843-443c-a085-b96b22ec4abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe334c55af5242a3953782fa62f94e0b'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:38.816607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:38.831027 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac071b0c-54ee-4b71-9e0d-06189ef9374d admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:38.840202 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cd981-aae7-4391-8f93-e14b6463589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:38.841391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cd981-aae7-4391-8f93-e14b6463589a admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:38.841882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cd981-aae7-4391-8f93-e14b6463589a admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:38.842442 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cd981-aae7-4391-8f93-e14b6463589a admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:38.843055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1140/2282] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:52:38 2022] DELETE /identity/v3/users/fe334c55af5242a3953782fa62f94e0b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:52:38.848097 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cd981-aae7-4391-8f93-e14b6463589a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:38.850599 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cd981-aae7-4391-8f93-e14b6463589a admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:38.888833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131caa4-6843-443c-a085-b96b22ec4abf admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:38.891215 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1143/2283] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:52:38 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:52:38.892807 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-7131caa4-6843-443c-a085-b96b22ec4abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:39.007805 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131caa4-6843-443c-a085-b96b22ec4abf admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:39.013513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd21011-2b62-4c2f-8a31-0b279adadc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:39.014432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21011-2b62-4c2f-8a31-0b279adadc7c admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:39.014888 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21011-2b62-4c2f-8a31-0b279adadc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:39.015600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd21011-2b62-4c2f-8a31-0b279adadc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:39.016521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd21011-2b62-4c2f-8a31-0b279adadc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:39.018415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd21011-2b62-4c2f-8a31-0b279adadc7c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:39.032013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1141/2284] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:52:39.036144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cd981-aae7-4391-8f93-e14b6463589a admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:39.046589 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:39.055705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cd981-aae7-4391-8f93-e14b6463589a admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:39.062787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b63aec-384e-46c2-81de-874929ba0a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:39.064584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b63aec-384e-46c2-81de-874929ba0a86 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:39.064977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b63aec-384e-46c2-81de-874929ba0a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:39.065363 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b63aec-384e-46c2-81de-874929ba0a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:39.066462 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b63aec-384e-46c2-81de-874929ba0a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:39.068399 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b63aec-384e-46c2-81de-874929ba0a86 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:39.087883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1144/2285] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:52:39.089284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd21011-2b62-4c2f-8a31-0b279adadc7c admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:39.105227 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd21011-2b62-4c2f-8a31-0b279adadc7c admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:39.118662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b63aec-384e-46c2-81de-874929ba0a86 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:39.121537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-51b63aec-384e-46c2-81de-874929ba0a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:39.125740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9204ca2-1477-4d6e-ba30-6a163c1034a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:39.126470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9204ca2-1477-4d6e-ba30-6a163c1034a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:39.126755 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9204ca2-1477-4d6e-ba30-6a163c1034a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:39.127030 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9204ca2-1477-4d6e-ba30-6a163c1034a0 admin admin] PATH_INFO: `/v3/projects/8d5e7106f82b4a2d95efc95323f83c49/users/47b1be2043474fb6b31972605de5bb63/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:39.140873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b63aec-384e-46c2-81de-874929ba0a86 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:39.149933 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:39.150803 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:39.151192 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:39.151863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] PATH_INFO: `/v3/projects/1fe624adeb854e47bbe86ae6e249d501` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:39.153806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe624adeb854e47bbe86ae6e249d501)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:39.156122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:39.163200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9204ca2-1477-4d6e-ba30-6a163c1034a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5e7106f82b4a2d95efc95323f83c49, user_id=47b1be2043474fb6b31972605de5bb63, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:39.167632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9204ca2-1477-4d6e-ba30-6a163c1034a0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:39.192341 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1142/2286] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:52:39 2022] PUT /identity/v3/projects/8d5e7106f82b4a2d95efc95323f83c49/users/47b1be2043474fb6b31972605de5bb63/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:52:39.207216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da5a5c-b81d-41a3-9410-78bd3043c46c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:39.207836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da5a5c-b81d-41a3-9410-78bd3043c46c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:39.208593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da5a5c-b81d-41a3-9410-78bd3043c46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:39.238953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe624adeb854e47bbe86ae6e249d501', 'request_id': 'req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:39.249073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe624adeb854e47bbe86ae6e249d501', 'request_id': 'req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:39.252248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-21da5a5c-b81d-41a3-9410-78bd3043c46c None None] MFA Rules not processed for user `47b1be2043474fb6b31972605de5bb63`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:39.253906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-21da5a5c-b81d-41a3-9410-78bd3043c46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:39.260624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe624adeb854e47bbe86ae6e249d501', 'request_id': 'req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:39.286620 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] The token cache is being invalidate because project 1fe624adeb854e47bbe86ae6e249d501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:52:39.287178 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:39.288366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:39.291820 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1145/2287] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:52:39 2022] DELETE /identity/v3/projects/1fe624adeb854e47bbe86ae6e249d501 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:52:39.295601 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:39.297957 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:39.344206 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1143/2288] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:52:39.375508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11895d-dc10-4be5-988c-a6d8c22dfbb9 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:39.375761 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da5a5c-b81d-41a3-9410-78bd3043c46c None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:39.377434 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-21da5a5c-b81d-41a3-9410-78bd3043c46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:39.380646 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8270d-5996-43c6-80b3-99a4674ab5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:39.381503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8270d-5996-43c6-80b3-99a4674ab5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:39.381789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8270d-5996-43c6-80b3-99a4674ab5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:39.382058 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8270d-5996-43c6-80b3-99a4674ab5ec admin admin] PATH_INFO: `/v3/users/b10bb9aae76341659c96f25b43d07467` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:39.383344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8270d-5996-43c6-80b3-99a4674ab5ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b10bb9aae76341659c96f25b43d07467)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:39.385340 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8270d-5996-43c6-80b3-99a4674ab5ec admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:39.456345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-92d8270d-5996-43c6-80b3-99a4674ab5ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b10bb9aae76341659c96f25b43d07467'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:39.457031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-92d8270d-5996-43c6-80b3-99a4674ab5ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b10bb9aae76341659c96f25b43d07467'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:39.476614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:39.480228 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-92d8270d-5996-43c6-80b3-99a4674ab5ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b10bb9aae76341659c96f25b43d07467'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:39.485771 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da5a5c-b81d-41a3-9410-78bd3043c46c None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:39.489205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-92d8270d-5996-43c6-80b3-99a4674ab5ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b10bb9aae76341659c96f25b43d07467'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:39.489927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-92d8270d-5996-43c6-80b3-99a4674ab5ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b10bb9aae76341659c96f25b43d07467'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:39.494215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59eab7a-0bea-4776-bb45-d17460ce5930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:39.495688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eab7a-0bea-4776-bb45-d17460ce5930 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:39.496672 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eab7a-0bea-4776-bb45-d17460ce5930 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:39.497072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eab7a-0bea-4776-bb45-d17460ce5930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:39.499803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f59eab7a-0bea-4776-bb45-d17460ce5930 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:39.502951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:39.515975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1146/2289] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:52:39 2022] DELETE /identity/v3/users/b10bb9aae76341659c96f25b43d07467 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:52:39.519956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eab7a-0bea-4776-bb45-d17460ce5930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:39.522010 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eab7a-0bea-4776-bb45-d17460ce5930 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:39.534480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1144/2290] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:52:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:52:39.833618 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8270d-5996-43c6-80b3-99a4674ab5ec admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:39.836389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-92d8270d-5996-43c6-80b3-99a4674ab5ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:39.958453 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8270d-5996-43c6-80b3-99a4674ab5ec admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:39.975765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf3b62-0af8-4749-8b0f-358fcef8d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:39.977354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf3b62-0af8-4749-8b0f-358fcef8d942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:39.977946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf3b62-0af8-4749-8b0f-358fcef8d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:39.978146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf3b62-0af8-4749-8b0f-358fcef8d942 admin admin] PATH_INFO: `/v3/projects/269f63c364a5498cb9a8334a1b415c94` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:39.979996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf3b62-0af8-4749-8b0f-358fcef8d942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=269f63c364a5498cb9a8334a1b415c94)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:39.982516 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf3b62-0af8-4749-8b0f-358fcef8d942 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:40.056270 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c6bf3b62-0af8-4749-8b0f-358fcef8d942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269f63c364a5498cb9a8334a1b415c94', 'request_id': 'req-c6bf3b62-0af8-4749-8b0f-358fcef8d942'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:40.068271 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c6bf3b62-0af8-4749-8b0f-358fcef8d942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269f63c364a5498cb9a8334a1b415c94', 'request_id': 'req-c6bf3b62-0af8-4749-8b0f-358fcef8d942'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:40.077657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c6bf3b62-0af8-4749-8b0f-358fcef8d942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269f63c364a5498cb9a8334a1b415c94', 'request_id': 'req-c6bf3b62-0af8-4749-8b0f-358fcef8d942'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:40.116042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c6bf3b62-0af8-4749-8b0f-358fcef8d942 admin admin] The token cache is being invalidate because project 269f63c364a5498cb9a8334a1b415c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:52:40.116376 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c6bf3b62-0af8-4749-8b0f-358fcef8d942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:40.117688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c6bf3b62-0af8-4749-8b0f-358fcef8d942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:40.119456 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1147/2291] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:52:39 2022] DELETE /identity/v3/projects/269f63c364a5498cb9a8334a1b415c94 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:52:40.125234 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd0a70-0713-4455-8d11-6b7c90f47818 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:40.125860 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd0a70-0713-4455-8d11-6b7c90f47818 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:40.125860 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd0a70-0713-4455-8d11-6b7c90f47818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:40.152022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-cbdd0a70-0713-4455-8d11-6b7c90f47818 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:40.153246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-cbdd0a70-0713-4455-8d11-6b7c90f47818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:40.243707 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1145/2292] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:40.255720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def03c-dd77-48b2-bd16-9eb200e52aa8 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:40.256101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def03c-dd77-48b2-bd16-9eb200e52aa8 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:40.256388 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def03c-dd77-48b2-bd16-9eb200e52aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:40.280428 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-19def03c-dd77-48b2-bd16-9eb200e52aa8 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:40.281821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-19def03c-dd77-48b2-bd16-9eb200e52aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:40.291894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1148/2293] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:40.296030 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd0a70-0713-4455-8d11-6b7c90f47818 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:40.307060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd0a70-0713-4455-8d11-6b7c90f47818 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:40.312192 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd191c-dff8-4891-92ed-af7e8d45fa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:40.313122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd191c-dff8-4891-92ed-af7e8d45fa15 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:40.313510 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd191c-dff8-4891-92ed-af7e8d45fa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:40.313849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd191c-dff8-4891-92ed-af7e8d45fa15 admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:40.314674 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd191c-dff8-4891-92ed-af7e8d45fa15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:52:40.315172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd191c-dff8-4891-92ed-af7e8d45fa15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:40.316918 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd191c-dff8-4891-92ed-af7e8d45fa15 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:40.333516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1146/2294] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:52:40.334709 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19def03c-dd77-48b2-bd16-9eb200e52aa8 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:40.346148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19def03c-dd77-48b2-bd16-9eb200e52aa8 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:40.352260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef114041-81ec-4424-a644-522cc25dac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:40.352990 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef114041-81ec-4424-a644-522cc25dac36 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:40.353279 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef114041-81ec-4424-a644-522cc25dac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:40.353557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef114041-81ec-4424-a644-522cc25dac36 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:40.354265 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef114041-81ec-4424-a644-522cc25dac36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:40.356180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef114041-81ec-4424-a644-522cc25dac36 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:40.389904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1149/2295] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:52:40 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:52:40.394049 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd191c-dff8-4891-92ed-af7e8d45fa15 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:40.405521 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd191c-dff8-4891-92ed-af7e8d45fa15 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:40.466430 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d6ccc-2b68-42bb-ba37-1416ad4857ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:40.467284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d6ccc-2b68-42bb-ba37-1416ad4857ac admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:40.467702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d6ccc-2b68-42bb-ba37-1416ad4857ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:40.468075 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d6ccc-2b68-42bb-ba37-1416ad4857ac admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:40.468858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d6ccc-2b68-42bb-ba37-1416ad4857ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:40.471209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d6ccc-2b68-42bb-ba37-1416ad4857ac admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:40.493765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1147/2296] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:52:40 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:52:40.497677 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef114041-81ec-4424-a644-522cc25dac36 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:40.509274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef114041-81ec-4424-a644-522cc25dac36 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:40.515770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb132f-a5ea-49f4-9fe3-cd2fecce371d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:40.516833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb132f-a5ea-49f4-9fe3-cd2fecce371d admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:40.517354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb132f-a5ea-49f4-9fe3-cd2fecce371d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:40.517676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb132f-a5ea-49f4-9fe3-cd2fecce371d admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:40.518751 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb132f-a5ea-49f4-9fe3-cd2fecce371d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:40.521188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb132f-a5ea-49f4-9fe3-cd2fecce371d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:40.536739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1150/2297] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:52:40.538362 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d6ccc-2b68-42bb-ba37-1416ad4857ac admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:40.552477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d6ccc-2b68-42bb-ba37-1416ad4857ac admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:40.557878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f142b-7e3c-4115-8d46-7a2880f10fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:40.558543 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f142b-7e3c-4115-8d46-7a2880f10fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:40.558835 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f142b-7e3c-4115-8d46-7a2880f10fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:40.559243 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f142b-7e3c-4115-8d46-7a2880f10fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:40.560031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f142b-7e3c-4115-8d46-7a2880f10fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:40.561724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f142b-7e3c-4115-8d46-7a2880f10fb7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:40.575133 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1148/2298] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:52:40.579526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb132f-a5ea-49f4-9fe3-cd2fecce371d admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:40.591521 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb132f-a5ea-49f4-9fe3-cd2fecce371d admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:40.596324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eae182-297e-4b6f-ad42-728114de04a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:40.597005 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eae182-297e-4b6f-ad42-728114de04a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:40.597292 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eae182-297e-4b6f-ad42-728114de04a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:40.597712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eae182-297e-4b6f-ad42-728114de04a2 admin admin] PATH_INFO: `/v3/projects/4b63abbf93e74f4fb578e1cb3c553a5f/users/2ab41174efdb4e71902d2580ef21e167/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:40.619098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eae182-297e-4b6f-ad42-728114de04a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b63abbf93e74f4fb578e1cb3c553a5f, user_id=2ab41174efdb4e71902d2580ef21e167, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:40.621809 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eae182-297e-4b6f-ad42-728114de04a2 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:40.645099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1151/2299] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:52:40 2022] PUT /identity/v3/projects/4b63abbf93e74f4fb578e1cb3c553a5f/users/2ab41174efdb4e71902d2580ef21e167/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:52:40.655728 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8dd8-a69d-4b70-b7a0-ed6c04e7da49 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:40.656289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8dd8-a69d-4b70-b7a0-ed6c04e7da49 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:40.656883 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8dd8-a69d-4b70-b7a0-ed6c04e7da49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:40.697253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-5aad8dd8-a69d-4b70-b7a0-ed6c04e7da49 None None] MFA Rules not processed for user `2ab41174efdb4e71902d2580ef21e167`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:40.698513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5aad8dd8-a69d-4b70-b7a0-ed6c04e7da49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:40.790482 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:40.826305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1149/2300] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:40.838614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eae182-297e-4b6f-ad42-728114de04a2 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:40.840801 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-e0eae182-297e-4b6f-ad42-728114de04a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:40.866250 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:40.944398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eae182-297e-4b6f-ad42-728114de04a2 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:40.949460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082769e-6521-4980-b840-b4dd3a47f8e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:40.950116 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082769e-6521-4980-b840-b4dd3a47f8e4 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:40.950438 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082769e-6521-4980-b840-b4dd3a47f8e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:40.950718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082769e-6521-4980-b840-b4dd3a47f8e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:40.962041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082769e-6521-4980-b840-b4dd3a47f8e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:40.963787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082769e-6521-4980-b840-b4dd3a47f8e4 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:40.975348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1152/2301] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:52:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:52:41.002059 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8dd8-a69d-4b70-b7a0-ed6c04e7da49 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:41.083931 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8dd8-a69d-4b70-b7a0-ed6c04e7da49 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:41.089206 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab9fbf-4235-4972-a16e-72d8a57a1c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:41.089881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab9fbf-4235-4972-a16e-72d8a57a1c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:41.090168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab9fbf-4235-4972-a16e-72d8a57a1c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:41.090487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab9fbf-4235-4972-a16e-72d8a57a1c7b admin admin] PATH_INFO: `/v3/users/2ab41174efdb4e71902d2580ef21e167` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:41.091761 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab9fbf-4235-4972-a16e-72d8a57a1c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab41174efdb4e71902d2580ef21e167)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:41.093754 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab9fbf-4235-4972-a16e-72d8a57a1c7b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:41.183828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b4ab9fbf-4235-4972-a16e-72d8a57a1c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab41174efdb4e71902d2580ef21e167'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:41.184582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b4ab9fbf-4235-4972-a16e-72d8a57a1c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab41174efdb4e71902d2580ef21e167'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:41.192667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b4ab9fbf-4235-4972-a16e-72d8a57a1c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab41174efdb4e71902d2580ef21e167'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:41.196621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b4ab9fbf-4235-4972-a16e-72d8a57a1c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab41174efdb4e71902d2580ef21e167'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:41.208310 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b4ab9fbf-4235-4972-a16e-72d8a57a1c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab41174efdb4e71902d2580ef21e167'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:41.241074 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1150/2302] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:52:41 2022] DELETE /identity/v3/users/2ab41174efdb4e71902d2580ef21e167 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:52:41.246614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34faa35-30f4-432f-9c32-f1f230cc4203 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:41.246939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34faa35-30f4-432f-9c32-f1f230cc4203 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:41.247220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34faa35-30f4-432f-9c32-f1f230cc4203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:41.271857 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-c34faa35-30f4-432f-9c32-f1f230cc4203 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:41.273362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c34faa35-30f4-432f-9c32-f1f230cc4203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:41.366425 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1153/2303] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:41.377029 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab9fbf-4235-4972-a16e-72d8a57a1c7b admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:41.379123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b4ab9fbf-4235-4972-a16e-72d8a57a1c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:41.490910 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab9fbf-4235-4972-a16e-72d8a57a1c7b admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:41.498125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ce2ce-e5ae-429d-905f-dce3cf734309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:41.499340 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ce2ce-e5ae-429d-905f-dce3cf734309 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:41.499802 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ce2ce-e5ae-429d-905f-dce3cf734309 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:41.500151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ce2ce-e5ae-429d-905f-dce3cf734309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:41.514582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ce2ce-e5ae-429d-905f-dce3cf734309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:41.516563 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ce2ce-e5ae-429d-905f-dce3cf734309 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:41.542590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1151/2304] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:52:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:52:41.863946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34faa35-30f4-432f-9c32-f1f230cc4203 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:41.866116 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c34faa35-30f4-432f-9c32-f1f230cc4203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:41.888735 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34faa35-30f4-432f-9c32-f1f230cc4203 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:41.900742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92a7f2-c9bc-448d-8e9a-20085261f431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:41.901144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92a7f2-c9bc-448d-8e9a-20085261f431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:41.901403 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92a7f2-c9bc-448d-8e9a-20085261f431 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:41.901681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92a7f2-c9bc-448d-8e9a-20085261f431 admin admin] PATH_INFO: `/v3/projects/4b63abbf93e74f4fb578e1cb3c553a5f` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:41.903166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92a7f2-c9bc-448d-8e9a-20085261f431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b63abbf93e74f4fb578e1cb3c553a5f)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:41.905360 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92a7f2-c9bc-448d-8e9a-20085261f431 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:41.968294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2a92a7f2-c9bc-448d-8e9a-20085261f431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b63abbf93e74f4fb578e1cb3c553a5f', 'request_id': 'req-2a92a7f2-c9bc-448d-8e9a-20085261f431'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:41.975319 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2a92a7f2-c9bc-448d-8e9a-20085261f431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b63abbf93e74f4fb578e1cb3c553a5f', 'request_id': 'req-2a92a7f2-c9bc-448d-8e9a-20085261f431'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:41.981687 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2a92a7f2-c9bc-448d-8e9a-20085261f431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b63abbf93e74f4fb578e1cb3c553a5f', 'request_id': 'req-2a92a7f2-c9bc-448d-8e9a-20085261f431'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:41.996345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2a92a7f2-c9bc-448d-8e9a-20085261f431 admin admin] The token cache is being invalidate because project 4b63abbf93e74f4fb578e1cb3c553a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:52:41.996635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2a92a7f2-c9bc-448d-8e9a-20085261f431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:41.997295 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2a92a7f2-c9bc-448d-8e9a-20085261f431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:41.998870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1154/2305] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:52:41 2022] DELETE /identity/v3/projects/4b63abbf93e74f4fb578e1cb3c553a5f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:52:42.004927 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154c8bd-1359-4da2-84f4-22ff94965075 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:42.005212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154c8bd-1359-4da2-84f4-22ff94965075 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:42.005489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154c8bd-1359-4da2-84f4-22ff94965075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:42.027495 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-7154c8bd-1359-4da2-84f4-22ff94965075 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:42.028686 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-7154c8bd-1359-4da2-84f4-22ff94965075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:42.033173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:42.099655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1152/2306] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:42.107553 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356522e3-e4b7-4412-9a08-2018c450eb47 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:42.107842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356522e3-e4b7-4412-9a08-2018c450eb47 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:42.108119 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356522e3-e4b7-4412-9a08-2018c450eb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:42.129212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-356522e3-e4b7-4412-9a08-2018c450eb47 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:42.130465 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-356522e3-e4b7-4412-9a08-2018c450eb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:42.139458 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1155/2307] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:42.144157 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154c8bd-1359-4da2-84f4-22ff94965075 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:42.154053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154c8bd-1359-4da2-84f4-22ff94965075 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:42.158694 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1b97c-788e-48de-b70b-15336505a6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:42.159296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1b97c-788e-48de-b70b-15336505a6bc admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:42.159578 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1b97c-788e-48de-b70b-15336505a6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:42.159851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1b97c-788e-48de-b70b-15336505a6bc admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:42.160576 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1b97c-788e-48de-b70b-15336505a6bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:52:42.160876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1b97c-788e-48de-b70b-15336505a6bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:42.162504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1b97c-788e-48de-b70b-15336505a6bc admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:42.174250 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1153/2308] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:52:42.179549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356522e3-e4b7-4412-9a08-2018c450eb47 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:42.189329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356522e3-e4b7-4412-9a08-2018c450eb47 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:42.194010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254d5f8-1fb1-46ce-89c9-370a7303e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:42.195427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254d5f8-1fb1-46ce-89c9-370a7303e4ba admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:42.195726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254d5f8-1fb1-46ce-89c9-370a7303e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:42.195999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254d5f8-1fb1-46ce-89c9-370a7303e4ba admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:42.196669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254d5f8-1fb1-46ce-89c9-370a7303e4ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:42.198616 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254d5f8-1fb1-46ce-89c9-370a7303e4ba admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:42.226860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1156/2309] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:52:42 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:52:42.231348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1b97c-788e-48de-b70b-15336505a6bc admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:42.242985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1b97c-788e-48de-b70b-15336505a6bc admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:42.302645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b20df7-e00f-4921-b2a1-e954bda5347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:42.303489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20df7-e00f-4921-b2a1-e954bda5347a admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:42.304926 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20df7-e00f-4921-b2a1-e954bda5347a admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:42.305398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20df7-e00f-4921-b2a1-e954bda5347a admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:42.306242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20df7-e00f-4921-b2a1-e954bda5347a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:42.308261 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20df7-e00f-4921-b2a1-e954bda5347a admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:42.331861 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1154/2310] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:52:42 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:52:42.336437 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254d5f8-1fb1-46ce-89c9-370a7303e4ba admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:42.347352 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254d5f8-1fb1-46ce-89c9-370a7303e4ba admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:42.352856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572c753-db54-4d42-9d95-cb4e708980d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:42.353365 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c753-db54-4d42-9d95-cb4e708980d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:42.353652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c753-db54-4d42-9d95-cb4e708980d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:42.353933 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572c753-db54-4d42-9d95-cb4e708980d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:42.354681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572c753-db54-4d42-9d95-cb4e708980d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:42.356309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572c753-db54-4d42-9d95-cb4e708980d2 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:42.367386 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1157/2311] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:52:42.371988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b20df7-e00f-4921-b2a1-e954bda5347a admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:42.382441 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b20df7-e00f-4921-b2a1-e954bda5347a admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:42.387191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7412c2-69b0-4f51-af2a-a20eb4786de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:42.387812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7412c2-69b0-4f51-af2a-a20eb4786de1 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:42.388100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7412c2-69b0-4f51-af2a-a20eb4786de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:42.388385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7412c2-69b0-4f51-af2a-a20eb4786de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:42.389124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7412c2-69b0-4f51-af2a-a20eb4786de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:42.390875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7412c2-69b0-4f51-af2a-a20eb4786de1 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:42.401930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1155/2312] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:52:42.406458 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572c753-db54-4d42-9d95-cb4e708980d2 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:42.418987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572c753-db54-4d42-9d95-cb4e708980d2 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:42.423755 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc40ee-5e57-472c-826b-29dacdc770b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:42.424429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc40ee-5e57-472c-826b-29dacdc770b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:42.424705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc40ee-5e57-472c-826b-29dacdc770b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:42.425078 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc40ee-5e57-472c-826b-29dacdc770b4 admin admin] PATH_INFO: `/v3/projects/1233d47cc83a4f2ba6fa9acee60b7254/users/626d2b1519574391b681877fe64842b4/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:42.427513 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:42.444274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc40ee-5e57-472c-826b-29dacdc770b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1233d47cc83a4f2ba6fa9acee60b7254, user_id=626d2b1519574391b681877fe64842b4, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:42.447048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc40ee-5e57-472c-826b-29dacdc770b4 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:42.459710 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1158/2313] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:52:42 2022] PUT /identity/v3/projects/1233d47cc83a4f2ba6fa9acee60b7254/users/626d2b1519574391b681877fe64842b4/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:52:42.471972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320887c8-3542-4878-97dc-95b8d0fe6ed7 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:42.472263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320887c8-3542-4878-97dc-95b8d0fe6ed7 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:42.472546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320887c8-3542-4878-97dc-95b8d0fe6ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:42.501949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-320887c8-3542-4878-97dc-95b8d0fe6ed7 None None] MFA Rules not processed for user `626d2b1519574391b681877fe64842b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:42.503216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-320887c8-3542-4878-97dc-95b8d0fe6ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:42.574150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1156/2314] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:52:42.586011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc40ee-5e57-472c-826b-29dacdc770b4 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:42.588085 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-cabc40ee-5e57-472c-826b-29dacdc770b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:42.649629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc40ee-5e57-472c-826b-29dacdc770b4 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:42.653417 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f03a2-7c83-497d-bfb7-f55cb3b186a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:42.653912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f03a2-7c83-497d-bfb7-f55cb3b186a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:42.654221 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f03a2-7c83-497d-bfb7-f55cb3b186a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:42.654547 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f03a2-7c83-497d-bfb7-f55cb3b186a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:42.663428 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f03a2-7c83-497d-bfb7-f55cb3b186a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:42.664834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f03a2-7c83-497d-bfb7-f55cb3b186a7 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:42.673929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1159/2315] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:52:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:52:42.899556 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ba40-683a-4979-8ca7-21ca46240d3b None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:42.900009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ba40-683a-4979-8ca7-21ca46240d3b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:42.900320 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ba40-683a-4979-8ca7-21ca46240d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:42.910026 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:42.922684 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-dba4ba40-683a-4979-8ca7-21ca46240d3b None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:42.923917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-dba4ba40-683a-4979-8ca7-21ca46240d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:42.985528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1157/2316] 10.222.0.43 () {58 vars in 967 bytes} [Wed Jul 27 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:43.010868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f03a2-7c83-497d-bfb7-f55cb3b186a7 service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:43.010868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6c6f03a2-7c83-497d-bfb7-f55cb3b186a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:43.083580 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f03a2-7c83-497d-bfb7-f55cb3b186a7 service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:43.088771 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8a01b-bf35-4e63-bb46-60732a9440bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:43.089389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8a01b-bf35-4e63-bb46-60732a9440bc service swift] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:43.089669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8a01b-bf35-4e63-bb46-60732a9440bc service swift] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:43.089943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8a01b-bf35-4e63-bb46-60732a9440bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:43.099655 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8a01b-bf35-4e63-bb46-60732a9440bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:43.102475 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8a01b-bf35-4e63-bb46-60732a9440bc service swift] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:43.111676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1160/2317] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 10:52:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 10:52:44.877293 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4ba40-683a-4979-8ca7-21ca46240d3b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:44.879096 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-dba4ba40-683a-4979-8ca7-21ca46240d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:44.957854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4ba40-683a-4979-8ca7-21ca46240d3b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:44.963550 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedab3d-e412-4f2a-ab0f-695b078a9215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:44.964209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedab3d-e412-4f2a-ab0f-695b078a9215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:44.964493 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedab3d-e412-4f2a-ab0f-695b078a9215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:44.964772 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fedab3d-e412-4f2a-ab0f-695b078a9215 admin admin] PATH_INFO: `/v3/users/47b1be2043474fb6b31972605de5bb63` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:44.965982 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedab3d-e412-4f2a-ab0f-695b078a9215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b1be2043474fb6b31972605de5bb63)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:44.967954 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fedab3d-e412-4f2a-ab0f-695b078a9215 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:45.021262 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-6fedab3d-e412-4f2a-ab0f-695b078a9215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b1be2043474fb6b31972605de5bb63'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.021987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-6fedab3d-e412-4f2a-ab0f-695b078a9215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b1be2043474fb6b31972605de5bb63'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.030313 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-6fedab3d-e412-4f2a-ab0f-695b078a9215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b1be2043474fb6b31972605de5bb63'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.031025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-6fedab3d-e412-4f2a-ab0f-695b078a9215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b1be2043474fb6b31972605de5bb63'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.048064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-6fedab3d-e412-4f2a-ab0f-695b078a9215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b1be2043474fb6b31972605de5bb63'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.074871 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1158/2318] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:52:44 2022] DELETE /identity/v3/users/47b1be2043474fb6b31972605de5bb63 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:52:45.079450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43791f65-f5e7-4d85-92da-7e92c44e554c None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:45.079988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43791f65-f5e7-4d85-92da-7e92c44e554c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:45.079988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43791f65-f5e7-4d85-92da-7e92c44e554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:45.104149 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedab3d-e412-4f2a-ab0f-695b078a9215 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:45.105646 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6fedab3d-e412-4f2a-ab0f-695b078a9215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:45.107705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-43791f65-f5e7-4d85-92da-7e92c44e554c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:45.109367 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-43791f65-f5e7-4d85-92da-7e92c44e554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:45.140692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:45.183110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1161/2319] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:45.184143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fedab3d-e412-4f2a-ab0f-695b078a9215 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:45.189209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212909b-71af-40db-b6a6-15bb6e9cd13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:45.189857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212909b-71af-40db-b6a6-15bb6e9cd13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:45.190138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212909b-71af-40db-b6a6-15bb6e9cd13c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:45.190446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212909b-71af-40db-b6a6-15bb6e9cd13c admin admin] PATH_INFO: `/v3/users/7580bb98324b491e96934d89d5bdfc63` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:45.191693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212909b-71af-40db-b6a6-15bb6e9cd13c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7580bb98324b491e96934d89d5bdfc63)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:45.193335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43791f65-f5e7-4d85-92da-7e92c44e554c None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:45.193633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212909b-71af-40db-b6a6-15bb6e9cd13c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:45.196101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-43791f65-f5e7-4d85-92da-7e92c44e554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:45.218353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:45.246730 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7212909b-71af-40db-b6a6-15bb6e9cd13c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7580bb98324b491e96934d89d5bdfc63'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.247413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7212909b-71af-40db-b6a6-15bb6e9cd13c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7580bb98324b491e96934d89d5bdfc63'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.254669 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7212909b-71af-40db-b6a6-15bb6e9cd13c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7580bb98324b491e96934d89d5bdfc63'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.255337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7212909b-71af-40db-b6a6-15bb6e9cd13c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7580bb98324b491e96934d89d5bdfc63'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.263613 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43791f65-f5e7-4d85-92da-7e92c44e554c None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:45.264091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7212909b-71af-40db-b6a6-15bb6e9cd13c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7580bb98324b491e96934d89d5bdfc63'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.267849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65e268-7119-4291-838b-6bd9e2ca7fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:45.268476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65e268-7119-4291-838b-6bd9e2ca7fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:45.268758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65e268-7119-4291-838b-6bd9e2ca7fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:45.269028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65e268-7119-4291-838b-6bd9e2ca7fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:45.270804 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-be65e268-7119-4291-838b-6bd9e2ca7fb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:45.283796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1159/2320] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:52:45 2022] DELETE /identity/v3/users/7580bb98324b491e96934d89d5bdfc63 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:52:45.284560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65e268-7119-4291-838b-6bd9e2ca7fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:45.286146 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65e268-7119-4291-838b-6bd9e2ca7fb9 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:45.297018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1162/2321] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:52:45.486942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212909b-71af-40db-b6a6-15bb6e9cd13c admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:45.488528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-7212909b-71af-40db-b6a6-15bb6e9cd13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:45.562365 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212909b-71af-40db-b6a6-15bb6e9cd13c admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:45.567174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5af1e1-83c0-4612-a2c1-735ef168bd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:45.567896 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5af1e1-83c0-4612-a2c1-735ef168bd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:45.568248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5af1e1-83c0-4612-a2c1-735ef168bd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:45.568591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5af1e1-83c0-4612-a2c1-735ef168bd44 admin admin] PATH_INFO: `/v3/projects/63f533e19f0b469585feb1d7ee77db20` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:45.570314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5af1e1-83c0-4612-a2c1-735ef168bd44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f533e19f0b469585feb1d7ee77db20)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:45.572025 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5af1e1-83c0-4612-a2c1-735ef168bd44 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:45.630056 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ca5af1e1-83c0-4612-a2c1-735ef168bd44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f533e19f0b469585feb1d7ee77db20', 'request_id': 'req-ca5af1e1-83c0-4612-a2c1-735ef168bd44'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.631278 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:45.638451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65e268-7119-4291-838b-6bd9e2ca7fb9 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:45.640521 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-be65e268-7119-4291-838b-6bd9e2ca7fb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:45.642742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ca5af1e1-83c0-4612-a2c1-735ef168bd44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f533e19f0b469585feb1d7ee77db20', 'request_id': 'req-ca5af1e1-83c0-4612-a2c1-735ef168bd44'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.657296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ca5af1e1-83c0-4612-a2c1-735ef168bd44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f533e19f0b469585feb1d7ee77db20', 'request_id': 'req-ca5af1e1-83c0-4612-a2c1-735ef168bd44'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.657662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65e268-7119-4291-838b-6bd9e2ca7fb9 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:45.678272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ca5af1e1-83c0-4612-a2c1-735ef168bd44 admin admin] The token cache is being invalidate because project 63f533e19f0b469585feb1d7ee77db20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:52:45.678930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ca5af1e1-83c0-4612-a2c1-735ef168bd44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.681504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ca5af1e1-83c0-4612-a2c1-735ef168bd44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.683641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1160/2322] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:52:45 2022] DELETE /identity/v3/projects/63f533e19f0b469585feb1d7ee77db20 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:52:45.688753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb1ca7-6956-4c4a-a196-cae74991145c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:45.689742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb1ca7-6956-4c4a-a196-cae74991145c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:45.690130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb1ca7-6956-4c4a-a196-cae74991145c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:45.713401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-d5cb1ca7-6956-4c4a-a196-cae74991145c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:45.714632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d5cb1ca7-6956-4c4a-a196-cae74991145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:45.727975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afb3b3-fe33-4642-820f-21215c3ff6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:45.728631 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afb3b3-fe33-4642-820f-21215c3ff6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:45.728907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afb3b3-fe33-4642-820f-21215c3ff6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:45.729596 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afb3b3-fe33-4642-820f-21215c3ff6ce admin admin] PATH_INFO: `/v3/projects/8d5e7106f82b4a2d95efc95323f83c49` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:45.730624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afb3b3-fe33-4642-820f-21215c3ff6ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d5e7106f82b4a2d95efc95323f83c49)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:45.732577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afb3b3-fe33-4642-820f-21215c3ff6ce admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:45.787405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1161/2323] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:45.788144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-68afb3b3-fe33-4642-820f-21215c3ff6ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d5e7106f82b4a2d95efc95323f83c49', 'request_id': 'req-68afb3b3-fe33-4642-820f-21215c3ff6ce'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.795256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746796a3-4583-4975-ad02-c0b2fb4e4dc1 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:45.795516 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-68afb3b3-fe33-4642-820f-21215c3ff6ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d5e7106f82b4a2d95efc95323f83c49', 'request_id': 'req-68afb3b3-fe33-4642-820f-21215c3ff6ce'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.795766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746796a3-4583-4975-ad02-c0b2fb4e4dc1 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:45.796303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746796a3-4583-4975-ad02-c0b2fb4e4dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:45.801576 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-68afb3b3-fe33-4642-820f-21215c3ff6ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d5e7106f82b4a2d95efc95323f83c49', 'request_id': 'req-68afb3b3-fe33-4642-820f-21215c3ff6ce'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.821950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-68afb3b3-fe33-4642-820f-21215c3ff6ce admin admin] The token cache is being invalidate because project 8d5e7106f82b4a2d95efc95323f83c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:52:45.822575 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-68afb3b3-fe33-4642-820f-21215c3ff6ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.823280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-68afb3b3-fe33-4642-820f-21215c3ff6ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:45.824214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-746796a3-4583-4975-ad02-c0b2fb4e4dc1 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:45.825080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1163/2324] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:52:45 2022] DELETE /identity/v3/projects/8d5e7106f82b4a2d95efc95323f83c49 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:52:45.825740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-746796a3-4583-4975-ad02-c0b2fb4e4dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:45.930630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1162/2325] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:52:45.935345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afb3b3-fe33-4642-820f-21215c3ff6ce admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:45.953589 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afb3b3-fe33-4642-820f-21215c3ff6ce admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:45.959486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b2807-7e2b-4317-9b2b-6bcdd2de5708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:45.960889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b2807-7e2b-4317-9b2b-6bcdd2de5708 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:45.961289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b2807-7e2b-4317-9b2b-6bcdd2de5708 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:45.961645 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b2807-7e2b-4317-9b2b-6bcdd2de5708 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:45.962505 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b2807-7e2b-4317-9b2b-6bcdd2de5708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:52:45.962893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b2807-7e2b-4317-9b2b-6bcdd2de5708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:45.964722 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b2807-7e2b-4317-9b2b-6bcdd2de5708 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:45.984460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1164/2326] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:52:45.986519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746796a3-4583-4975-ad02-c0b2fb4e4dc1 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:45.996901 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746796a3-4583-4975-ad02-c0b2fb4e4dc1 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:46.002354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a0cad-6f6a-4c8b-9691-650371e8f692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:46.003006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a0cad-6f6a-4c8b-9691-650371e8f692 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:46.003389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a0cad-6f6a-4c8b-9691-650371e8f692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:46.003561 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a0cad-6f6a-4c8b-9691-650371e8f692 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:46.004355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a0cad-6f6a-4c8b-9691-650371e8f692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:46.006180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a0cad-6f6a-4c8b-9691-650371e8f692 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:46.040183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1163/2327] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:52:45 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:52:46.044451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b2807-7e2b-4317-9b2b-6bcdd2de5708 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:46.057126 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b2807-7e2b-4317-9b2b-6bcdd2de5708 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:46.092040 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:46.119785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c7186-8251-4e7e-8aba-6648c6ade43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:46.120410 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c7186-8251-4e7e-8aba-6648c6ade43d admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:46.120696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c7186-8251-4e7e-8aba-6648c6ade43d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:46.120974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c7186-8251-4e7e-8aba-6648c6ade43d admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:46.121643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c7186-8251-4e7e-8aba-6648c6ade43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:46.123607 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c7186-8251-4e7e-8aba-6648c6ade43d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:46.145094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1165/2328] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:52:46 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:52:46.149393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a0cad-6f6a-4c8b-9691-650371e8f692 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:46.159939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a0cad-6f6a-4c8b-9691-650371e8f692 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:46.165076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c00ee-ed3f-4de7-8034-c40cb7e53d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:46.165712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c00ee-ed3f-4de7-8034-c40cb7e53d2a admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:46.166020 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c00ee-ed3f-4de7-8034-c40cb7e53d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:46.166332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c00ee-ed3f-4de7-8034-c40cb7e53d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:46.167037 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c00ee-ed3f-4de7-8034-c40cb7e53d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:46.168619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c00ee-ed3f-4de7-8034-c40cb7e53d2a admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:46.179586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1164/2329] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:52:46.183481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c7186-8251-4e7e-8aba-6648c6ade43d admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:46.193859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c7186-8251-4e7e-8aba-6648c6ade43d admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:46.198524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbee17-4322-4157-82a7-2a64caf460a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:46.199138 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbee17-4322-4157-82a7-2a64caf460a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:46.199422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbee17-4322-4157-82a7-2a64caf460a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:46.199702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbee17-4322-4157-82a7-2a64caf460a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:46.200400 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbee17-4322-4157-82a7-2a64caf460a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:46.202084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbee17-4322-4157-82a7-2a64caf460a1 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:46.212268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1166/2330] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:52:46.216692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c00ee-ed3f-4de7-8034-c40cb7e53d2a admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:46.227238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c00ee-ed3f-4de7-8034-c40cb7e53d2a admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:46.232054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88bb1a-ebd6-415b-8302-8abe9cf183f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:46.232714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88bb1a-ebd6-415b-8302-8abe9cf183f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:46.232999 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88bb1a-ebd6-415b-8302-8abe9cf183f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:46.233279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88bb1a-ebd6-415b-8302-8abe9cf183f7 admin admin] PATH_INFO: `/v3/projects/39b3e31207ad40c3804b55abcb5ef631/users/892b25819bb94fa9bfd7bb990b4ee762/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:46.248580 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88bb1a-ebd6-415b-8302-8abe9cf183f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b3e31207ad40c3804b55abcb5ef631, user_id=892b25819bb94fa9bfd7bb990b4ee762, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:46.251285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88bb1a-ebd6-415b-8302-8abe9cf183f7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:46.264989 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1165/2331] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:52:46 2022] PUT /identity/v3/projects/39b3e31207ad40c3804b55abcb5ef631/users/892b25819bb94fa9bfd7bb990b4ee762/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:52:46.276205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfba0f-dd2f-4a0c-b366-e1cbfc696ac0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:46.276491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfba0f-dd2f-4a0c-b366-e1cbfc696ac0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:46.276790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfba0f-dd2f-4a0c-b366-e1cbfc696ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:46.307495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-badfba0f-dd2f-4a0c-b366-e1cbfc696ac0 None None] MFA Rules not processed for user `892b25819bb94fa9bfd7bb990b4ee762`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:46.308703 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-badfba0f-dd2f-4a0c-b366-e1cbfc696ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:46.376004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1167/2332] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:46.387687 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88bb1a-ebd6-415b-8302-8abe9cf183f7 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:46.389424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-de88bb1a-ebd6-415b-8302-8abe9cf183f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:46.417518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:46.451683 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88bb1a-ebd6-415b-8302-8abe9cf183f7 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:46.455472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bece6-eff9-409b-b442-56efeee10ff1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4e81eb81934784b8632248ecf0894f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:46.456096 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bece6-eff9-409b-b442-56efeee10ff1 service glance] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:46.456382 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bece6-eff9-409b-b442-56efeee10ff1 service glance] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:46.456663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bece6-eff9-409b-b442-56efeee10ff1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:46.465988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bece6-eff9-409b-b442-56efeee10ff1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:46.467513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bece6-eff9-409b-b442-56efeee10ff1 service glance] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:46.477394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1166/2333] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:52:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:52:53.114003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfba0f-dd2f-4a0c-b366-e1cbfc696ac0 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:53.116057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-badfba0f-dd2f-4a0c-b366-e1cbfc696ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:53.194388 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfba0f-dd2f-4a0c-b366-e1cbfc696ac0 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:53.199287 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289972c7-5c4e-43b4-bdff-3e47f1b7ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:53.199975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289972c7-5c4e-43b4-bdff-3e47f1b7ece5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:53.200293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289972c7-5c4e-43b4-bdff-3e47f1b7ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:53.200571 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289972c7-5c4e-43b4-bdff-3e47f1b7ece5 admin admin] PATH_INFO: `/v3/users/626d2b1519574391b681877fe64842b4` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:53.201920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289972c7-5c4e-43b4-bdff-3e47f1b7ece5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=626d2b1519574391b681877fe64842b4)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:53.203930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289972c7-5c4e-43b4-bdff-3e47f1b7ece5 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:53.252165 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:53.254311 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-289972c7-5c4e-43b4-bdff-3e47f1b7ece5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '626d2b1519574391b681877fe64842b4'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:53.255153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-289972c7-5c4e-43b4-bdff-3e47f1b7ece5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '626d2b1519574391b681877fe64842b4'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:53.268517 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-289972c7-5c4e-43b4-bdff-3e47f1b7ece5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '626d2b1519574391b681877fe64842b4'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:53.281142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-289972c7-5c4e-43b4-bdff-3e47f1b7ece5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '626d2b1519574391b681877fe64842b4'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:53.281954 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-289972c7-5c4e-43b4-bdff-3e47f1b7ece5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '626d2b1519574391b681877fe64842b4'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:53.300999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1168/2334] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:52:53 2022] DELETE /identity/v3/users/626d2b1519574391b681877fe64842b4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:52:53.305923 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101d75d-f219-400c-b877-94cabad4a1c3 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:53.306554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101d75d-f219-400c-b877-94cabad4a1c3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:53.306692 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101d75d-f219-400c-b877-94cabad4a1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:53.326216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-d101d75d-f219-400c-b877-94cabad4a1c3 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:53.327437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d101d75d-f219-400c-b877-94cabad4a1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:53.390336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1167/2335] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:53.403642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289972c7-5c4e-43b4-bdff-3e47f1b7ece5 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:53.405123 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-289972c7-5c4e-43b4-bdff-3e47f1b7ece5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:53.469752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289972c7-5c4e-43b4-bdff-3e47f1b7ece5 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:53.473401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0494fcb-f481-4eca-b19b-6bbff3e9085f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:53.474035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0494fcb-f481-4eca-b19b-6bbff3e9085f service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:53.474361 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0494fcb-f481-4eca-b19b-6bbff3e9085f service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:53.474644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0494fcb-f481-4eca-b19b-6bbff3e9085f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:53.484600 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0494fcb-f481-4eca-b19b-6bbff3e9085f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:53.486055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0494fcb-f481-4eca-b19b-6bbff3e9085f service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:53.496364 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1169/2336] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:52:53.783482 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101d75d-f219-400c-b877-94cabad4a1c3 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:53.785227 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d101d75d-f219-400c-b877-94cabad4a1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:53.798078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101d75d-f219-400c-b877-94cabad4a1c3 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:53.802760 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c495ed-e71d-4e85-ab8f-25a85c844029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:53.803935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c495ed-e71d-4e85-ab8f-25a85c844029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:53.804223 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c495ed-e71d-4e85-ab8f-25a85c844029 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:53.804499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c495ed-e71d-4e85-ab8f-25a85c844029 admin admin] PATH_INFO: `/v3/projects/1233d47cc83a4f2ba6fa9acee60b7254` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:53.805697 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c495ed-e71d-4e85-ab8f-25a85c844029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1233d47cc83a4f2ba6fa9acee60b7254)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:53.807651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c495ed-e71d-4e85-ab8f-25a85c844029 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:53.857557 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-55c495ed-e71d-4e85-ab8f-25a85c844029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1233d47cc83a4f2ba6fa9acee60b7254', 'request_id': 'req-55c495ed-e71d-4e85-ab8f-25a85c844029'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:53.867093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-55c495ed-e71d-4e85-ab8f-25a85c844029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1233d47cc83a4f2ba6fa9acee60b7254', 'request_id': 'req-55c495ed-e71d-4e85-ab8f-25a85c844029'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:53.880370 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-55c495ed-e71d-4e85-ab8f-25a85c844029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1233d47cc83a4f2ba6fa9acee60b7254', 'request_id': 'req-55c495ed-e71d-4e85-ab8f-25a85c844029'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:53.892641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-55c495ed-e71d-4e85-ab8f-25a85c844029 admin admin] The token cache is being invalidate because project 1233d47cc83a4f2ba6fa9acee60b7254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:52:53.893000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-55c495ed-e71d-4e85-ab8f-25a85c844029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:53.893659 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-55c495ed-e71d-4e85-ab8f-25a85c844029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:52:53.895465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1168/2337] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:52:53 2022] DELETE /identity/v3/projects/1233d47cc83a4f2ba6fa9acee60b7254 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:52:53.900273 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1b3c5-1400-4bca-8711-bd86176ee677 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:53.900566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1b3c5-1400-4bca-8711-bd86176ee677 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:53.900848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1b3c5-1400-4bca-8711-bd86176ee677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:53.920758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-05d1b3c5-1400-4bca-8711-bd86176ee677 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:53.921963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-05d1b3c5-1400-4bca-8711-bd86176ee677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:53.988229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1170/2338] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:53.999794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7922eb1-bfb5-43ec-95c5-994dbff93639 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:54.000174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7922eb1-bfb5-43ec-95c5-994dbff93639 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:54.000567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7922eb1-bfb5-43ec-95c5-994dbff93639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:54.021408 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-c7922eb1-bfb5-43ec-95c5-994dbff93639 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:54.023315 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c7922eb1-bfb5-43ec-95c5-994dbff93639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:54.031396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1169/2339] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:52:54.036996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1b3c5-1400-4bca-8711-bd86176ee677 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:54.048626 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1b3c5-1400-4bca-8711-bd86176ee677 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:54.053298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aac07-0c66-4fb0-9009-a38cbf2fd621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:54.054298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aac07-0c66-4fb0-9009-a38cbf2fd621 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:54.054582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aac07-0c66-4fb0-9009-a38cbf2fd621 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:54.054855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aac07-0c66-4fb0-9009-a38cbf2fd621 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:54.055552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976aac07-0c66-4fb0-9009-a38cbf2fd621 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:52:54.055855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976aac07-0c66-4fb0-9009-a38cbf2fd621 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:54.057595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976aac07-0c66-4fb0-9009-a38cbf2fd621 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:54.072348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1171/2340] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:52:54.077339 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7922eb1-bfb5-43ec-95c5-994dbff93639 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:54.087650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7922eb1-bfb5-43ec-95c5-994dbff93639 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:54.092486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e368c-190d-4e30-8884-05b7679acdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:54.093100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e368c-190d-4e30-8884-05b7679acdbf admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:54.093385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e368c-190d-4e30-8884-05b7679acdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:54.093662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e368c-190d-4e30-8884-05b7679acdbf admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:54.094390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e368c-190d-4e30-8884-05b7679acdbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:54.096285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e368c-190d-4e30-8884-05b7679acdbf admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:54.127659 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1170/2341] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:52:54 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:52:54.132077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aac07-0c66-4fb0-9009-a38cbf2fd621 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:54.142494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aac07-0c66-4fb0-9009-a38cbf2fd621 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:54.194706 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:54.205504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d9a96-234a-4c54-9aef-566975deb850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:54.206126 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d9a96-234a-4c54-9aef-566975deb850 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:54.206435 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d9a96-234a-4c54-9aef-566975deb850 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:54.206710 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d9a96-234a-4c54-9aef-566975deb850 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:54.207378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d9a96-234a-4c54-9aef-566975deb850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:54.209284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d9a96-234a-4c54-9aef-566975deb850 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:54.233402 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1172/2342] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:52:54 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:52:54.237629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e368c-190d-4e30-8884-05b7679acdbf admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:54.248158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e368c-190d-4e30-8884-05b7679acdbf admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:54.252791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6fcb7-ce54-49b1-a1d1-53b8b3f215d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:54.253396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6fcb7-ce54-49b1-a1d1-53b8b3f215d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:54.253679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6fcb7-ce54-49b1-a1d1-53b8b3f215d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:54.253955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6fcb7-ce54-49b1-a1d1-53b8b3f215d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:54.254697 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6fcb7-ce54-49b1-a1d1-53b8b3f215d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:54.256291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6fcb7-ce54-49b1-a1d1-53b8b3f215d7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:54.267648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1171/2343] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:52:54.271752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d9a96-234a-4c54-9aef-566975deb850 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:54.283420 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d9a96-234a-4c54-9aef-566975deb850 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:54.289135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c49ff7-ce70-42a7-9ffc-e2778b0f4289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:54.289958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c49ff7-ce70-42a7-9ffc-e2778b0f4289 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:54.290210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c49ff7-ce70-42a7-9ffc-e2778b0f4289 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:54.290505 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c49ff7-ce70-42a7-9ffc-e2778b0f4289 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:54.291213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c49ff7-ce70-42a7-9ffc-e2778b0f4289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:54.293987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c49ff7-ce70-42a7-9ffc-e2778b0f4289 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:54.308660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1173/2344] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:52:54.310088 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6fcb7-ce54-49b1-a1d1-53b8b3f215d7 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:54.321926 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6fcb7-ce54-49b1-a1d1-53b8b3f215d7 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:54.337529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f27c78-b0e0-4b54-9812-67763779f6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:54.337529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f27c78-b0e0-4b54-9812-67763779f6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:54.337529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f27c78-b0e0-4b54-9812-67763779f6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:54.337529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f27c78-b0e0-4b54-9812-67763779f6ee admin admin] PATH_INFO: `/v3/projects/24b63e695b094979bec660b3aeb8b069/users/30c3ac076b014aa6a5c26e7b8ae99232/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:54.339163 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:54.352779 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f27c78-b0e0-4b54-9812-67763779f6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b63e695b094979bec660b3aeb8b069, user_id=30c3ac076b014aa6a5c26e7b8ae99232, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:54.355511 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f27c78-b0e0-4b54-9812-67763779f6ee admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:54.374324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1172/2345] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:52:54 2022] PUT /identity/v3/projects/24b63e695b094979bec660b3aeb8b069/users/30c3ac076b014aa6a5c26e7b8ae99232/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:52:54.375624 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788bbe1-28e3-4343-9c99-4b1f6ae45bfb None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:54.375931 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788bbe1-28e3-4343-9c99-4b1f6ae45bfb None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:54.376249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788bbe1-28e3-4343-9c99-4b1f6ae45bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:54.397813 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-b788bbe1-28e3-4343-9c99-4b1f6ae45bfb None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:54.399117 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b788bbe1-28e3-4343-9c99-4b1f6ae45bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:54.459261 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1174/2346] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:52:54.473752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f27c78-b0e0-4b54-9812-67763779f6ee admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:54.475649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-68f27c78-b0e0-4b54-9812-67763779f6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:54.538714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f27c78-b0e0-4b54-9812-67763779f6ee admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:54.542545 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d600fd-9fc3-4f02-a729-e8d3c59f4124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:54.543168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d600fd-9fc3-4f02-a729-e8d3c59f4124 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:54.543455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d600fd-9fc3-4f02-a729-e8d3c59f4124 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:54.543736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d600fd-9fc3-4f02-a729-e8d3c59f4124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:54.555264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d600fd-9fc3-4f02-a729-e8d3c59f4124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:54.556975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d600fd-9fc3-4f02-a729-e8d3c59f4124 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:54.567477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1173/2347] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:52:59.024465 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731852e-6101-42a5-82ec-e21dc9dc5731 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:59.025000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731852e-6101-42a5-82ec-e21dc9dc5731 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:59.025000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731852e-6101-42a5-82ec-e21dc9dc5731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:59.058799 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-f731852e-6101-42a5-82ec-e21dc9dc5731 None None] MFA Rules not processed for user `30c3ac076b014aa6a5c26e7b8ae99232`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:52:59.059179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f731852e-6101-42a5-82ec-e21dc9dc5731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:52:59.142409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1175/2348] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:52:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:52:59.148362 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d600fd-9fc3-4f02-a729-e8d3c59f4124 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:59.163717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d600fd-9fc3-4f02-a729-e8d3c59f4124 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:59.170607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baef735-3b44-4240-a85d-a27940cdda89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:59.171635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baef735-3b44-4240-a85d-a27940cdda89 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:59.172106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baef735-3b44-4240-a85d-a27940cdda89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:59.172571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baef735-3b44-4240-a85d-a27940cdda89 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:59.173739 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baef735-3b44-4240-a85d-a27940cdda89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:59.177315 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baef735-3b44-4240-a85d-a27940cdda89 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:59.227127 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1174/2349] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:52:59 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:52:59.228184 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731852e-6101-42a5-82ec-e21dc9dc5731 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:59.241434 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731852e-6101-42a5-82ec-e21dc9dc5731 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:59.319947 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029cc32-5a5e-4302-8e5e-345a21f5bf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:59.320842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029cc32-5a5e-4302-8e5e-345a21f5bf77 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:59.321115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029cc32-5a5e-4302-8e5e-345a21f5bf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:59.321384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029cc32-5a5e-4302-8e5e-345a21f5bf77 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:59.322070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029cc32-5a5e-4302-8e5e-345a21f5bf77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:59.324028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029cc32-5a5e-4302-8e5e-345a21f5bf77 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:59.333549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:52:59.347992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1176/2350] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:52:59 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:52:59.352650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baef735-3b44-4240-a85d-a27940cdda89 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:59.363487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baef735-3b44-4240-a85d-a27940cdda89 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:59.368510 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ae638-7304-4f1a-a396-aca39869c35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:59.369131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ae638-7304-4f1a-a396-aca39869c35a admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:59.369413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ae638-7304-4f1a-a396-aca39869c35a admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:59.369686 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ae638-7304-4f1a-a396-aca39869c35a admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:59.370441 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ae638-7304-4f1a-a396-aca39869c35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:59.372107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ae638-7304-4f1a-a396-aca39869c35a admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:59.385679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1175/2351] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:52:59.389824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029cc32-5a5e-4302-8e5e-345a21f5bf77 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:59.401783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029cc32-5a5e-4302-8e5e-345a21f5bf77 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:59.406988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0214e55-b9f2-4356-91d4-54b6454873ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:59.407925 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0214e55-b9f2-4356-91d4-54b6454873ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:59.408250 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0214e55-b9f2-4356-91d4-54b6454873ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:59.408612 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0214e55-b9f2-4356-91d4-54b6454873ff admin admin] PATH_INFO: `/v3/projects/19c36a59531d463f8220d6efe7dbd46c/users/99d09b701dbc48a4a495cf003577e6c5/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:59.427361 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0214e55-b9f2-4356-91d4-54b6454873ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c36a59531d463f8220d6efe7dbd46c, user_id=99d09b701dbc48a4a495cf003577e6c5, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:59.430663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0214e55-b9f2-4356-91d4-54b6454873ff admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:59.454162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1177/2352] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:52:59 2022] PUT /identity/v3/projects/19c36a59531d463f8220d6efe7dbd46c/users/99d09b701dbc48a4a495cf003577e6c5/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:52:59.458956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ae638-7304-4f1a-a396-aca39869c35a admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:59.472676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ae638-7304-4f1a-a396-aca39869c35a admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:59.559330 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e74db9-7fb2-4da5-b98f-fe5e23bac62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:59.559651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74db9-7fb2-4da5-b98f-fe5e23bac62d admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:59.559935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74db9-7fb2-4da5-b98f-fe5e23bac62d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:59.560212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e74db9-7fb2-4da5-b98f-fe5e23bac62d admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:59.560994 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e74db9-7fb2-4da5-b98f-fe5e23bac62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:59.567179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e74db9-7fb2-4da5-b98f-fe5e23bac62d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:59.579209 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1176/2353] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:52:59.583308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0214e55-b9f2-4356-91d4-54b6454873ff admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:52:59.594883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0214e55-b9f2-4356-91d4-54b6454873ff admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:52:59.599529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb9b6b-1635-4073-a04f-ff8ccf13154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:52:59.601205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9b6b-1635-4073-a04f-ff8ccf13154c admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:52:59.601774 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9b6b-1635-4073-a04f-ff8ccf13154c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:52:59.602059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb9b6b-1635-4073-a04f-ff8ccf13154c admin admin] PATH_INFO: `/v3/projects/19c36a59531d463f8220d6efe7dbd46c/users/99d09b701dbc48a4a495cf003577e6c5/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:52:59.604160 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb9b6b-1635-4073-a04f-ff8ccf13154c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c36a59531d463f8220d6efe7dbd46c, user_id=99d09b701dbc48a4a495cf003577e6c5, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:52:59.606927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb9b6b-1635-4073-a04f-ff8ccf13154c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:52:59.619632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1178/2354] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:52:59 2022] PUT /identity/v3/projects/19c36a59531d463f8220d6efe7dbd46c/users/99d09b701dbc48a4a495cf003577e6c5/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:53:03.957331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f520-3a41-4ff3-b79f-1af54b6db882 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:53:03.957833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f520-3a41-4ff3-b79f-1af54b6db882 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:53:03.957956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5f520-3a41-4ff3-b79f-1af54b6db882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:53:03.988108 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-fda5f520-3a41-4ff3-b79f-1af54b6db882 None None] MFA Rules not processed for user `99d09b701dbc48a4a495cf003577e6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:53:03.989336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-fda5f520-3a41-4ff3-b79f-1af54b6db882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:53:04.034747 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:53:04.065620 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1177/2355] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:53:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:53:04.083098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb9b6b-1635-4073-a04f-ff8ccf13154c admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:53:04.085066 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-dbeb9b6b-1635-4073-a04f-ff8ccf13154c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:53:04.166097 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb9b6b-1635-4073-a04f-ff8ccf13154c admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:53:04.172163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4dba2-b539-4491-b502-b271f50398c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:53:04.172792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4dba2-b539-4491-b502-b271f50398c9 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:53:04.173346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4dba2-b539-4491-b502-b271f50398c9 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:53:04.173484 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4dba2-b539-4491-b502-b271f50398c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:53:04.238081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4dba2-b539-4491-b502-b271f50398c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:53:04.239760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4dba2-b539-4491-b502-b271f50398c9 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:53:04.250253 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1179/2356] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:53:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:53:05.385113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a05829-ab9e-4819-8599-2b9c2132a5be None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:53:05.385767 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a05829-ab9e-4819-8599-2b9c2132a5be None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:53:05.385767 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a05829-ab9e-4819-8599-2b9c2132a5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:53:05.408822 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b3a05829-ab9e-4819-8599-2b9c2132a5be None None] MFA Rules not processed for user `30c3ac076b014aa6a5c26e7b8ae99232`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:53:05.410112 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b3a05829-ab9e-4819-8599-2b9c2132a5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:53:05.419149 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1178/2357] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:53:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:53:14.246395 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:INSERT=4,keystone:SELECT=73 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:53:15.401970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=14 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:53:23.108338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4dba2-b539-4491-b502-b271f50398c9 service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:53:23.109889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-11e4dba2-b539-4491-b502-b271f50398c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:53:23.174764 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4dba2-b539-4491-b502-b271f50398c9 service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:53:23.180295 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f8086-4b8b-42f7-a067-c0ea9e56dfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:53:23.180978 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f8086-4b8b-42f7-a067-c0ea9e56dfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:53:23.181244 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f8086-4b8b-42f7-a067-c0ea9e56dfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:53:23.181519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f8086-4b8b-42f7-a067-c0ea9e56dfa8 admin admin] PATH_INFO: `/v3/users/892b25819bb94fa9bfd7bb990b4ee762` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:53:23.182713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f8086-4b8b-42f7-a067-c0ea9e56dfa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=892b25819bb94fa9bfd7bb990b4ee762)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:53:23.184612 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f8086-4b8b-42f7-a067-c0ea9e56dfa8 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:53:23.229858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-a61f8086-4b8b-42f7-a067-c0ea9e56dfa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '892b25819bb94fa9bfd7bb990b4ee762'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:53:23.230527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-a61f8086-4b8b-42f7-a067-c0ea9e56dfa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '892b25819bb94fa9bfd7bb990b4ee762'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:53:23.237796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-a61f8086-4b8b-42f7-a067-c0ea9e56dfa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '892b25819bb94fa9bfd7bb990b4ee762'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:53:23.245469 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-a61f8086-4b8b-42f7-a067-c0ea9e56dfa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '892b25819bb94fa9bfd7bb990b4ee762'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:53:23.246109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-a61f8086-4b8b-42f7-a067-c0ea9e56dfa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '892b25819bb94fa9bfd7bb990b4ee762'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:53:23.263400 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1180/2358] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:53:23 2022] DELETE /identity/v3/users/892b25819bb94fa9bfd7bb990b4ee762 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:53:23.268060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1300233-7e1e-4a87-8ee7-92e4e8115ce5 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:53:23.268546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1300233-7e1e-4a87-8ee7-92e4e8115ce5 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:53:23.268660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1300233-7e1e-4a87-8ee7-92e4e8115ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:53:23.287446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-f1300233-7e1e-4a87-8ee7-92e4e8115ce5 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:53:23.288682 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f1300233-7e1e-4a87-8ee7-92e4e8115ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:53:23.348126 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1179/2359] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:53:23.358364 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f8086-4b8b-42f7-a067-c0ea9e56dfa8 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:53:23.359775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a61f8086-4b8b-42f7-a067-c0ea9e56dfa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:53:23.417153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f8086-4b8b-42f7-a067-c0ea9e56dfa8 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:53:23.420804 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dc269-0b05-4194-ab2a-cdc69ab47d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:53:23.421438 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dc269-0b05-4194-ab2a-cdc69ab47d4f service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:53:23.421739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dc269-0b05-4194-ab2a-cdc69ab47d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:53:23.422003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dc269-0b05-4194-ab2a-cdc69ab47d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:53:23.432017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dc269-0b05-4194-ab2a-cdc69ab47d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:53:23.433478 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dc269-0b05-4194-ab2a-cdc69ab47d4f service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:53:23.443442 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1181/2360] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:53:23.794639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1300233-7e1e-4a87-8ee7-92e4e8115ce5 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:53:23.796581 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f1300233-7e1e-4a87-8ee7-92e4e8115ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:53:23.810960 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1300233-7e1e-4a87-8ee7-92e4e8115ce5 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:53:23.815824 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b608df-c141-4ae4-855b-62090da746e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:53:23.816478 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b608df-c141-4ae4-855b-62090da746e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:53:23.816764 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b608df-c141-4ae4-855b-62090da746e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:53:23.817045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b608df-c141-4ae4-855b-62090da746e7 admin admin] PATH_INFO: `/v3/projects/39b3e31207ad40c3804b55abcb5ef631` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:53:23.818272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b608df-c141-4ae4-855b-62090da746e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b3e31207ad40c3804b55abcb5ef631)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:53:23.820876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b608df-c141-4ae4-855b-62090da746e7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:53:23.870527 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-69b608df-c141-4ae4-855b-62090da746e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b3e31207ad40c3804b55abcb5ef631', 'request_id': 'req-69b608df-c141-4ae4-855b-62090da746e7'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:53:23.876965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-69b608df-c141-4ae4-855b-62090da746e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b3e31207ad40c3804b55abcb5ef631', 'request_id': 'req-69b608df-c141-4ae4-855b-62090da746e7'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:53:23.884565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-69b608df-c141-4ae4-855b-62090da746e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b3e31207ad40c3804b55abcb5ef631', 'request_id': 'req-69b608df-c141-4ae4-855b-62090da746e7'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:53:23.895158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-69b608df-c141-4ae4-855b-62090da746e7 admin admin] The token cache is being invalidate because project 39b3e31207ad40c3804b55abcb5ef631 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:53:23.895454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-69b608df-c141-4ae4-855b-62090da746e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:53:23.896116 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-69b608df-c141-4ae4-855b-62090da746e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:53:23.897636 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1180/2361] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:53:23 2022] DELETE /identity/v3/projects/39b3e31207ad40c3804b55abcb5ef631 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:53:28.581443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dc269-0b05-4194-ab2a-cdc69ab47d4f service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:53:28.582874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b40dc269-0b05-4194-ab2a-cdc69ab47d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:53:28.615604 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:53:28.667481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dc269-0b05-4194-ab2a-cdc69ab47d4f service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:53:28.737075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a60da-307f-4512-aae5-5b6e5e94ea4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:53:28.737707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a60da-307f-4512-aae5-5b6e5e94ea4e service placement] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:53:28.738020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a60da-307f-4512-aae5-5b6e5e94ea4e service placement] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:53:28.738327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a60da-307f-4512-aae5-5b6e5e94ea4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:53:28.740115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-417a60da-307f-4512-aae5-5b6e5e94ea4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:53:28.752350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a60da-307f-4512-aae5-5b6e5e94ea4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:53:28.753963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a60da-307f-4512-aae5-5b6e5e94ea4e service placement] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:53:28.764837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1182/2362] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:53:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:53:33.892162 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:53:38.760579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=48 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:53:42.543156 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d987d9-aa83-45e9-a126-e5fa4750e62d None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:53:42.543686 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d987d9-aa83-45e9-a126-e5fa4750e62d None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:53:42.543686 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d987d9-aa83-45e9-a126-e5fa4750e62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:53:42.563459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-06d987d9-aa83-45e9-a126-e5fa4750e62d None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:53:42.564650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-06d987d9-aa83-45e9-a126-e5fa4750e62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:53:42.622230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1181/2363] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:53:42.667819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a60da-307f-4512-aae5-5b6e5e94ea4e service placement] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:53:42.669455 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-417a60da-307f-4512-aae5-5b6e5e94ea4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:53:42.739290 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a60da-307f-4512-aae5-5b6e5e94ea4e service placement] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:53:42.744463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cdf39-a246-4168-8778-71752edf5a88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:53:42.745078 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cdf39-a246-4168-8778-71752edf5a88 service swift] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:53:42.745357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cdf39-a246-4168-8778-71752edf5a88 service swift] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:53:42.745630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cdf39-a246-4168-8778-71752edf5a88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:53:42.753636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cdf39-a246-4168-8778-71752edf5a88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:53:42.755251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cdf39-a246-4168-8778-71752edf5a88 service swift] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:53:42.764383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1183/2364] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 10:53:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 10:53:45.097074 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a4d52-f2a8-4c52-8b0b-25a19268f573 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:53:45.097591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a4d52-f2a8-4c52-8b0b-25a19268f573 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:53:45.097696 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a4d52-f2a8-4c52-8b0b-25a19268f573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:53:45.117554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-808a4d52-f2a8-4c52-8b0b-25a19268f573 None None] MFA Rules not processed for user `00e8fb23313f4e168eb2f690039379ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:53:45.119449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-808a4d52-f2a8-4c52-8b0b-25a19268f573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:53:45.187862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1182/2365] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:53:47.594161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cdf39-a246-4168-8778-71752edf5a88 service swift] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:53:47.595796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1f0cdf39-a246-4168-8778-71752edf5a88 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:53:47.694476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cdf39-a246-4168-8778-71752edf5a88 service swift] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:53:47.703286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb9830-5e1b-4879-aa41-a00f6b0dc037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:53:47.704403 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb9830-5e1b-4879-aa41-a00f6b0dc037 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:53:47.704545 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb9830-5e1b-4879-aa41-a00f6b0dc037 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:53:47.704830 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb9830-5e1b-4879-aa41-a00f6b0dc037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:53:47.706841 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-74eb9830-5e1b-4879-aa41-a00f6b0dc037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:53:47.820689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb9830-5e1b-4879-aa41-a00f6b0dc037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:53:47.823233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb9830-5e1b-4879-aa41-a00f6b0dc037 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:53:47.839111 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1184/2366] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:53:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:53:55.176786 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=50 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:53:57.831264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=82 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:54:00.939284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b939c-3178-4b79-bf79-97b41cc5773a None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:00.940215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b939c-3178-4b79-bf79-97b41cc5773a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:00.940499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b939c-3178-4b79-bf79-97b41cc5773a None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:00.942167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1183/2367] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jul 27 10:54:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:54:00.948629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf44f6-7bb9-4c05-8ab6-25f77e87d525 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:00.949168 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf44f6-7bb9-4c05-8ab6-25f77e87d525 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:00.949168 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf44f6-7bb9-4c05-8ab6-25f77e87d525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:00.969451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-32bf44f6-7bb9-4c05-8ab6-25f77e87d525 None None] MFA Rules not processed for user `3bb16c9232464cc2aeee12b7fa918b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:54:00.970699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-32bf44f6-7bb9-4c05-8ab6-25f77e87d525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:54:01.057059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1185/2368] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jul 27 10:54:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:54:01.068509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b939c-3178-4b79-bf79-97b41cc5773a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:54:01.070307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-921b939c-3178-4b79-bf79-97b41cc5773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:54:01.152651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b939c-3178-4b79-bf79-97b41cc5773a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:54:01.156974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69735407-bdab-46a7-9c31-1618f277714a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4e81eb81934784b8632248ecf0894f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:54:01.157601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735407-bdab-46a7-9c31-1618f277714a service glance] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:01.157882 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735407-bdab-46a7-9c31-1618f277714a service glance] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:01.158208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69735407-bdab-46a7-9c31-1618f277714a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:01.170016 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69735407-bdab-46a7-9c31-1618f277714a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:54:01.171499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69735407-bdab-46a7-9c31-1618f277714a service glance] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:54:01.183610 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1184/2369] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:54:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:54:01.254587 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5803b5-300e-4ba5-88a2-c16fe6b56fd0 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:01.254877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5803b5-300e-4ba5-88a2-c16fe6b56fd0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:01.255158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5803b5-300e-4ba5-88a2-c16fe6b56fd0 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:01.256551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1186/2370] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jul 27 10:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:54:01.262128 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93daa-15d9-40fa-b52b-9249ad95f44d None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:01.262457 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93daa-15d9-40fa-b52b-9249ad95f44d None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:01.262737 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93daa-15d9-40fa-b52b-9249ad95f44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:01.282170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-08b93daa-15d9-40fa-b52b-9249ad95f44d None None] MFA Rules not processed for user `6b33631df63d4657a8e2ad108ca9f670`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:54:01.283417 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-08b93daa-15d9-40fa-b52b-9249ad95f44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:54:01.290428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1185/2371] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jul 27 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:54:01.302759 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5803b5-300e-4ba5-88a2-c16fe6b56fd0 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:54:01.314460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5803b5-300e-4ba5-88a2-c16fe6b56fd0 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:54:01.318013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2fa8d-1fbe-4acc-ae51-300b3963e2c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:54:01.318656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2fa8d-1fbe-4acc-ae51-300b3963e2c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:01.318939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2fa8d-1fbe-4acc-ae51-300b3963e2c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:01.319216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2fa8d-1fbe-4acc-ae51-300b3963e2c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:01.327327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2fa8d-1fbe-4acc-ae51-300b3963e2c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:54:01.328822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2fa8d-1fbe-4acc-ae51-300b3963e2c6 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:54:01.337530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1187/2372] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:54:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:54:01.420993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96c532-a7b2-448a-845f-000471c430cd None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:01.421282 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96c532-a7b2-448a-845f-000471c430cd None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:01.421558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96c532-a7b2-448a-845f-000471c430cd None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:01.422986 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1186/2373] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jul 27 10:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:54:01.428034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288604c-bfa0-4299-8ad8-358fc4bc1d2f None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:01.428327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288604c-bfa0-4299-8ad8-358fc4bc1d2f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:01.428600 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288604c-bfa0-4299-8ad8-358fc4bc1d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:01.448388 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-7288604c-bfa0-4299-8ad8-358fc4bc1d2f None None] MFA Rules not processed for user `3bb16c9232464cc2aeee12b7fa918b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:54:01.449586 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7288604c-bfa0-4299-8ad8-358fc4bc1d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:54:01.458861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1188/2374] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jul 27 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:54:01.469717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96c532-a7b2-448a-845f-000471c430cd None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:54:01.481422 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96c532-a7b2-448a-845f-000471c430cd None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:54:01.485062 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811ca59-38be-4c7a-ba30-509377e2ae47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:54:01.485660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811ca59-38be-4c7a-ba30-509377e2ae47 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:01.485946 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811ca59-38be-4c7a-ba30-509377e2ae47 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:01.486258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811ca59-38be-4c7a-ba30-509377e2ae47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:01.496486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811ca59-38be-4c7a-ba30-509377e2ae47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:54:01.497904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811ca59-38be-4c7a-ba30-509377e2ae47 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:54:01.508861 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1187/2375] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:54:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:54:03.798023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0836547-0acf-4132-972f-406fbf70e734 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:03.798023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0836547-0acf-4132-972f-406fbf70e734 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:03.798630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0836547-0acf-4132-972f-406fbf70e734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:03.819666 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-f0836547-0acf-4132-972f-406fbf70e734 None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:54:03.821952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f0836547-0acf-4132-972f-406fbf70e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:54:03.830327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1189/2376] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 10:54:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:54:03.842640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811ca59-38be-4c7a-ba30-509377e2ae47 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:54:03.854036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811ca59-38be-4c7a-ba30-509377e2ae47 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:54:03.859141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d928688-fc14-4412-a828-548fd081c0e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:54:03.859752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d928688-fc14-4412-a828-548fd081c0e9 service swift] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:03.860036 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d928688-fc14-4412-a828-548fd081c0e9 service swift] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:03.860314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d928688-fc14-4412-a828-548fd081c0e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:03.871447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d928688-fc14-4412-a828-548fd081c0e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:54:03.874535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d928688-fc14-4412-a828-548fd081c0e9 service swift] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:54:03.884259 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1188/2377] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 10:54:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 10:54:13.814309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=43 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:54:13.880122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=41 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:54:29.451251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690976e-963a-40a3-beb5-5780adbdfb2e None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:29.451812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690976e-963a-40a3-beb5-5780adbdfb2e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:29.451812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690976e-963a-40a3-beb5-5780adbdfb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:29.471523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-c690976e-963a-40a3-beb5-5780adbdfb2e None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:54:29.472756 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c690976e-963a-40a3-beb5-5780adbdfb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:54:29.480995 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1190/2378] 10.222.0.43 () {58 vars in 967 bytes} [Wed Jul 27 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:54:29.493679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d928688-fc14-4412-a828-548fd081c0e9 service swift] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:54:29.505087 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d928688-fc14-4412-a828-548fd081c0e9 service swift] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:54:29.510433 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554d0cf-fb07-44bd-8549-4dd94e1d01bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:54:29.511106 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554d0cf-fb07-44bd-8549-4dd94e1d01bd service swift] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:29.511427 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554d0cf-fb07-44bd-8549-4dd94e1d01bd service swift] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:29.511708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554d0cf-fb07-44bd-8549-4dd94e1d01bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:29.520415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554d0cf-fb07-44bd-8549-4dd94e1d01bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:54:29.522158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554d0cf-fb07-44bd-8549-4dd94e1d01bd service swift] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:54:29.530840 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1189/2379] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 10:54:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 10:54:39.466558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:54:39.527085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=6 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:54:51.659124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690976e-963a-40a3-beb5-5780adbdfb2e None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:54:51.660580 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c690976e-963a-40a3-beb5-5780adbdfb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:54:51.721754 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690976e-963a-40a3-beb5-5780adbdfb2e None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:54:51.725426 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3887f1-78ab-4de5-9c8b-9a6d6bb7f483 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:54:51.726043 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3887f1-78ab-4de5-9c8b-9a6d6bb7f483 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:51.726366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3887f1-78ab-4de5-9c8b-9a6d6bb7f483 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:51.726648 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3887f1-78ab-4de5-9c8b-9a6d6bb7f483 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:51.728769 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5f3887f1-78ab-4de5-9c8b-9a6d6bb7f483 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:54:51.742856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3887f1-78ab-4de5-9c8b-9a6d6bb7f483 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:54:51.744284 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3887f1-78ab-4de5-9c8b-9a6d6bb7f483 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:54:51.755778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1191/2380] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:54:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:54:54.307905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554d0cf-fb07-44bd-8549-4dd94e1d01bd service swift] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:54:54.317504 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554d0cf-fb07-44bd-8549-4dd94e1d01bd service swift] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:54:54.321140 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0cc79-6f09-4528-aa82-a4057f1d0187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:54:54.321747 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0cc79-6f09-4528-aa82-a4057f1d0187 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:54.322032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0cc79-6f09-4528-aa82-a4057f1d0187 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:54.322346 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0cc79-6f09-4528-aa82-a4057f1d0187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:54.324146 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-9bf0cc79-6f09-4528-aa82-a4057f1d0187 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:54:54.341354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0cc79-6f09-4528-aa82-a4057f1d0187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:54:54.344364 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0cc79-6f09-4528-aa82-a4057f1d0187 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:54:54.360526 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1190/2381] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:54:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:54:59.202472 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3887f1-78ab-4de5-9c8b-9a6d6bb7f483 service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:54:59.204157 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5f3887f1-78ab-4de5-9c8b-9a6d6bb7f483 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:54:59.218177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3887f1-78ab-4de5-9c8b-9a6d6bb7f483 service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:54:59.224448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7c921-00bd-4bbe-b98e-0c3705c85f2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:54:59.225051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7c921-00bd-4bbe-b98e-0c3705c85f2e service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:54:59.225331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7c921-00bd-4bbe-b98e-0c3705c85f2e service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:54:59.225606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7c921-00bd-4bbe-b98e-0c3705c85f2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:54:59.227338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-efd7c921-00bd-4bbe-b98e-0c3705c85f2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:54:59.286651 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7c921-00bd-4bbe-b98e-0c3705c85f2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:54:59.288259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7c921-00bd-4bbe-b98e-0c3705c85f2e service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:54:59.297301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1192/2382] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:54:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:55:04.355221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=6 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:55:09.293160 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=54 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:55:11.226052 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b331-7a6f-4c3a-95e6-c33e2fb2ceb8 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:55:11.226621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b331-7a6f-4c3a-95e6-c33e2fb2ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:55:11.226728 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94b331-7a6f-4c3a-95e6-c33e2fb2ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:55:11.246333 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-6b94b331-7a6f-4c3a-95e6-c33e2fb2ceb8 None None] MFA Rules not processed for user `71fcdfd05fb146e88f43fb29c4b0232c`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:55:11.247553 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6b94b331-7a6f-4c3a-95e6-c33e2fb2ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:55:11.254786 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1191/2383] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:55:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:55:18.555629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7c921-00bd-4bbe-b98e-0c3705c85f2e service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:55:18.565049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7c921-00bd-4bbe-b98e-0c3705c85f2e service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:55:18.569261 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de4888-3187-4119-803b-144011daf685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:55:18.569955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4888-3187-4119-803b-144011daf685 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:55:18.570337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4888-3187-4119-803b-144011daf685 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:55:18.570686 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de4888-3187-4119-803b-144011daf685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:55:18.572518 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-34de4888-3187-4119-803b-144011daf685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:55:18.583305 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de4888-3187-4119-803b-144011daf685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:55:18.584829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de4888-3187-4119-803b-144011daf685 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:55:18.593319 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1193/2384] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:55:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:55:21.241342 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:55:28.589494 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=6 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:56:01.378262 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94b331-7a6f-4c3a-95e6-c33e2fb2ceb8 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:01.391860 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94b331-7a6f-4c3a-95e6-c33e2fb2ceb8 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:01.397182 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374dfc1-45a6-4b31-9775-4d9acc601860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:01.397818 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374dfc1-45a6-4b31-9775-4d9acc601860 service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:01.398100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374dfc1-45a6-4b31-9775-4d9acc601860 service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:01.398404 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374dfc1-45a6-4b31-9775-4d9acc601860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:01.400865 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5374dfc1-45a6-4b31-9775-4d9acc601860 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:01.459848 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374dfc1-45a6-4b31-9775-4d9acc601860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:01.461436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374dfc1-45a6-4b31-9775-4d9acc601860 service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:01.470784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1192/2385] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:56:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:56:07.063311 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de4888-3187-4119-803b-144011daf685 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:07.064732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-34de4888-3187-4119-803b-144011daf685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:07.082517 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de4888-3187-4119-803b-144011daf685 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:07.089310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4568222-85ab-49e5-b0ae-b17d62a9cdcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:07.090215 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4568222-85ab-49e5-b0ae-b17d62a9cdcc service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:07.090773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4568222-85ab-49e5-b0ae-b17d62a9cdcc service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:07.091125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4568222-85ab-49e5-b0ae-b17d62a9cdcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:07.093302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b4568222-85ab-49e5-b0ae-b17d62a9cdcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:07.107774 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4568222-85ab-49e5-b0ae-b17d62a9cdcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:07.109488 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4568222-85ab-49e5-b0ae-b17d62a9cdcc service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:07.119728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1194/2386] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:56:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:56:07.480791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374dfc1-45a6-4b31-9775-4d9acc601860 service nova] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:07.500391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374dfc1-45a6-4b31-9775-4d9acc601860 service nova] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:07.506476 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6b32b-a63e-4448-b385-97614fffdc61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:07.507363 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6b32b-a63e-4448-b385-97614fffdc61 service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:07.507646 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6b32b-a63e-4448-b385-97614fffdc61 service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:07.507923 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6b32b-a63e-4448-b385-97614fffdc61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:07.510350 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-37d6b32b-a63e-4448-b385-97614fffdc61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:07.523894 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6b32b-a63e-4448-b385-97614fffdc61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:07.525861 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6b32b-a63e-4448-b385-97614fffdc61 service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:07.540130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1193/2387] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:56:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:56:13.212523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a62cd-1037-46d6-95bb-6d4987e4f5f0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:13.213065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a62cd-1037-46d6-95bb-6d4987e4f5f0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:13.213286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a62cd-1037-46d6-95bb-6d4987e4f5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:13.234882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-5d9a62cd-1037-46d6-95bb-6d4987e4f5f0 None None] MFA Rules not processed for user `9c6c44ca3dc44632b7d064d19a9cf1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:56:13.236155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5d9a62cd-1037-46d6-95bb-6d4987e4f5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:13.244715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1195/2388] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:56:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:56:13.641884 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6b32b-a63e-4448-b385-97614fffdc61 service nova] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:13.643388 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-37d6b32b-a63e-4448-b385-97614fffdc61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:13.657661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6b32b-a63e-4448-b385-97614fffdc61 service nova] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:13.661657 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d4e40-e531-43a5-a5c1-fecd86b0d2b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:13.662415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4e40-e531-43a5-a5c1-fecd86b0d2b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:13.662758 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4e40-e531-43a5-a5c1-fecd86b0d2b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:13.663073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4e40-e531-43a5-a5c1-fecd86b0d2b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:13.665712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a36d4e40-e531-43a5-a5c1-fecd86b0d2b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:13.677654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d4e40-e531-43a5-a5c1-fecd86b0d2b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:13.679421 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d4e40-e531-43a5-a5c1-fecd86b0d2b0 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:13.689324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1194/2389] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:56:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:56:16.053003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a62cd-1037-46d6-95bb-6d4987e4f5f0 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:16.054632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5d9a62cd-1037-46d6-95bb-6d4987e4f5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:16.074017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a62cd-1037-46d6-95bb-6d4987e4f5f0 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:16.080835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f906afc-4ccc-4553-99d0-3c136b3cdc5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:16.081525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906afc-4ccc-4553-99d0-3c136b3cdc5e service placement] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:16.081839 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906afc-4ccc-4553-99d0-3c136b3cdc5e service placement] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:16.082167 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906afc-4ccc-4553-99d0-3c136b3cdc5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:16.084603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3f906afc-4ccc-4553-99d0-3c136b3cdc5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:16.100850 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f906afc-4ccc-4553-99d0-3c136b3cdc5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:16.103712 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f906afc-4ccc-4553-99d0-3c136b3cdc5e service placement] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:16.121685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1196/2390] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:56:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:56:19.003676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a3ede-c30b-4a89-9ed5-002bdfd47748 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:19.004260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a3ede-c30b-4a89-9ed5-002bdfd47748 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:19.004260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a3ede-c30b-4a89-9ed5-002bdfd47748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:19.025275 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-364a3ede-c30b-4a89-9ed5-002bdfd47748 None None] MFA Rules not processed for user `00e8fb23313f4e168eb2f690039379ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:56:19.026512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-364a3ede-c30b-4a89-9ed5-002bdfd47748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:19.033443 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1195/2391] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:56:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:56:26.114001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=15 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:56:28.157482 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f906afc-4ccc-4553-99d0-3c136b3cdc5e service placement] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:28.181451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f906afc-4ccc-4553-99d0-3c136b3cdc5e service placement] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:28.206232 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4a2da-3d61-4b1e-b2ef-9a2198c17880 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:28.207241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4a2da-3d61-4b1e-b2ef-9a2198c17880 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:28.207597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4a2da-3d61-4b1e-b2ef-9a2198c17880 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:28.207948 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4a2da-3d61-4b1e-b2ef-9a2198c17880 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:28.209867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-39f4a2da-3d61-4b1e-b2ef-9a2198c17880 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:28.225042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4a2da-3d61-4b1e-b2ef-9a2198c17880 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:28.227261 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4a2da-3d61-4b1e-b2ef-9a2198c17880 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:28.240090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1197/2392] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:56:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:56:29.019424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=43 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:56:29.289685 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a3ede-c30b-4a89-9ed5-002bdfd47748 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:29.305313 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a3ede-c30b-4a89-9ed5-002bdfd47748 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:29.312565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90e553-f05f-4c5a-9cc9-24eafcbee768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:29.313398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90e553-f05f-4c5a-9cc9-24eafcbee768 service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:29.313779 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90e553-f05f-4c5a-9cc9-24eafcbee768 service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:29.314158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90e553-f05f-4c5a-9cc9-24eafcbee768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:29.316271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-7f90e553-f05f-4c5a-9cc9-24eafcbee768 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:29.332765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90e553-f05f-4c5a-9cc9-24eafcbee768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:29.334664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90e553-f05f-4c5a-9cc9-24eafcbee768 service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:29.348375 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1196/2393] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:56:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:56:38.235534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=6 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:56:39.343601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=6 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:56:55.753550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4a2da-3d61-4b1e-b2ef-9a2198c17880 service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:55.763780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4a2da-3d61-4b1e-b2ef-9a2198c17880 service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:55.767359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cbb11-940a-4152-8e29-79a7ed4ae8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:55.767957 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cbb11-940a-4152-8e29-79a7ed4ae8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:55.768237 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cbb11-940a-4152-8e29-79a7ed4ae8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:55.768506 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cbb11-940a-4152-8e29-79a7ed4ae8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:55.770260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-819cbb11-940a-4152-8e29-79a7ed4ae8a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:55.836980 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cbb11-940a-4152-8e29-79a7ed4ae8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:55.838348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819cbb11-940a-4152-8e29-79a7ed4ae8a7 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:55.848144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1198/2394] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:56:59.040980 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90e553-f05f-4c5a-9cc9-24eafcbee768 service nova] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:59.054090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90e553-f05f-4c5a-9cc9-24eafcbee768 service nova] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:59.060519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85bb30-995f-4e16-bca7-62f28e79a1b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:59.061330 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85bb30-995f-4e16-bca7-62f28e79a1b4 service placement] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:59.061772 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85bb30-995f-4e16-bca7-62f28e79a1b4 service placement] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:59.062998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85bb30-995f-4e16-bca7-62f28e79a1b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:59.064783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4e85bb30-995f-4e16-bca7-62f28e79a1b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:59.079976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85bb30-995f-4e16-bca7-62f28e79a1b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:59.082467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85bb30-995f-4e16-bca7-62f28e79a1b4 service placement] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:59.097951 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1197/2395] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:56:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:56:59.108272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cbb11-940a-4152-8e29-79a7ed4ae8a7 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:59.110718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-819cbb11-940a-4152-8e29-79a7ed4ae8a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:59.130778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cbb11-940a-4152-8e29-79a7ed4ae8a7 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:59.137883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93bd97-2d39-4d83-835b-933e222470b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:59.138849 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93bd97-2d39-4d83-835b-933e222470b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:59.139268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93bd97-2d39-4d83-835b-933e222470b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:59.139701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93bd97-2d39-4d83-835b-933e222470b7 admin admin] PATH_INFO: `/v3/users/71fcdfd05fb146e88f43fb29c4b0232c` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:59.141394 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93bd97-2d39-4d83-835b-933e222470b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71fcdfd05fb146e88f43fb29c4b0232c)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:59.144536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93bd97-2d39-4d83-835b-933e222470b7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:59.204488 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2f93bd97-2d39-4d83-835b-933e222470b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71fcdfd05fb146e88f43fb29c4b0232c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:56:59.205101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2f93bd97-2d39-4d83-835b-933e222470b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71fcdfd05fb146e88f43fb29c4b0232c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:56:59.213345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2f93bd97-2d39-4d83-835b-933e222470b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71fcdfd05fb146e88f43fb29c4b0232c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:56:59.220884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2f93bd97-2d39-4d83-835b-933e222470b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71fcdfd05fb146e88f43fb29c4b0232c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:56:59.221554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2f93bd97-2d39-4d83-835b-933e222470b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71fcdfd05fb146e88f43fb29c4b0232c'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:56:59.244210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1199/2396] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:56:59 2022] DELETE /identity/v3/users/71fcdfd05fb146e88f43fb29c4b0232c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:56:59.432262 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85bb30-995f-4e16-bca7-62f28e79a1b4 service placement] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:59.445102 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85bb30-995f-4e16-bca7-62f28e79a1b4 service placement] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:59.505013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74ed2d-95af-4c78-b110-85dfbef6b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:59.506410 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74ed2d-95af-4c78-b110-85dfbef6b924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:59.506699 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74ed2d-95af-4c78-b110-85dfbef6b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:59.506981 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74ed2d-95af-4c78-b110-85dfbef6b924 admin admin] PATH_INFO: `/v3/projects/27cca23fea974855a8867ab5fbae1606` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:59.508170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74ed2d-95af-4c78-b110-85dfbef6b924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27cca23fea974855a8867ab5fbae1606)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:59.510064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74ed2d-95af-4c78-b110-85dfbef6b924 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:59.560078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7d74ed2d-95af-4c78-b110-85dfbef6b924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27cca23fea974855a8867ab5fbae1606', 'request_id': 'req-7d74ed2d-95af-4c78-b110-85dfbef6b924'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:56:59.567242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7d74ed2d-95af-4c78-b110-85dfbef6b924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27cca23fea974855a8867ab5fbae1606', 'request_id': 'req-7d74ed2d-95af-4c78-b110-85dfbef6b924'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:56:59.575147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7d74ed2d-95af-4c78-b110-85dfbef6b924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27cca23fea974855a8867ab5fbae1606', 'request_id': 'req-7d74ed2d-95af-4c78-b110-85dfbef6b924'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:56:59.585750 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7d74ed2d-95af-4c78-b110-85dfbef6b924 admin admin] The token cache is being invalidate because project 27cca23fea974855a8867ab5fbae1606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:56:59.586043 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7d74ed2d-95af-4c78-b110-85dfbef6b924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:56:59.586716 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7d74ed2d-95af-4c78-b110-85dfbef6b924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:56:59.588264 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1198/2397] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:56:59 2022] DELETE /identity/v3/projects/27cca23fea974855a8867ab5fbae1606 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:56:59.593392 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03f70d-2023-486d-998c-adfbdad5467b None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:59.593681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03f70d-2023-486d-998c-adfbdad5467b None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:59.593960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03f70d-2023-486d-998c-adfbdad5467b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:59.614541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-8f03f70d-2023-486d-998c-adfbdad5467b None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:56:59.616618 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8f03f70d-2023-486d-998c-adfbdad5467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:59.675458 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1200/2398] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:56:59.684288 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d486bef-8248-4b78-b69a-c602484ef781 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:59.684910 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d486bef-8248-4b78-b69a-c602484ef781 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:59.685215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d486bef-8248-4b78-b69a-c602484ef781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:59.705786 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-0d486bef-8248-4b78-b69a-c602484ef781 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:56:59.707012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0d486bef-8248-4b78-b69a-c602484ef781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:56:59.716199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1199/2399] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:56:59.720740 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03f70d-2023-486d-998c-adfbdad5467b None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:59.731792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03f70d-2023-486d-998c-adfbdad5467b None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:59.736502 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49948870-86aa-4333-a7d0-a5e414cb2ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:59.737114 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49948870-86aa-4333-a7d0-a5e414cb2ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:59.737396 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49948870-86aa-4333-a7d0-a5e414cb2ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:59.737669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49948870-86aa-4333-a7d0-a5e414cb2ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:59.738415 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49948870-86aa-4333-a7d0-a5e414cb2ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:56:59.738718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49948870-86aa-4333-a7d0-a5e414cb2ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:59.740945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49948870-86aa-4333-a7d0-a5e414cb2ad5 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:59.742544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:56:59.755153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1201/2400] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:56:59.759519 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d486bef-8248-4b78-b69a-c602484ef781 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:59.769904 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d486bef-8248-4b78-b69a-c602484ef781 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:59.775959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4037b75-aca1-4ac7-9c0a-c3e9f28e4fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:59.776583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4037b75-aca1-4ac7-9c0a-c3e9f28e4fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:59.776863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4037b75-aca1-4ac7-9c0a-c3e9f28e4fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:59.777138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4037b75-aca1-4ac7-9c0a-c3e9f28e4fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:59.777805 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4037b75-aca1-4ac7-9c0a-c3e9f28e4fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:59.779755 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4037b75-aca1-4ac7-9c0a-c3e9f28e4fa4 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:59.809531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1200/2401] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:56:59 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:56:59.814152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49948870-86aa-4333-a7d0-a5e414cb2ad5 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:59.825316 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49948870-86aa-4333-a7d0-a5e414cb2ad5 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:59.882742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d727d-7666-4c2a-a793-1440b9c97995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:59.883364 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d727d-7666-4c2a-a793-1440b9c97995 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:59.883644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d727d-7666-4c2a-a793-1440b9c97995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:59.883919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d727d-7666-4c2a-a793-1440b9c97995 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:59.884585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d727d-7666-4c2a-a793-1440b9c97995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:59.886519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d727d-7666-4c2a-a793-1440b9c97995 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:59.908644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1202/2402] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:56:59 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:56:59.914000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4037b75-aca1-4ac7-9c0a-c3e9f28e4fa4 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:59.924799 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4037b75-aca1-4ac7-9c0a-c3e9f28e4fa4 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:59.929913 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29439270-2b48-498c-87c9-279136bf72bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:59.930552 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29439270-2b48-498c-87c9-279136bf72bb admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:59.930838 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29439270-2b48-498c-87c9-279136bf72bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:59.931111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29439270-2b48-498c-87c9-279136bf72bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:59.931820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29439270-2b48-498c-87c9-279136bf72bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:59.933397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29439270-2b48-498c-87c9-279136bf72bb admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:59.943895 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1201/2403] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:56:59.948136 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d727d-7666-4c2a-a793-1440b9c97995 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:59.959116 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d727d-7666-4c2a-a793-1440b9c97995 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:56:59.963845 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb5787-5504-4133-9143-e9f2a9e8ee2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:56:59.964458 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5787-5504-4133-9143-e9f2a9e8ee2e admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:56:59.964770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5787-5504-4133-9143-e9f2a9e8ee2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:56:59.965043 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5787-5504-4133-9143-e9f2a9e8ee2e admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:56:59.965855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb5787-5504-4133-9143-e9f2a9e8ee2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:56:59.967500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb5787-5504-4133-9143-e9f2a9e8ee2e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:56:59.979491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1203/2404] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:56:59.983891 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29439270-2b48-498c-87c9-279136bf72bb admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:56:59.995959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29439270-2b48-498c-87c9-279136bf72bb admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:00.000564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f44bce-6926-42da-91db-0e1c5f205e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:00.001225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44bce-6926-42da-91db-0e1c5f205e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:00.001506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44bce-6926-42da-91db-0e1c5f205e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:00.001778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f44bce-6926-42da-91db-0e1c5f205e94 admin admin] PATH_INFO: `/v3/projects/a78a3f58583440d68144394c43d5862f/users/218fb4b1911c4772ad8c690bf11fda35/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:00.019109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f44bce-6926-42da-91db-0e1c5f205e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78a3f58583440d68144394c43d5862f, user_id=218fb4b1911c4772ad8c690bf11fda35, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:00.022341 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f44bce-6926-42da-91db-0e1c5f205e94 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:00.035783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1202/2405] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:56:59 2022] PUT /identity/v3/projects/a78a3f58583440d68144394c43d5862f/users/218fb4b1911c4772ad8c690bf11fda35/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:00.047065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4108a4-1201-4336-8252-0a11a30953ef None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:00.047398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4108a4-1201-4336-8252-0a11a30953ef None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:00.047718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4108a4-1201-4336-8252-0a11a30953ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:00.076940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-8c4108a4-1201-4336-8252-0a11a30953ef None None] MFA Rules not processed for user `218fb4b1911c4772ad8c690bf11fda35`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:00.078203 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8c4108a4-1201-4336-8252-0a11a30953ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:00.142791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1204/2406] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:00.154740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f44bce-6926-42da-91db-0e1c5f205e94 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:00.156648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b3f44bce-6926-42da-91db-0e1c5f205e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:00.172413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:00.236896 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f44bce-6926-42da-91db-0e1c5f205e94 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:00.242631 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa61e8-b881-4607-b477-0205e8a27eea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:00.243251 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa61e8-b881-4607-b477-0205e8a27eea service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:00.243529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa61e8-b881-4607-b477-0205e8a27eea service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:00.243798 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa61e8-b881-4607-b477-0205e8a27eea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:00.251749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa61e8-b881-4607-b477-0205e8a27eea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:00.253314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa61e8-b881-4607-b477-0205e8a27eea service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:00.262178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1203/2407] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:05.511386 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4108a4-1201-4336-8252-0a11a30953ef None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:05.580955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4108a4-1201-4336-8252-0a11a30953ef None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:05.586289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae3332-bef2-48fe-ba0c-09766c59ec92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:05.586931 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae3332-bef2-48fe-ba0c-09766c59ec92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:05.587213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae3332-bef2-48fe-ba0c-09766c59ec92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:05.587491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae3332-bef2-48fe-ba0c-09766c59ec92 admin admin] PATH_INFO: `/v3/users/218fb4b1911c4772ad8c690bf11fda35` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:05.588658 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae3332-bef2-48fe-ba0c-09766c59ec92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=218fb4b1911c4772ad8c690bf11fda35)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:05.590605 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae3332-bef2-48fe-ba0c-09766c59ec92 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:05.593124 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:05.640352 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-01ae3332-bef2-48fe-ba0c-09766c59ec92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218fb4b1911c4772ad8c690bf11fda35'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:05.641023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-01ae3332-bef2-48fe-ba0c-09766c59ec92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218fb4b1911c4772ad8c690bf11fda35'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:05.649219 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-01ae3332-bef2-48fe-ba0c-09766c59ec92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218fb4b1911c4772ad8c690bf11fda35'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:05.656324 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-01ae3332-bef2-48fe-ba0c-09766c59ec92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218fb4b1911c4772ad8c690bf11fda35'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:05.656961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-01ae3332-bef2-48fe-ba0c-09766c59ec92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218fb4b1911c4772ad8c690bf11fda35'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:05.675117 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1205/2408] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:57:05 2022] DELETE /identity/v3/users/218fb4b1911c4772ad8c690bf11fda35 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:05.680312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd692d-fa53-4ec9-92fa-9870f676c0ee None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:05.680816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd692d-fa53-4ec9-92fa-9870f676c0ee None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:05.680916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd692d-fa53-4ec9-92fa-9870f676c0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:05.700248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-bbbd692d-fa53-4ec9-92fa-9870f676c0ee None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:05.701470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-bbbd692d-fa53-4ec9-92fa-9870f676c0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:05.763449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1204/2409] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:05.775346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae3332-bef2-48fe-ba0c-09766c59ec92 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:05.777167 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-01ae3332-bef2-48fe-ba0c-09766c59ec92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:05.838619 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae3332-bef2-48fe-ba0c-09766c59ec92 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:05.843037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc16dca-71c3-44e6-9756-7c3e9137cfbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:05.843702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc16dca-71c3-44e6-9756-7c3e9137cfbc service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:05.844001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc16dca-71c3-44e6-9756-7c3e9137cfbc service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:05.844302 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc16dca-71c3-44e6-9756-7c3e9137cfbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:05.855237 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc16dca-71c3-44e6-9756-7c3e9137cfbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:05.856681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc16dca-71c3-44e6-9756-7c3e9137cfbc service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:05.867523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1206/2410] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:06.153911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd692d-fa53-4ec9-92fa-9870f676c0ee None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:06.155574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-bbbd692d-fa53-4ec9-92fa-9870f676c0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:06.172001 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd692d-fa53-4ec9-92fa-9870f676c0ee None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:06.179306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f9607-162a-4ec6-a94c-0cabf300ca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:06.180373 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f9607-162a-4ec6-a94c-0cabf300ca6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:06.180878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f9607-162a-4ec6-a94c-0cabf300ca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:06.181336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f9607-162a-4ec6-a94c-0cabf300ca6a admin admin] PATH_INFO: `/v3/projects/a78a3f58583440d68144394c43d5862f` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:06.183068 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f9607-162a-4ec6-a94c-0cabf300ca6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78a3f58583440d68144394c43d5862f)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:06.185846 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f9607-162a-4ec6-a94c-0cabf300ca6a admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:06.236773 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-157f9607-162a-4ec6-a94c-0cabf300ca6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78a3f58583440d68144394c43d5862f', 'request_id': 'req-157f9607-162a-4ec6-a94c-0cabf300ca6a'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:06.243912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-157f9607-162a-4ec6-a94c-0cabf300ca6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78a3f58583440d68144394c43d5862f', 'request_id': 'req-157f9607-162a-4ec6-a94c-0cabf300ca6a'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:06.251882 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-157f9607-162a-4ec6-a94c-0cabf300ca6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78a3f58583440d68144394c43d5862f', 'request_id': 'req-157f9607-162a-4ec6-a94c-0cabf300ca6a'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:06.269000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-157f9607-162a-4ec6-a94c-0cabf300ca6a admin admin] The token cache is being invalidate because project a78a3f58583440d68144394c43d5862f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:57:06.269201 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-157f9607-162a-4ec6-a94c-0cabf300ca6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:06.269991 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-157f9607-162a-4ec6-a94c-0cabf300ca6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:06.271847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1205/2411] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:57:06 2022] DELETE /identity/v3/projects/a78a3f58583440d68144394c43d5862f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:06.276986 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03ac0-d3e7-44b0-a00f-b4e337f2cded None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:06.277274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03ac0-d3e7-44b0-a00f-b4e337f2cded None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:06.277551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf03ac0-d3e7-44b0-a00f-b4e337f2cded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:06.299716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-aaf03ac0-d3e7-44b0-a00f-b4e337f2cded None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:06.300916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-aaf03ac0-d3e7-44b0-a00f-b4e337f2cded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:06.361824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1207/2412] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:06.373061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a643ad-0675-4e46-8886-d883eb737a1e None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:06.373473 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a643ad-0675-4e46-8886-d883eb737a1e None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:06.373898 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a643ad-0675-4e46-8886-d883eb737a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:06.394253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-34a643ad-0675-4e46-8886-d883eb737a1e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:06.395450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-34a643ad-0675-4e46-8886-d883eb737a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:06.403937 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1206/2413] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:06.408844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf03ac0-d3e7-44b0-a00f-b4e337f2cded None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:06.420075 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf03ac0-d3e7-44b0-a00f-b4e337f2cded None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:06.424934 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebaa04-814d-4fae-967b-f6c4ce99a4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:06.425541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebaa04-814d-4fae-967b-f6c4ce99a4ca admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:06.425822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebaa04-814d-4fae-967b-f6c4ce99a4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:06.426098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebaa04-814d-4fae-967b-f6c4ce99a4ca admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:06.426855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebaa04-814d-4fae-967b-f6c4ce99a4ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:57:06.427846 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebaa04-814d-4fae-967b-f6c4ce99a4ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:06.429353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebaa04-814d-4fae-967b-f6c4ce99a4ca admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:06.441189 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1208/2414] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:57:06.446405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a643ad-0675-4e46-8886-d883eb737a1e None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:06.455979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a643ad-0675-4e46-8886-d883eb737a1e None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:06.460730 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853b760-f591-41ee-8d75-8c8a2dae5072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:06.461373 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853b760-f591-41ee-8d75-8c8a2dae5072 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:06.461660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853b760-f591-41ee-8d75-8c8a2dae5072 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:06.461934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853b760-f591-41ee-8d75-8c8a2dae5072 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:06.462645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853b760-f591-41ee-8d75-8c8a2dae5072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:06.464608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853b760-f591-41ee-8d75-8c8a2dae5072 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:06.480305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:06.496019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1207/2415] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:57:06 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:06.500524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebaa04-814d-4fae-967b-f6c4ce99a4ca admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:06.510963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebaa04-814d-4fae-967b-f6c4ce99a4ca admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:06.518650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:06.573295 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ec9be-1aff-4e5f-b34d-155352f22948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:06.573827 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ec9be-1aff-4e5f-b34d-155352f22948 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:06.574105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ec9be-1aff-4e5f-b34d-155352f22948 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:06.574409 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ec9be-1aff-4e5f-b34d-155352f22948 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:06.575158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ec9be-1aff-4e5f-b34d-155352f22948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:06.577100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ec9be-1aff-4e5f-b34d-155352f22948 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:06.598612 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1209/2416] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:57:06 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:06.603803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853b760-f591-41ee-8d75-8c8a2dae5072 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:06.615399 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853b760-f591-41ee-8d75-8c8a2dae5072 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:06.620320 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e173641-3d61-4168-bed4-490f57767846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:06.620947 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173641-3d61-4168-bed4-490f57767846 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:06.621241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173641-3d61-4168-bed4-490f57767846 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:06.621508 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173641-3d61-4168-bed4-490f57767846 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:06.622244 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e173641-3d61-4168-bed4-490f57767846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:06.623845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e173641-3d61-4168-bed4-490f57767846 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:06.634451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1208/2417] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:06.638543 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ec9be-1aff-4e5f-b34d-155352f22948 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:06.649260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ec9be-1aff-4e5f-b34d-155352f22948 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:06.653910 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0cc4e-1692-4e15-a7dc-6eb3e27cb9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:06.654557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0cc4e-1692-4e15-a7dc-6eb3e27cb9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:06.654841 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0cc4e-1692-4e15-a7dc-6eb3e27cb9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:06.655118 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0cc4e-1692-4e15-a7dc-6eb3e27cb9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:06.655812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0cc4e-1692-4e15-a7dc-6eb3e27cb9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:06.657402 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0cc4e-1692-4e15-a7dc-6eb3e27cb9f7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:06.672713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1210/2418] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:06.679575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e173641-3d61-4168-bed4-490f57767846 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:06.694444 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e173641-3d61-4168-bed4-490f57767846 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:06.700216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad3585-2d6f-4e3a-b37b-5db25895896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:06.700894 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad3585-2d6f-4e3a-b37b-5db25895896d admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:06.701175 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad3585-2d6f-4e3a-b37b-5db25895896d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:06.701452 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad3585-2d6f-4e3a-b37b-5db25895896d admin admin] PATH_INFO: `/v3/projects/2def3b0417274a9391935033f8287b36/users/37024647ec8643e798d5a73442d7a30a/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:06.718722 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad3585-2d6f-4e3a-b37b-5db25895896d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2def3b0417274a9391935033f8287b36, user_id=37024647ec8643e798d5a73442d7a30a, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:06.721349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad3585-2d6f-4e3a-b37b-5db25895896d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:06.735661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1209/2419] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:06 2022] PUT /identity/v3/projects/2def3b0417274a9391935033f8287b36/users/37024647ec8643e798d5a73442d7a30a/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:06.741681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466550df-62eb-45e0-9e76-aeab3d232fd4 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:06.742000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466550df-62eb-45e0-9e76-aeab3d232fd4 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:06.742357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466550df-62eb-45e0-9e76-aeab3d232fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:06.761944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-466550df-62eb-45e0-9e76-aeab3d232fd4 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:06.763215 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-466550df-62eb-45e0-9e76-aeab3d232fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:06.825164 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1211/2420] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:06.835811 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad3585-2d6f-4e3a-b37b-5db25895896d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:06.837740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-97ad3585-2d6f-4e3a-b37b-5db25895896d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:06.897588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad3585-2d6f-4e3a-b37b-5db25895896d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:06.901329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb3521-f414-4992-8340-2cf132c50b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:06.901958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb3521-f414-4992-8340-2cf132c50b19 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:06.902270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb3521-f414-4992-8340-2cf132c50b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:06.902551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb3521-f414-4992-8340-2cf132c50b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:06.912730 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb3521-f414-4992-8340-2cf132c50b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:06.914198 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb3521-f414-4992-8340-2cf132c50b19 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:06.924212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1210/2421] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:07.831335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc12e-754c-4644-9dcb-6c94497a0e68 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:07.831984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc12e-754c-4644-9dcb-6c94497a0e68 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:07.831984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc12e-754c-4644-9dcb-6c94497a0e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:07.867042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-fb8dc12e-754c-4644-9dcb-6c94497a0e68 None None] MFA Rules not processed for user `37024647ec8643e798d5a73442d7a30a`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:07.868895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-fb8dc12e-754c-4644-9dcb-6c94497a0e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:07.984005 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1212/2422] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:07 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 10:57:07.989054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb3521-f414-4992-8340-2cf132c50b19 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:08.022846 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb3521-f414-4992-8340-2cf132c50b19 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:08.030050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a295-2cb7-472c-936d-7149917f2489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:08.030986 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a295-2cb7-472c-936d-7149917f2489 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:08.031395 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a295-2cb7-472c-936d-7149917f2489 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:08.031847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a295-2cb7-472c-936d-7149917f2489 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:08.032696 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383a295-2cb7-472c-936d-7149917f2489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:08.046678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383a295-2cb7-472c-936d-7149917f2489 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:08.098237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1211/2423] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:57:07 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:57:08.103375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc12e-754c-4644-9dcb-6c94497a0e68 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:08.115977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc12e-754c-4644-9dcb-6c94497a0e68 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:08.137261 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:08.195625 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3b245-f6b6-402a-9759-29a5cec6718d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:08.196959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3b245-f6b6-402a-9759-29a5cec6718d admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:08.197380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3b245-f6b6-402a-9759-29a5cec6718d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:08.197713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3b245-f6b6-402a-9759-29a5cec6718d admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:08.199034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3b245-f6b6-402a-9759-29a5cec6718d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:08.201305 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3b245-f6b6-402a-9759-29a5cec6718d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:08.234222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1213/2424] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:57:08 2022] POST /identity/v3/users => generated 309 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:08.238362 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a295-2cb7-472c-936d-7149917f2489 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:08.250966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a295-2cb7-472c-936d-7149917f2489 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:08.256706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f4976-adc9-43db-9a09-efa063492aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:08.257423 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f4976-adc9-43db-9a09-efa063492aac admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:08.257748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f4976-adc9-43db-9a09-efa063492aac admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:08.258084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f4976-adc9-43db-9a09-efa063492aac admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:08.259012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f4976-adc9-43db-9a09-efa063492aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:08.260665 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f4976-adc9-43db-9a09-efa063492aac admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:08.272237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1212/2425] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:08.276992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3b245-f6b6-402a-9759-29a5cec6718d admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:08.291778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3b245-f6b6-402a-9759-29a5cec6718d admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:08.297014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b667e-6e18-446d-9a31-ffb30e5bf1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:08.297715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b667e-6e18-446d-9a31-ffb30e5bf1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:08.298000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b667e-6e18-446d-9a31-ffb30e5bf1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:08.298331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b667e-6e18-446d-9a31-ffb30e5bf1f2 admin admin] PATH_INFO: `/v3/projects/8411ed8e4c0e4b84b065c5121b6d96dd/users/4635e0ba0bc2415ba01f1df324e8cb6d/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:08.314942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b667e-6e18-446d-9a31-ffb30e5bf1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8411ed8e4c0e4b84b065c5121b6d96dd, user_id=4635e0ba0bc2415ba01f1df324e8cb6d, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:08.318212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b667e-6e18-446d-9a31-ffb30e5bf1f2 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:08.334531 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1214/2426] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:08 2022] PUT /identity/v3/projects/8411ed8e4c0e4b84b065c5121b6d96dd/users/4635e0ba0bc2415ba01f1df324e8cb6d/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:08.338706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f4976-adc9-43db-9a09-efa063492aac admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:08.349041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f4976-adc9-43db-9a09-efa063492aac admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:08.409206 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6438a-7ad5-4116-ba7a-aecdf1be3f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:08.409950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6438a-7ad5-4116-ba7a-aecdf1be3f81 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:08.410383 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6438a-7ad5-4116-ba7a-aecdf1be3f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:08.410693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6438a-7ad5-4116-ba7a-aecdf1be3f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:08.411448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6438a-7ad5-4116-ba7a-aecdf1be3f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:08.413024 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6438a-7ad5-4116-ba7a-aecdf1be3f81 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:08.423305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1213/2427] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:08.428489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b667e-6e18-446d-9a31-ffb30e5bf1f2 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:08.439308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b667e-6e18-446d-9a31-ffb30e5bf1f2 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:08.444773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c918a2-8ac7-428d-b1e1-f3ef2da442fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:08.445378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c918a2-8ac7-428d-b1e1-f3ef2da442fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:08.445663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c918a2-8ac7-428d-b1e1-f3ef2da442fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:08.445956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c918a2-8ac7-428d-b1e1-f3ef2da442fc admin admin] PATH_INFO: `/v3/projects/8411ed8e4c0e4b84b065c5121b6d96dd/users/4635e0ba0bc2415ba01f1df324e8cb6d/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:08.447963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c918a2-8ac7-428d-b1e1-f3ef2da442fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8411ed8e4c0e4b84b065c5121b6d96dd, user_id=4635e0ba0bc2415ba01f1df324e8cb6d, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:08.450654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c918a2-8ac7-428d-b1e1-f3ef2da442fc admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:08.461777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1215/2428] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:08 2022] PUT /identity/v3/projects/8411ed8e4c0e4b84b065c5121b6d96dd/users/4635e0ba0bc2415ba01f1df324e8cb6d/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:57:09.140465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a832ab-137a-4156-b271-97364c63890f None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:09.141626 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a832ab-137a-4156-b271-97364c63890f None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:09.142315 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a832ab-137a-4156-b271-97364c63890f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:09.175236 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e8a832ab-137a-4156-b271-97364c63890f None None] MFA Rules not processed for user `4635e0ba0bc2415ba01f1df324e8cb6d`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:09.176784 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e8a832ab-137a-4156-b271-97364c63890f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:09.192242 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:09.290462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1214/2429] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:09 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:10.475011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c918a2-8ac7-428d-b1e1-f3ef2da442fc admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:10.556348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c918a2-8ac7-428d-b1e1-f3ef2da442fc admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:10.566662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f242141-4cae-4da4-8837-457e6eb121dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:10.567380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f242141-4cae-4da4-8837-457e6eb121dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:10.567670 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f242141-4cae-4da4-8837-457e6eb121dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:10.567946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f242141-4cae-4da4-8837-457e6eb121dd admin admin] PATH_INFO: `/v3/users/37024647ec8643e798d5a73442d7a30a` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:10.569725 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f242141-4cae-4da4-8837-457e6eb121dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=37024647ec8643e798d5a73442d7a30a)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:10.571705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f242141-4cae-4da4-8837-457e6eb121dd admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:10.628545 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3f242141-4cae-4da4-8837-457e6eb121dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37024647ec8643e798d5a73442d7a30a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:10.629301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3f242141-4cae-4da4-8837-457e6eb121dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37024647ec8643e798d5a73442d7a30a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:10.643522 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3f242141-4cae-4da4-8837-457e6eb121dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37024647ec8643e798d5a73442d7a30a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:10.652556 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3f242141-4cae-4da4-8837-457e6eb121dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37024647ec8643e798d5a73442d7a30a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:10.653333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3f242141-4cae-4da4-8837-457e6eb121dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37024647ec8643e798d5a73442d7a30a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:10.662688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:10.675676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1216/2430] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:57:10 2022] DELETE /identity/v3/users/37024647ec8643e798d5a73442d7a30a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:10.856714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a832ab-137a-4156-b271-97364c63890f None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:10.871091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a832ab-137a-4156-b271-97364c63890f None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:10.937198 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:10.937855 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:10.938165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:10.938481 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] PATH_INFO: `/v3/projects/2def3b0417274a9391935033f8287b36` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:10.939655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2def3b0417274a9391935033f8287b36)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:10.941584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:10.990406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2def3b0417274a9391935033f8287b36', 'request_id': 'req-b302dd31-4168-47eb-a018-7d8fb530bbb3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:10.996684 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2def3b0417274a9391935033f8287b36', 'request_id': 'req-b302dd31-4168-47eb-a018-7d8fb530bbb3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:11.005551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2def3b0417274a9391935033f8287b36', 'request_id': 'req-b302dd31-4168-47eb-a018-7d8fb530bbb3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:11.016775 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] The token cache is being invalidate because project 2def3b0417274a9391935033f8287b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:57:11.017065 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:11.017713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:11.019290 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1215/2431] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:57:10 2022] DELETE /identity/v3/projects/2def3b0417274a9391935033f8287b36 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:11.023857 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f242141-4cae-4da4-8837-457e6eb121dd admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:11.025285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3f242141-4cae-4da4-8837-457e6eb121dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:11.039699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f242141-4cae-4da4-8837-457e6eb121dd admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:11.098301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d506b9-e463-41d9-90ba-682a5a91bb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:11.099789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d506b9-e463-41d9-90ba-682a5a91bb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:11.100086 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d506b9-e463-41d9-90ba-682a5a91bb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:11.100343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d506b9-e463-41d9-90ba-682a5a91bb4e admin admin] PATH_INFO: `/v3/users/4635e0ba0bc2415ba01f1df324e8cb6d` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:11.101557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d506b9-e463-41d9-90ba-682a5a91bb4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4635e0ba0bc2415ba01f1df324e8cb6d)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:11.103525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d506b9-e463-41d9-90ba-682a5a91bb4e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:11.157752 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-75d506b9-e463-41d9-90ba-682a5a91bb4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4635e0ba0bc2415ba01f1df324e8cb6d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:11.158435 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-75d506b9-e463-41d9-90ba-682a5a91bb4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4635e0ba0bc2415ba01f1df324e8cb6d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:11.166488 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-75d506b9-e463-41d9-90ba-682a5a91bb4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4635e0ba0bc2415ba01f1df324e8cb6d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:11.174463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-75d506b9-e463-41d9-90ba-682a5a91bb4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4635e0ba0bc2415ba01f1df324e8cb6d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:11.175172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-75d506b9-e463-41d9-90ba-682a5a91bb4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4635e0ba0bc2415ba01f1df324e8cb6d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:11.195661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1217/2432] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:57:11 2022] DELETE /identity/v3/users/4635e0ba0bc2415ba01f1df324e8cb6d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:57:11.381451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:11.383140 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:11.397334 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302dd31-4168-47eb-a018-7d8fb530bbb3 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:11.446021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:11.466709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b5c23-7ea3-4bfc-9344-ca328384a46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:11.467355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b5c23-7ea3-4bfc-9344-ca328384a46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:11.467637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b5c23-7ea3-4bfc-9344-ca328384a46c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:11.467920 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b5c23-7ea3-4bfc-9344-ca328384a46c admin admin] PATH_INFO: `/v3/projects/8411ed8e4c0e4b84b065c5121b6d96dd` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:11.469135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b5c23-7ea3-4bfc-9344-ca328384a46c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8411ed8e4c0e4b84b065c5121b6d96dd)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:11.471190 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b5c23-7ea3-4bfc-9344-ca328384a46c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:11.521741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-025b5c23-7ea3-4bfc-9344-ca328384a46c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8411ed8e4c0e4b84b065c5121b6d96dd', 'request_id': 'req-025b5c23-7ea3-4bfc-9344-ca328384a46c'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:11.528997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-025b5c23-7ea3-4bfc-9344-ca328384a46c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8411ed8e4c0e4b84b065c5121b6d96dd', 'request_id': 'req-025b5c23-7ea3-4bfc-9344-ca328384a46c'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:11.538093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-025b5c23-7ea3-4bfc-9344-ca328384a46c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8411ed8e4c0e4b84b065c5121b6d96dd', 'request_id': 'req-025b5c23-7ea3-4bfc-9344-ca328384a46c'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:11.551254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-025b5c23-7ea3-4bfc-9344-ca328384a46c admin admin] The token cache is being invalidate because project 8411ed8e4c0e4b84b065c5121b6d96dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:57:11.551548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-025b5c23-7ea3-4bfc-9344-ca328384a46c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:11.553143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-025b5c23-7ea3-4bfc-9344-ca328384a46c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:11.554913 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1216/2433] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:57:11 2022] DELETE /identity/v3/projects/8411ed8e4c0e4b84b065c5121b6d96dd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:11.560202 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002ad1b-d1c7-4638-acdc-549e57f22168 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:11.561061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002ad1b-d1c7-4638-acdc-549e57f22168 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:11.561222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002ad1b-d1c7-4638-acdc-549e57f22168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:11.585133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-d002ad1b-d1c7-4638-acdc-549e57f22168 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:11.586435 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-d002ad1b-d1c7-4638-acdc-549e57f22168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:11.667163 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1218/2434] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:11.680300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4f5a7-9691-4f16-8793-77d1886c653b None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:11.680796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4f5a7-9691-4f16-8793-77d1886c653b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:11.681272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4f5a7-9691-4f16-8793-77d1886c653b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:11.713103 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-50a4f5a7-9691-4f16-8793-77d1886c653b None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:11.714367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-50a4f5a7-9691-4f16-8793-77d1886c653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:11.722317 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1217/2435] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:11.727888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002ad1b-d1c7-4638-acdc-549e57f22168 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:11.738173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002ad1b-d1c7-4638-acdc-549e57f22168 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:11.744062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf790ae9-ed2e-4154-9278-e4dd27d47cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:11.744835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf790ae9-ed2e-4154-9278-e4dd27d47cdc admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:11.745166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf790ae9-ed2e-4154-9278-e4dd27d47cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:11.745440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf790ae9-ed2e-4154-9278-e4dd27d47cdc admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:11.746915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf790ae9-ed2e-4154-9278-e4dd27d47cdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:57:11.747228 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf790ae9-ed2e-4154-9278-e4dd27d47cdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:11.750398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf790ae9-ed2e-4154-9278-e4dd27d47cdc admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:11.760896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:11.767137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1219/2436] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:57:11.771881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4f5a7-9691-4f16-8793-77d1886c653b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:11.783638 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4f5a7-9691-4f16-8793-77d1886c653b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:11.791289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787d6d1-00ce-40e0-92d6-079530537f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:11.792083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d6d1-00ce-40e0-92d6-079530537f3b admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:11.792421 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d6d1-00ce-40e0-92d6-079530537f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:11.792792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d6d1-00ce-40e0-92d6-079530537f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:11.793410 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787d6d1-00ce-40e0-92d6-079530537f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:11.795405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787d6d1-00ce-40e0-92d6-079530537f3b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:11.827183 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1218/2437] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:57:11 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:57:11.838166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf790ae9-ed2e-4154-9278-e4dd27d47cdc admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:11.849646 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf790ae9-ed2e-4154-9278-e4dd27d47cdc admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:11.913290 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb2815-4769-474d-b37d-db4c8347dbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:11.913970 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2815-4769-474d-b37d-db4c8347dbff admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:11.914212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2815-4769-474d-b37d-db4c8347dbff admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:11.914505 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2815-4769-474d-b37d-db4c8347dbff admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:11.915216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb2815-4769-474d-b37d-db4c8347dbff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:11.917129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb2815-4769-474d-b37d-db4c8347dbff admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:11.941212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1220/2438] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:57:11 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:11.945049 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787d6d1-00ce-40e0-92d6-079530537f3b admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:11.956100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787d6d1-00ce-40e0-92d6-079530537f3b admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:11.961594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4981859-58a8-4a0e-ae33-d1cbf8222d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:11.962256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4981859-58a8-4a0e-ae33-d1cbf8222d34 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:11.962592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4981859-58a8-4a0e-ae33-d1cbf8222d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:11.962874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4981859-58a8-4a0e-ae33-d1cbf8222d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:11.963583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4981859-58a8-4a0e-ae33-d1cbf8222d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:11.965189 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4981859-58a8-4a0e-ae33-d1cbf8222d34 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:11.976700 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1219/2439] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:57:11.982118 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb2815-4769-474d-b37d-db4c8347dbff admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:11.993709 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb2815-4769-474d-b37d-db4c8347dbff admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:11.998451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07573de4-e15a-4df8-b077-66a7176ef3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:11.999103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07573de4-e15a-4df8-b077-66a7176ef3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:11.999383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07573de4-e15a-4df8-b077-66a7176ef3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:11.999660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07573de4-e15a-4df8-b077-66a7176ef3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:12.000360 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07573de4-e15a-4df8-b077-66a7176ef3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:12.001949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07573de4-e15a-4df8-b077-66a7176ef3a7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:12.012996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1221/2440] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:12.017355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4981859-58a8-4a0e-ae33-d1cbf8222d34 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:12.029366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4981859-58a8-4a0e-ae33-d1cbf8222d34 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:12.034093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722bd0b-150e-4980-922c-f13bde51b83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:12.034796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722bd0b-150e-4980-922c-f13bde51b83d admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:12.035080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722bd0b-150e-4980-922c-f13bde51b83d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:12.035362 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722bd0b-150e-4980-922c-f13bde51b83d admin admin] PATH_INFO: `/v3/projects/e8fb606090bf40d8b327288b1a6e6019/users/df09c3b50e7a444cb776b7646ed2d7ba/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:12.052567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722bd0b-150e-4980-922c-f13bde51b83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8fb606090bf40d8b327288b1a6e6019, user_id=df09c3b50e7a444cb776b7646ed2d7ba, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:12.055516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722bd0b-150e-4980-922c-f13bde51b83d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:12.069170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1220/2441] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:12 2022] PUT /identity/v3/projects/e8fb606090bf40d8b327288b1a6e6019/users/df09c3b50e7a444cb776b7646ed2d7ba/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:12.080186 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d43de6-e36a-4b12-a17c-3bb207038753 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:12.080524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d43de6-e36a-4b12-a17c-3bb207038753 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:12.080860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d43de6-e36a-4b12-a17c-3bb207038753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:12.112841 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-47d43de6-e36a-4b12-a17c-3bb207038753 None None] MFA Rules not processed for user `df09c3b50e7a444cb776b7646ed2d7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:12.115090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-47d43de6-e36a-4b12-a17c-3bb207038753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:12.183203 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1222/2442] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:12.187853 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722bd0b-150e-4980-922c-f13bde51b83d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:12.252822 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722bd0b-150e-4980-922c-f13bde51b83d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:12.257794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fb605-163b-4e70-bcfb-2ef5ff26f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:12.258450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fb605-163b-4e70-bcfb-2ef5ff26f90b admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:12.258741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fb605-163b-4e70-bcfb-2ef5ff26f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:12.259021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fb605-163b-4e70-bcfb-2ef5ff26f90b admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:12.259711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fb605-163b-4e70-bcfb-2ef5ff26f90b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:12.261607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fb605-163b-4e70-bcfb-2ef5ff26f90b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:12.273639 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:12.294702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1221/2443] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:57:12 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:12.299271 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d43de6-e36a-4b12-a17c-3bb207038753 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:12.310243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d43de6-e36a-4b12-a17c-3bb207038753 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:12.367492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aae55-7124-4bb9-887e-a427b8bd87fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:12.368119 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aae55-7124-4bb9-887e-a427b8bd87fd admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:12.368401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aae55-7124-4bb9-887e-a427b8bd87fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:12.368679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340aae55-7124-4bb9-887e-a427b8bd87fd admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:12.369378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340aae55-7124-4bb9-887e-a427b8bd87fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:12.371325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340aae55-7124-4bb9-887e-a427b8bd87fd admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:12.383509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:12.394793 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1223/2444] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:57:12 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:12.399225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fb605-163b-4e70-bcfb-2ef5ff26f90b admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:12.409910 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fb605-163b-4e70-bcfb-2ef5ff26f90b admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:12.415930 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee53f19-86c5-47c4-ae6c-2d30a651e05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:12.416598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee53f19-86c5-47c4-ae6c-2d30a651e05d admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:12.416871 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee53f19-86c5-47c4-ae6c-2d30a651e05d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:12.417153 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee53f19-86c5-47c4-ae6c-2d30a651e05d admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:12.417863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee53f19-86c5-47c4-ae6c-2d30a651e05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:12.419771 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee53f19-86c5-47c4-ae6c-2d30a651e05d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:12.431675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1222/2445] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:12.435960 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aae55-7124-4bb9-887e-a427b8bd87fd admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:12.446886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340aae55-7124-4bb9-887e-a427b8bd87fd admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:12.451913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cbb96-840f-4279-86bc-8eec0b043dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:12.452583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cbb96-840f-4279-86bc-8eec0b043dae admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:12.452869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cbb96-840f-4279-86bc-8eec0b043dae admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:12.453149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cbb96-840f-4279-86bc-8eec0b043dae admin admin] PATH_INFO: `/v3/projects/f69df043a10e4f279bb7d7fe00ee5943/users/eaf7bfe30dd949ea9842b2b37c0b0ab5/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:12.469406 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cbb96-840f-4279-86bc-8eec0b043dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69df043a10e4f279bb7d7fe00ee5943, user_id=eaf7bfe30dd949ea9842b2b37c0b0ab5, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:12.472109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cbb96-840f-4279-86bc-8eec0b043dae admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:12.486000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1224/2446] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:12 2022] PUT /identity/v3/projects/f69df043a10e4f279bb7d7fe00ee5943/users/eaf7bfe30dd949ea9842b2b37c0b0ab5/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:12.491355 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee53f19-86c5-47c4-ae6c-2d30a651e05d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:12.501705 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee53f19-86c5-47c4-ae6c-2d30a651e05d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:12.566200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b5c85-e908-4fbb-8e9f-caeaebc201cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:12.566833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b5c85-e908-4fbb-8e9f-caeaebc201cf admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:12.567113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b5c85-e908-4fbb-8e9f-caeaebc201cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:12.567990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b5c85-e908-4fbb-8e9f-caeaebc201cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:12.568704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b5c85-e908-4fbb-8e9f-caeaebc201cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:12.570426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b5c85-e908-4fbb-8e9f-caeaebc201cf admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:12.580761 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1223/2447] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:57:12.585468 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cbb96-840f-4279-86bc-8eec0b043dae admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:12.595985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cbb96-840f-4279-86bc-8eec0b043dae admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:12.601481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7402531-22bb-44a9-819b-6cd9ad024992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:12.602208 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7402531-22bb-44a9-819b-6cd9ad024992 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:12.602498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7402531-22bb-44a9-819b-6cd9ad024992 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:12.602828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7402531-22bb-44a9-819b-6cd9ad024992 admin admin] PATH_INFO: `/v3/projects/f69df043a10e4f279bb7d7fe00ee5943/users/eaf7bfe30dd949ea9842b2b37c0b0ab5/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:12.604838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7402531-22bb-44a9-819b-6cd9ad024992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69df043a10e4f279bb7d7fe00ee5943, user_id=eaf7bfe30dd949ea9842b2b37c0b0ab5, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:12.607804 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7402531-22bb-44a9-819b-6cd9ad024992 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:12.619345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1225/2448] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:12 2022] PUT /identity/v3/projects/f69df043a10e4f279bb7d7fe00ee5943/users/eaf7bfe30dd949ea9842b2b37c0b0ab5/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:12.631518 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b211ca4-47f4-4e70-817c-4904803fb8d8 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:12.631812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b211ca4-47f4-4e70-817c-4904803fb8d8 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:12.632090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b211ca4-47f4-4e70-817c-4904803fb8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:12.662418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-1b211ca4-47f4-4e70-817c-4904803fb8d8 None None] MFA Rules not processed for user `eaf7bfe30dd949ea9842b2b37c0b0ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:12.663667 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1b211ca4-47f4-4e70-817c-4904803fb8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:12.735381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1224/2449] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:12.747231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7402531-22bb-44a9-819b-6cd9ad024992 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:12.748956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-d7402531-22bb-44a9-819b-6cd9ad024992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:12.809114 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7402531-22bb-44a9-819b-6cd9ad024992 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:12.812795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70c715-ddd1-491e-b661-68488dbcc5c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:12.813411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c715-ddd1-491e-b661-68488dbcc5c7 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:12.813693 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c715-ddd1-491e-b661-68488dbcc5c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:12.813969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c715-ddd1-491e-b661-68488dbcc5c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:12.872386 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70c715-ddd1-491e-b661-68488dbcc5c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:12.873884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70c715-ddd1-491e-b661-68488dbcc5c7 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:12.884537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1226/2450] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:15.507903 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b211ca4-47f4-4e70-817c-4904803fb8d8 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:15.517491 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b211ca4-47f4-4e70-817c-4904803fb8d8 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:15.521503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f94b55-544b-4ba9-bcca-414f1fb97019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:15.522147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f94b55-544b-4ba9-bcca-414f1fb97019 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:15.522459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f94b55-544b-4ba9-bcca-414f1fb97019 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:15.522730 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f94b55-544b-4ba9-bcca-414f1fb97019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:15.532569 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f94b55-544b-4ba9-bcca-414f1fb97019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:15.534046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f94b55-544b-4ba9-bcca-414f1fb97019 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:15.546123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1225/2451] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:21.377271 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70c715-ddd1-491e-b661-68488dbcc5c7 service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:21.379033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-db70c715-ddd1-491e-b661-68488dbcc5c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:21.442895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70c715-ddd1-491e-b661-68488dbcc5c7 service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:21.446713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f72e79-e030-4c22-bdbd-8abb19078ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:21.447383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72e79-e030-4c22-bdbd-8abb19078ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:21.447667 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72e79-e030-4c22-bdbd-8abb19078ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:21.447942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f72e79-e030-4c22-bdbd-8abb19078ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:21.449738 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-89f72e79-e030-4c22-bdbd-8abb19078ff4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:21.460847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f72e79-e030-4c22-bdbd-8abb19078ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:21.462381 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f72e79-e030-4c22-bdbd-8abb19078ff4 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:21.470370 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1227/2452] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:21.584615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb379b8-17ef-4bcd-8e0a-28d4c3b08485 None None] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:21.585310 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb379b8-17ef-4bcd-8e0a-28d4c3b08485 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:21.585310 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb379b8-17ef-4bcd-8e0a-28d4c3b08485 None None] PATH_INFO: `/` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:21.586874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1226/2453] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jul 27 10:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:57:21.593459 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a6aa-badf-483c-a284-881948dbf856 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:21.593810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a6aa-badf-483c-a284-881948dbf856 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:21.594100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25a6aa-badf-483c-a284-881948dbf856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:21.613923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-5b25a6aa-badf-483c-a284-881948dbf856 None None] MFA Rules not processed for user `6b33631df63d4657a8e2ad108ca9f670`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:21.615347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5b25a6aa-badf-483c-a284-881948dbf856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:21.622018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1228/2454] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jul 27 10:57:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:21.635352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb379b8-17ef-4bcd-8e0a-28d4c3b08485 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:21.637238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0bb379b8-17ef-4bcd-8e0a-28d4c3b08485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:21.651829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb379b8-17ef-4bcd-8e0a-28d4c3b08485 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:21.655515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32524c-0e34-4a62-aaaf-ff5059acf7d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:21.656218 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32524c-0e34-4a62-aaaf-ff5059acf7d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:21.656568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32524c-0e34-4a62-aaaf-ff5059acf7d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:21.656917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32524c-0e34-4a62-aaaf-ff5059acf7d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:21.664578 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32524c-0e34-4a62-aaaf-ff5059acf7d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:21.666014 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32524c-0e34-4a62-aaaf-ff5059acf7d2 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:21.675565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1227/2455] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:21.764848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e2a7-545e-4569-8447-b508605e0dc7 None None] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:21.765135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e2a7-545e-4569-8447-b508605e0dc7 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:21.765412 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2e2a7-545e-4569-8447-b508605e0dc7 None None] PATH_INFO: `/` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:21.766768 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1229/2456] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jul 27 10:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 10:57:21.773858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3b76-b400-456a-b1fc-46bd8635f350 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:21.774326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3b76-b400-456a-b1fc-46bd8635f350 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:21.774663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce3b76-b400-456a-b1fc-46bd8635f350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:21.800929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-65ce3b76-b400-456a-b1fc-46bd8635f350 None None] MFA Rules not processed for user `3bb16c9232464cc2aeee12b7fa918b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:21.802942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-65ce3b76-b400-456a-b1fc-46bd8635f350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:21.838031 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:21.880789 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1228/2457] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jul 27 10:57:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:21.891638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2e2a7-545e-4569-8447-b508605e0dc7 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:21.904446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2e2a7-545e-4569-8447-b508605e0dc7 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:21.908428 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8f538-1997-49d4-ab32-1ac67858ea00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:21.909056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8f538-1997-49d4-ab32-1ac67858ea00 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:21.909336 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8f538-1997-49d4-ab32-1ac67858ea00 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:21.909611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8f538-1997-49d4-ab32-1ac67858ea00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:21.919453 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:21.922499 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8f538-1997-49d4-ab32-1ac67858ea00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:21.924642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8f538-1997-49d4-ab32-1ac67858ea00 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:21.938887 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1230/2458] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:28.164208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce3b76-b400-456a-b1fc-46bd8635f350 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:28.269358 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce3b76-b400-456a-b1fc-46bd8635f350 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:28.274735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e7678-1ee9-4f69-afa8-02034188f94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:28.275370 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e7678-1ee9-4f69-afa8-02034188f94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:28.275679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e7678-1ee9-4f69-afa8-02034188f94e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:28.275923 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e7678-1ee9-4f69-afa8-02034188f94e admin admin] PATH_INFO: `/v3/users/df09c3b50e7a444cb776b7646ed2d7ba` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:28.277091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e7678-1ee9-4f69-afa8-02034188f94e admin admin] RBAC: Authorizing `identity:delete_user(user_id=df09c3b50e7a444cb776b7646ed2d7ba)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:28.279022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e7678-1ee9-4f69-afa8-02034188f94e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:28.325688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-456e7678-1ee9-4f69-afa8-02034188f94e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df09c3b50e7a444cb776b7646ed2d7ba'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:28.326366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-456e7678-1ee9-4f69-afa8-02034188f94e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df09c3b50e7a444cb776b7646ed2d7ba'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:28.333265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-456e7678-1ee9-4f69-afa8-02034188f94e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df09c3b50e7a444cb776b7646ed2d7ba'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:28.334619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-456e7678-1ee9-4f69-afa8-02034188f94e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df09c3b50e7a444cb776b7646ed2d7ba'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:28.341879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-456e7678-1ee9-4f69-afa8-02034188f94e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df09c3b50e7a444cb776b7646ed2d7ba'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:28.359051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1229/2459] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:57:28 2022] DELETE /identity/v3/users/df09c3b50e7a444cb776b7646ed2d7ba => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:28.363504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5b6e-fe66-4082-8e9a-dc3d5fb44a6f None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:28.363991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5b6e-fe66-4082-8e9a-dc3d5fb44a6f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:28.364096 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5b6e-fe66-4082-8e9a-dc3d5fb44a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:28.413448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-67db5b6e-fe66-4082-8e9a-dc3d5fb44a6f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:28.414609 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-67db5b6e-fe66-4082-8e9a-dc3d5fb44a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:28.472098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1231/2460] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:28.482455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e7678-1ee9-4f69-afa8-02034188f94e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:28.483894 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-456e7678-1ee9-4f69-afa8-02034188f94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:28.487640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:28.559926 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e7678-1ee9-4f69-afa8-02034188f94e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:28.563662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef642b-d65a-4385-b2b6-1b611b9b93bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:28.564282 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef642b-d65a-4385-b2b6-1b611b9b93bb service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:28.564568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef642b-d65a-4385-b2b6-1b611b9b93bb service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:28.564845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef642b-d65a-4385-b2b6-1b611b9b93bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:28.573996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef642b-d65a-4385-b2b6-1b611b9b93bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:28.575456 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef642b-d65a-4385-b2b6-1b611b9b93bb service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:28.585537 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1230/2461] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:28.847578 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db5b6e-fe66-4082-8e9a-dc3d5fb44a6f None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:28.849565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-67db5b6e-fe66-4082-8e9a-dc3d5fb44a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:28.861395 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db5b6e-fe66-4082-8e9a-dc3d5fb44a6f None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:28.873145 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:28.874052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:28.874282 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:28.874564 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] PATH_INFO: `/v3/projects/e8fb606090bf40d8b327288b1a6e6019` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:28.875768 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8fb606090bf40d8b327288b1a6e6019)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:28.877768 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:28.934536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8fb606090bf40d8b327288b1a6e6019', 'request_id': 'req-8c6a7104-dfd5-48b6-9a21-25225daccff3'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:28.941206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8fb606090bf40d8b327288b1a6e6019', 'request_id': 'req-8c6a7104-dfd5-48b6-9a21-25225daccff3'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:28.947325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8fb606090bf40d8b327288b1a6e6019', 'request_id': 'req-8c6a7104-dfd5-48b6-9a21-25225daccff3'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:28.960402 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] The token cache is being invalidate because project e8fb606090bf40d8b327288b1a6e6019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:57:28.960697 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:28.961342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:28.963030 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1232/2462] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:57:28 2022] DELETE /identity/v3/projects/e8fb606090bf40d8b327288b1a6e6019 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:28.967023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef642b-d65a-4385-b2b6-1b611b9b93bb service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:28.977386 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef642b-d65a-4385-b2b6-1b611b9b93bb service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:29.038159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc9003-5087-4e8f-8331-8984b90481ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:29.038703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc9003-5087-4e8f-8331-8984b90481ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:29.038966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc9003-5087-4e8f-8331-8984b90481ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:29.039240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc9003-5087-4e8f-8331-8984b90481ee admin admin] PATH_INFO: `/v3/users/eaf7bfe30dd949ea9842b2b37c0b0ab5` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:29.040456 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc9003-5087-4e8f-8331-8984b90481ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf7bfe30dd949ea9842b2b37c0b0ab5)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:29.042396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc9003-5087-4e8f-8331-8984b90481ee admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:29.088351 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5dbc9003-5087-4e8f-8331-8984b90481ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf7bfe30dd949ea9842b2b37c0b0ab5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:29.089116 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5dbc9003-5087-4e8f-8331-8984b90481ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf7bfe30dd949ea9842b2b37c0b0ab5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:29.096266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5dbc9003-5087-4e8f-8331-8984b90481ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf7bfe30dd949ea9842b2b37c0b0ab5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:29.096907 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5dbc9003-5087-4e8f-8331-8984b90481ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf7bfe30dd949ea9842b2b37c0b0ab5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:29.104596 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5dbc9003-5087-4e8f-8331-8984b90481ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf7bfe30dd949ea9842b2b37c0b0ab5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:29.123324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1231/2463] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:57:28 2022] DELETE /identity/v3/users/eaf7bfe30dd949ea9842b2b37c0b0ab5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:29.394629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:29.397045 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:29.411416 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a7104-dfd5-48b6-9a21-25225daccff3 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:29.463775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:29.475617 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504651b-290c-4166-8fa8-644848dd1f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:29.476529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504651b-290c-4166-8fa8-644848dd1f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:29.477009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504651b-290c-4166-8fa8-644848dd1f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:29.477802 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504651b-290c-4166-8fa8-644848dd1f19 admin admin] PATH_INFO: `/v3/projects/f69df043a10e4f279bb7d7fe00ee5943` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:29.479035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504651b-290c-4166-8fa8-644848dd1f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f69df043a10e4f279bb7d7fe00ee5943)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:29.481019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504651b-290c-4166-8fa8-644848dd1f19 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:29.531254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9504651b-290c-4166-8fa8-644848dd1f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f69df043a10e4f279bb7d7fe00ee5943', 'request_id': 'req-9504651b-290c-4166-8fa8-644848dd1f19'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:29.537531 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9504651b-290c-4166-8fa8-644848dd1f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f69df043a10e4f279bb7d7fe00ee5943', 'request_id': 'req-9504651b-290c-4166-8fa8-644848dd1f19'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:29.543347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9504651b-290c-4166-8fa8-644848dd1f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f69df043a10e4f279bb7d7fe00ee5943', 'request_id': 'req-9504651b-290c-4166-8fa8-644848dd1f19'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:29.557189 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9504651b-290c-4166-8fa8-644848dd1f19 admin admin] The token cache is being invalidate because project f69df043a10e4f279bb7d7fe00ee5943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:57:29.557489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9504651b-290c-4166-8fa8-644848dd1f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:29.558119 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9504651b-290c-4166-8fa8-644848dd1f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:29.559702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1233/2464] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:57:29 2022] DELETE /identity/v3/projects/f69df043a10e4f279bb7d7fe00ee5943 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:29.565002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd88436-5aa0-4f89-81a7-bcbfea33e642 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:29.565508 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd88436-5aa0-4f89-81a7-bcbfea33e642 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:29.565618 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd88436-5aa0-4f89-81a7-bcbfea33e642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:29.581564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:29.618140 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-bdd88436-5aa0-4f89-81a7-bcbfea33e642 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:29.619408 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-bdd88436-5aa0-4f89-81a7-bcbfea33e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:29.678649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1232/2465] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:29.686228 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91050f-8d17-4664-ade1-15ab78c21d1e None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:29.686523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91050f-8d17-4664-ade1-15ab78c21d1e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:29.686804 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91050f-8d17-4664-ade1-15ab78c21d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:29.706694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-5c91050f-8d17-4664-ade1-15ab78c21d1e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:29.707893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-5c91050f-8d17-4664-ade1-15ab78c21d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:29.716445 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1234/2466] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:29.720721 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd88436-5aa0-4f89-81a7-bcbfea33e642 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:29.731093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd88436-5aa0-4f89-81a7-bcbfea33e642 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:29.735620 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621d288-5d48-473c-9a93-dc8e9c96f73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:29.736231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621d288-5d48-473c-9a93-dc8e9c96f73b admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:29.736514 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621d288-5d48-473c-9a93-dc8e9c96f73b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:29.736792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621d288-5d48-473c-9a93-dc8e9c96f73b admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:29.737490 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621d288-5d48-473c-9a93-dc8e9c96f73b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:57:29.737800 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621d288-5d48-473c-9a93-dc8e9c96f73b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:29.739492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621d288-5d48-473c-9a93-dc8e9c96f73b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:29.751956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1233/2467] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:57:29.756343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91050f-8d17-4664-ade1-15ab78c21d1e None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:29.765565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91050f-8d17-4664-ade1-15ab78c21d1e None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:29.770319 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365488a-5544-4eef-8e5b-fd170568ec9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:29.771073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365488a-5544-4eef-8e5b-fd170568ec9c admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:29.771359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365488a-5544-4eef-8e5b-fd170568ec9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:29.771637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365488a-5544-4eef-8e5b-fd170568ec9c admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:29.772306 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365488a-5544-4eef-8e5b-fd170568ec9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:29.774209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365488a-5544-4eef-8e5b-fd170568ec9c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:29.804334 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1235/2468] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:57:29 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:29.808641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621d288-5d48-473c-9a93-dc8e9c96f73b admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:29.818883 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621d288-5d48-473c-9a93-dc8e9c96f73b admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:29.875581 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649bd26-c361-48b8-b48c-72f675c9f20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:29.876205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649bd26-c361-48b8-b48c-72f675c9f20a admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:29.876490 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649bd26-c361-48b8-b48c-72f675c9f20a admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:29.876765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649bd26-c361-48b8-b48c-72f675c9f20a admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:29.877444 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649bd26-c361-48b8-b48c-72f675c9f20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:29.879483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649bd26-c361-48b8-b48c-72f675c9f20a admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:29.903316 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1234/2469] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:57:29 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:29.907362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365488a-5544-4eef-8e5b-fd170568ec9c admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:29.918561 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365488a-5544-4eef-8e5b-fd170568ec9c admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:29.923254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727004-f48d-4433-a9bd-31b32966927e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:29.924129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727004-f48d-4433-a9bd-31b32966927e admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:29.924415 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727004-f48d-4433-a9bd-31b32966927e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:29.924694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727004-f48d-4433-a9bd-31b32966927e admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:29.925397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9727004-f48d-4433-a9bd-31b32966927e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:29.927035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9727004-f48d-4433-a9bd-31b32966927e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:29.936853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1236/2470] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:29.940690 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649bd26-c361-48b8-b48c-72f675c9f20a admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:29.950734 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649bd26-c361-48b8-b48c-72f675c9f20a admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:29.961500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e81ec-6120-490d-a6fe-92f6cefdcac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:29.962134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e81ec-6120-490d-a6fe-92f6cefdcac7 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:29.962449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e81ec-6120-490d-a6fe-92f6cefdcac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:29.962723 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e81ec-6120-490d-a6fe-92f6cefdcac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:29.963436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e81ec-6120-490d-a6fe-92f6cefdcac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:29.965164 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e81ec-6120-490d-a6fe-92f6cefdcac7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:29.978640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1235/2471] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:29.982876 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727004-f48d-4433-a9bd-31b32966927e admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:29.993504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727004-f48d-4433-a9bd-31b32966927e admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:29.998527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677088c-a9dc-4abc-83cb-41247adbe2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:29.999199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677088c-a9dc-4abc-83cb-41247adbe2e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:29.999484 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677088c-a9dc-4abc-83cb-41247adbe2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:29.999767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677088c-a9dc-4abc-83cb-41247adbe2e7 admin admin] PATH_INFO: `/v3/projects/9e98d608c6194b698f5c83c5acb00129/users/2564d86e6ec943439a98e9f415f7de8e/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:30.015401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677088c-a9dc-4abc-83cb-41247adbe2e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e98d608c6194b698f5c83c5acb00129, user_id=2564d86e6ec943439a98e9f415f7de8e, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:30.018059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677088c-a9dc-4abc-83cb-41247adbe2e7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:30.032242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1237/2472] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:29 2022] PUT /identity/v3/projects/9e98d608c6194b698f5c83c5acb00129/users/2564d86e6ec943439a98e9f415f7de8e/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:57:30.043607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af0e39-416a-44a8-96ba-8a081594275e None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:30.043897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af0e39-416a-44a8-96ba-8a081594275e None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:30.044167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af0e39-416a-44a8-96ba-8a081594275e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:30.077356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-99af0e39-416a-44a8-96ba-8a081594275e None None] MFA Rules not processed for user `2564d86e6ec943439a98e9f415f7de8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:30.077356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-99af0e39-416a-44a8-96ba-8a081594275e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:30.128859 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:30.163822 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1236/2473] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:30.164819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677088c-a9dc-4abc-83cb-41247adbe2e7 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:30.234649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677088c-a9dc-4abc-83cb-41247adbe2e7 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:30.239267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a35df-b680-4205-9d46-0d50eaeddc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:30.240610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a35df-b680-4205-9d46-0d50eaeddc0b admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:30.240995 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a35df-b680-4205-9d46-0d50eaeddc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:30.241395 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a35df-b680-4205-9d46-0d50eaeddc0b admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:30.242089 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a35df-b680-4205-9d46-0d50eaeddc0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:30.244048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a35df-b680-4205-9d46-0d50eaeddc0b admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:30.270271 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1238/2474] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:57:30 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:30.274370 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af0e39-416a-44a8-96ba-8a081594275e None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:30.285489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af0e39-416a-44a8-96ba-8a081594275e None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:30.341123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65914d5-a7e4-49a7-bfd1-f5657970c23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:30.341745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65914d5-a7e4-49a7-bfd1-f5657970c23b admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:30.342020 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65914d5-a7e4-49a7-bfd1-f5657970c23b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:30.342332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65914d5-a7e4-49a7-bfd1-f5657970c23b admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:30.342993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65914d5-a7e4-49a7-bfd1-f5657970c23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:30.344888 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65914d5-a7e4-49a7-bfd1-f5657970c23b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:30.367372 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1237/2475] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:57:30 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:30.371459 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a35df-b680-4205-9d46-0d50eaeddc0b admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:30.378227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:30.382371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a35df-b680-4205-9d46-0d50eaeddc0b admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:30.388478 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c4c42-ad63-478c-b450-59a9f49ebd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:30.389298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c4c42-ad63-478c-b450-59a9f49ebd39 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:30.389637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c4c42-ad63-478c-b450-59a9f49ebd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:30.390062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c4c42-ad63-478c-b450-59a9f49ebd39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:30.390791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c4c42-ad63-478c-b450-59a9f49ebd39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:30.392452 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c4c42-ad63-478c-b450-59a9f49ebd39 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:30.403213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1239/2476] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:30.407298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65914d5-a7e4-49a7-bfd1-f5657970c23b admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:30.418110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65914d5-a7e4-49a7-bfd1-f5657970c23b admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:30.422804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba350924-dc6e-45f1-8f65-2fa310285367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:30.423723 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba350924-dc6e-45f1-8f65-2fa310285367 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:30.424006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba350924-dc6e-45f1-8f65-2fa310285367 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:30.424283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba350924-dc6e-45f1-8f65-2fa310285367 admin admin] PATH_INFO: `/v3/projects/80a2c9a796414871a3c79ec6631b770c/users/895419382c184ec1931b44db7f8a7e24/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:30.439399 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba350924-dc6e-45f1-8f65-2fa310285367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a2c9a796414871a3c79ec6631b770c, user_id=895419382c184ec1931b44db7f8a7e24, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:30.442080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba350924-dc6e-45f1-8f65-2fa310285367 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:30.454759 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1238/2477] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:30 2022] PUT /identity/v3/projects/80a2c9a796414871a3c79ec6631b770c/users/895419382c184ec1931b44db7f8a7e24/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:30.458657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c4c42-ad63-478c-b450-59a9f49ebd39 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:30.468552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c4c42-ad63-478c-b450-59a9f49ebd39 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:30.525652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3666f-2c43-4d0b-946a-94bd9531c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:30.526211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3666f-2c43-4d0b-946a-94bd9531c9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:30.526503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3666f-2c43-4d0b-946a-94bd9531c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:30.526779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3666f-2c43-4d0b-946a-94bd9531c9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:30.527469 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3666f-2c43-4d0b-946a-94bd9531c9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:30.529063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3666f-2c43-4d0b-946a-94bd9531c9f2 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:30.538650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1240/2478] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:30.542860 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba350924-dc6e-45f1-8f65-2fa310285367 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:30.554594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba350924-dc6e-45f1-8f65-2fa310285367 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:30.559670 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107af49-39cb-4c64-b340-f7b59ae09997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:30.560401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107af49-39cb-4c64-b340-f7b59ae09997 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:30.560685 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107af49-39cb-4c64-b340-f7b59ae09997 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:30.560964 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107af49-39cb-4c64-b340-f7b59ae09997 admin admin] PATH_INFO: `/v3/projects/80a2c9a796414871a3c79ec6631b770c/users/895419382c184ec1931b44db7f8a7e24/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:30.562938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107af49-39cb-4c64-b340-f7b59ae09997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a2c9a796414871a3c79ec6631b770c, user_id=895419382c184ec1931b44db7f8a7e24, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:30.565567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107af49-39cb-4c64-b340-f7b59ae09997 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:30.576381 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1239/2479] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:30 2022] PUT /identity/v3/projects/80a2c9a796414871a3c79ec6631b770c/users/895419382c184ec1931b44db7f8a7e24/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:30.588303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d25f0-385c-4414-83d7-0ebd3149fe5d None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:30.588590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d25f0-385c-4414-83d7-0ebd3149fe5d None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:30.588866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d25f0-385c-4414-83d7-0ebd3149fe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:30.617657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-854d25f0-385c-4414-83d7-0ebd3149fe5d None None] MFA Rules not processed for user `895419382c184ec1931b44db7f8a7e24`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:30.618917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-854d25f0-385c-4414-83d7-0ebd3149fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:30.685643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1241/2480] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:30.697435 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107af49-39cb-4c64-b340-f7b59ae09997 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:30.699129 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c107af49-39cb-4c64-b340-f7b59ae09997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:30.755976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107af49-39cb-4c64-b340-f7b59ae09997 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:30.759615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c1277-a0aa-4165-a9d0-7657e6117ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:30.760231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c1277-a0aa-4165-a9d0-7657e6117ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:30.760514 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c1277-a0aa-4165-a9d0-7657e6117ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:30.760796 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c1277-a0aa-4165-a9d0-7657e6117ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:30.769590 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c1277-a0aa-4165-a9d0-7657e6117ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:30.771573 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c1277-a0aa-4165-a9d0-7657e6117ac0 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:30.780979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1240/2481] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:30.847034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d25f0-385c-4414-83d7-0ebd3149fe5d None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:30.909880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d25f0-385c-4414-83d7-0ebd3149fe5d None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:30.915577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ab357-e2ff-4fbd-9948-cc611626de82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:30.916228 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ab357-e2ff-4fbd-9948-cc611626de82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:30.916515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ab357-e2ff-4fbd-9948-cc611626de82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:30.916796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ab357-e2ff-4fbd-9948-cc611626de82 admin admin] PATH_INFO: `/v3/users/2564d86e6ec943439a98e9f415f7de8e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:30.918013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ab357-e2ff-4fbd-9948-cc611626de82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2564d86e6ec943439a98e9f415f7de8e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:30.920149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ab357-e2ff-4fbd-9948-cc611626de82 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:30.937297 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:30.967222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-d69ab357-e2ff-4fbd-9948-cc611626de82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2564d86e6ec943439a98e9f415f7de8e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:30.967877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-d69ab357-e2ff-4fbd-9948-cc611626de82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2564d86e6ec943439a98e9f415f7de8e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:30.975791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-d69ab357-e2ff-4fbd-9948-cc611626de82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2564d86e6ec943439a98e9f415f7de8e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:30.982792 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-d69ab357-e2ff-4fbd-9948-cc611626de82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2564d86e6ec943439a98e9f415f7de8e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:30.983475 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-d69ab357-e2ff-4fbd-9948-cc611626de82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2564d86e6ec943439a98e9f415f7de8e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:31.001308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1242/2482] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:57:30 2022] DELETE /identity/v3/users/2564d86e6ec943439a98e9f415f7de8e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:31.006097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b01011-c6f9-4948-8997-1f2511f17d6b None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:31.006448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b01011-c6f9-4948-8997-1f2511f17d6b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:31.006729 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b01011-c6f9-4948-8997-1f2511f17d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:31.025289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-c4b01011-c6f9-4948-8997-1f2511f17d6b None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:31.026535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c4b01011-c6f9-4948-8997-1f2511f17d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:31.059856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:31.086980 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1241/2483] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:31.096614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ab357-e2ff-4fbd-9948-cc611626de82 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:31.098020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-d69ab357-e2ff-4fbd-9948-cc611626de82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:31.156024 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ab357-e2ff-4fbd-9948-cc611626de82 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:31.160209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1516-8e05-46a0-83a3-f1337d88e5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:31.160845 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1516-8e05-46a0-83a3-f1337d88e5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:31.161134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1516-8e05-46a0-83a3-f1337d88e5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:31.161945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1516-8e05-46a0-83a3-f1337d88e5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:31.171584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef1516-8e05-46a0-83a3-f1337d88e5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:31.173019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef1516-8e05-46a0-83a3-f1337d88e5a8 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:31.183529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1243/2484] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:31.507236 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b01011-c6f9-4948-8997-1f2511f17d6b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:31.508755 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c4b01011-c6f9-4948-8997-1f2511f17d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:31.521898 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b01011-c6f9-4948-8997-1f2511f17d6b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:31.526822 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:31.527549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:31.528284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:31.528284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] PATH_INFO: `/v3/projects/9e98d608c6194b698f5c83c5acb00129` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:31.529538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e98d608c6194b698f5c83c5acb00129)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:31.531559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:31.585175 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e98d608c6194b698f5c83c5acb00129', 'request_id': 'req-5d1d4a20-9854-4f8b-b196-95db0e661ad5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:31.591489 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e98d608c6194b698f5c83c5acb00129', 'request_id': 'req-5d1d4a20-9854-4f8b-b196-95db0e661ad5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:31.598900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e98d608c6194b698f5c83c5acb00129', 'request_id': 'req-5d1d4a20-9854-4f8b-b196-95db0e661ad5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:31.610047 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] The token cache is being invalidate because project 9e98d608c6194b698f5c83c5acb00129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:57:31.610374 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:31.611019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:31.612611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1242/2485] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:57:31 2022] DELETE /identity/v3/projects/9e98d608c6194b698f5c83c5acb00129 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:31.616704 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1516-8e05-46a0-83a3-f1337d88e5a8 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:31.626287 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1516-8e05-46a0-83a3-f1337d88e5a8 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:31.685653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7b1f6-eec9-47da-ae3c-0e774c26a943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:31.686365 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b1f6-eec9-47da-ae3c-0e774c26a943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:31.686653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b1f6-eec9-47da-ae3c-0e774c26a943 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:31.686933 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7b1f6-eec9-47da-ae3c-0e774c26a943 admin admin] PATH_INFO: `/v3/users/895419382c184ec1931b44db7f8a7e24` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:31.688104 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7b1f6-eec9-47da-ae3c-0e774c26a943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=895419382c184ec1931b44db7f8a7e24)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:31.690127 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7b1f6-eec9-47da-ae3c-0e774c26a943 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:31.741481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:31.748770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bac7b1f6-eec9-47da-ae3c-0e774c26a943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895419382c184ec1931b44db7f8a7e24'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:31.749509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bac7b1f6-eec9-47da-ae3c-0e774c26a943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895419382c184ec1931b44db7f8a7e24'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:31.758986 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bac7b1f6-eec9-47da-ae3c-0e774c26a943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895419382c184ec1931b44db7f8a7e24'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:31.766329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bac7b1f6-eec9-47da-ae3c-0e774c26a943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895419382c184ec1931b44db7f8a7e24'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:31.767010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bac7b1f6-eec9-47da-ae3c-0e774c26a943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895419382c184ec1931b44db7f8a7e24'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:31.785131 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1244/2486] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:57:31 2022] DELETE /identity/v3/users/895419382c184ec1931b44db7f8a7e24 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:32.136356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:32.137825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:32.153651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d4a20-9854-4f8b-b196-95db0e661ad5 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:32.220516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:32.221169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:32.221454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:32.221731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5 admin admin] PATH_INFO: `/v3/projects/80a2c9a796414871a3c79ec6631b770c` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:32.222966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a2c9a796414871a3c79ec6631b770c)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:32.225467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:32.271751 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a2c9a796414871a3c79ec6631b770c', 'request_id': 'req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:32.277750 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a2c9a796414871a3c79ec6631b770c', 'request_id': 'req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:32.285048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a2c9a796414871a3c79ec6631b770c', 'request_id': 'req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:32.287060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:32.302470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5 admin admin] The token cache is being invalidate because project 80a2c9a796414871a3c79ec6631b770c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:57:32.302880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:32.303762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9fd1c16e-9edc-478b-b1d4-104a2465fcb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:32.305292 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1243/2487] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:57:32 2022] DELETE /identity/v3/projects/80a2c9a796414871a3c79ec6631b770c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:32.310918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c24a19-9479-40f8-9916-459d70438e82 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:32.311207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c24a19-9479-40f8-9916-459d70438e82 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:32.311479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c24a19-9479-40f8-9916-459d70438e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:32.331866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-43c24a19-9479-40f8-9916-459d70438e82 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:32.333086 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-43c24a19-9479-40f8-9916-459d70438e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:32.392428 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1245/2488] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:32.400588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cfceb-714a-4b9d-91f7-f8b57abf305b None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:32.400886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cfceb-714a-4b9d-91f7-f8b57abf305b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:32.401169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cfceb-714a-4b9d-91f7-f8b57abf305b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:32.421696 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-4c1cfceb-714a-4b9d-91f7-f8b57abf305b None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:32.422992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4c1cfceb-714a-4b9d-91f7-f8b57abf305b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:32.431845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1244/2489] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:32.436293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c24a19-9479-40f8-9916-459d70438e82 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:32.446811 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c24a19-9479-40f8-9916-459d70438e82 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:32.451370 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f02fc-c89c-4230-9a99-229e582915cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:32.451977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f02fc-c89c-4230-9a99-229e582915cd admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:32.452259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f02fc-c89c-4230-9a99-229e582915cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:32.452537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f02fc-c89c-4230-9a99-229e582915cd admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:32.453233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f02fc-c89c-4230-9a99-229e582915cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:57:32.453565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f02fc-c89c-4230-9a99-229e582915cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:32.455182 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f02fc-c89c-4230-9a99-229e582915cd admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:32.469993 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1246/2490] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:57:32.474653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cfceb-714a-4b9d-91f7-f8b57abf305b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:32.484241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cfceb-714a-4b9d-91f7-f8b57abf305b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:32.488987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfd8f2-de47-4236-b1f7-fa4bbb11e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:32.489790 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfd8f2-de47-4236-b1f7-fa4bbb11e28f admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:32.490338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfd8f2-de47-4236-b1f7-fa4bbb11e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:32.490620 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfd8f2-de47-4236-b1f7-fa4bbb11e28f admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:32.491319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfd8f2-de47-4236-b1f7-fa4bbb11e28f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:32.493225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfd8f2-de47-4236-b1f7-fa4bbb11e28f admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:32.521851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1245/2491] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:57:32 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:32.525944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f02fc-c89c-4230-9a99-229e582915cd admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:32.536913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f02fc-c89c-4230-9a99-229e582915cd admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:32.603162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e402564-1f1b-43e8-bb71-625bc711de66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:32.603791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e402564-1f1b-43e8-bb71-625bc711de66 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:32.604077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e402564-1f1b-43e8-bb71-625bc711de66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:32.604357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e402564-1f1b-43e8-bb71-625bc711de66 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:32.605046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e402564-1f1b-43e8-bb71-625bc711de66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:32.607411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e402564-1f1b-43e8-bb71-625bc711de66 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:32.636368 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1247/2492] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:57:32 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:32.637688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfd8f2-de47-4236-b1f7-fa4bbb11e28f admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:32.649829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfd8f2-de47-4236-b1f7-fa4bbb11e28f admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:32.654616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2fa5b-4feb-435c-b3ce-e6488f43bb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:32.655333 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2fa5b-4feb-435c-b3ce-e6488f43bb9d admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:32.655619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2fa5b-4feb-435c-b3ce-e6488f43bb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:32.655897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2fa5b-4feb-435c-b3ce-e6488f43bb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:32.656597 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2fa5b-4feb-435c-b3ce-e6488f43bb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:32.658210 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2fa5b-4feb-435c-b3ce-e6488f43bb9d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:32.668824 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1246/2493] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:32.672858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e402564-1f1b-43e8-bb71-625bc711de66 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:32.683404 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e402564-1f1b-43e8-bb71-625bc711de66 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:32.688081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bde66-c420-46bc-9f20-a587a41811ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:32.688683 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bde66-c420-46bc-9f20-a587a41811ac admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:32.688962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bde66-c420-46bc-9f20-a587a41811ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:32.689235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bde66-c420-46bc-9f20-a587a41811ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:32.689927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bde66-c420-46bc-9f20-a587a41811ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:32.691544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bde66-c420-46bc-9f20-a587a41811ac admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:32.702726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1248/2494] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:32.706847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2fa5b-4feb-435c-b3ce-e6488f43bb9d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:32.717515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2fa5b-4feb-435c-b3ce-e6488f43bb9d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:32.722045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4d694-2c80-4bb4-9099-a0e9ee558a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:32.722719 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4d694-2c80-4bb4-9099-a0e9ee558a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:32.722998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4d694-2c80-4bb4-9099-a0e9ee558a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:32.723271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4d694-2c80-4bb4-9099-a0e9ee558a99 admin admin] PATH_INFO: `/v3/projects/1270d8637d0b401eafa2d456eec57cd7/users/370f44ac95da485ca2304f11dd159ada/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:32.737622 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4d694-2c80-4bb4-9099-a0e9ee558a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1270d8637d0b401eafa2d456eec57cd7, user_id=370f44ac95da485ca2304f11dd159ada, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:32.740296 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4d694-2c80-4bb4-9099-a0e9ee558a99 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:32.752651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1247/2495] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:32 2022] PUT /identity/v3/projects/1270d8637d0b401eafa2d456eec57cd7/users/370f44ac95da485ca2304f11dd159ada/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:32.764299 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4eb4cf-b112-40a4-b1ae-35e1349d3264 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:32.764589 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4eb4cf-b112-40a4-b1ae-35e1349d3264 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:32.764870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4eb4cf-b112-40a4-b1ae-35e1349d3264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:32.791897 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-3a4eb4cf-b112-40a4-b1ae-35e1349d3264 None None] MFA Rules not processed for user `370f44ac95da485ca2304f11dd159ada`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:32.793117 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3a4eb4cf-b112-40a4-b1ae-35e1349d3264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:32.802387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:32.859242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1249/2496] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:32.863875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4d694-2c80-4bb4-9099-a0e9ee558a99 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:32.925555 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4d694-2c80-4bb4-9099-a0e9ee558a99 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:32.930786 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e0097-d0ac-4719-9622-ee6811f1ff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:32.931424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e0097-d0ac-4719-9622-ee6811f1ff36 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:32.931716 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e0097-d0ac-4719-9622-ee6811f1ff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:32.931996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e0097-d0ac-4719-9622-ee6811f1ff36 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:32.932695 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e0097-d0ac-4719-9622-ee6811f1ff36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:32.934655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e0097-d0ac-4719-9622-ee6811f1ff36 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:32.964605 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1248/2497] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:57:32 2022] POST /identity/v3/projects => generated 399 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:32.967076 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4eb4cf-b112-40a4-b1ae-35e1349d3264 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:32.978005 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4eb4cf-b112-40a4-b1ae-35e1349d3264 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:33.034692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590a6d9-9b66-44b7-95d4-22ebf316b2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:33.035344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590a6d9-9b66-44b7-95d4-22ebf316b2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:33.035630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590a6d9-9b66-44b7-95d4-22ebf316b2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:33.035909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590a6d9-9b66-44b7-95d4-22ebf316b2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:33.036631 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590a6d9-9b66-44b7-95d4-22ebf316b2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:33.038553 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590a6d9-9b66-44b7-95d4-22ebf316b2f2 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:33.061677 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1250/2498] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:57:32 2022] POST /identity/v3/users => generated 306 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:33.065830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e0097-d0ac-4719-9622-ee6811f1ff36 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:33.077023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e0097-d0ac-4719-9622-ee6811f1ff36 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:33.082591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b564a3-4f3e-4ca2-8bc2-9dbf851549e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:33.083459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b564a3-4f3e-4ca2-8bc2-9dbf851549e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:33.083753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b564a3-4f3e-4ca2-8bc2-9dbf851549e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:33.084241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b564a3-4f3e-4ca2-8bc2-9dbf851549e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:33.084925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b564a3-4f3e-4ca2-8bc2-9dbf851549e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:33.086649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b564a3-4f3e-4ca2-8bc2-9dbf851549e4 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:33.097957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1249/2499] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:33.102853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590a6d9-9b66-44b7-95d4-22ebf316b2f2 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:33.113221 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590a6d9-9b66-44b7-95d4-22ebf316b2f2 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:33.118635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7840d10-f61e-4b63-adbc-e3c23a1d90c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:33.119301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840d10-f61e-4b63-adbc-e3c23a1d90c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:33.119582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840d10-f61e-4b63-adbc-e3c23a1d90c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:33.119861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840d10-f61e-4b63-adbc-e3c23a1d90c0 admin admin] PATH_INFO: `/v3/projects/854fd43ad44446ab81ba067bfc2661b9/users/97c161b0518547d8aab6f5797fcb011e/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:33.135252 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7840d10-f61e-4b63-adbc-e3c23a1d90c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854fd43ad44446ab81ba067bfc2661b9, user_id=97c161b0518547d8aab6f5797fcb011e, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:33.137909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7840d10-f61e-4b63-adbc-e3c23a1d90c0 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:33.150785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1251/2500] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:33 2022] PUT /identity/v3/projects/854fd43ad44446ab81ba067bfc2661b9/users/97c161b0518547d8aab6f5797fcb011e/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:33.154733 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b564a3-4f3e-4ca2-8bc2-9dbf851549e4 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:33.167032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b564a3-4f3e-4ca2-8bc2-9dbf851549e4 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:33.227460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37385a8e-9b33-4318-a85a-298a4808edab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:33.227997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37385a8e-9b33-4318-a85a-298a4808edab admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:33.228283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37385a8e-9b33-4318-a85a-298a4808edab admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:33.228592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37385a8e-9b33-4318-a85a-298a4808edab admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:33.229303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37385a8e-9b33-4318-a85a-298a4808edab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:33.231389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37385a8e-9b33-4318-a85a-298a4808edab admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:33.233038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:33.244808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1250/2501] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:33.248668 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7840d10-f61e-4b63-adbc-e3c23a1d90c0 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:33.259144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7840d10-f61e-4b63-adbc-e3c23a1d90c0 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:33.264031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c560fe-996d-454e-9e24-27c95a04b100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:33.264694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c560fe-996d-454e-9e24-27c95a04b100 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:33.264978 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c560fe-996d-454e-9e24-27c95a04b100 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:33.265255 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c560fe-996d-454e-9e24-27c95a04b100 admin admin] PATH_INFO: `/v3/projects/854fd43ad44446ab81ba067bfc2661b9/users/97c161b0518547d8aab6f5797fcb011e/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:33.267272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c560fe-996d-454e-9e24-27c95a04b100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854fd43ad44446ab81ba067bfc2661b9, user_id=97c161b0518547d8aab6f5797fcb011e, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:33.269940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c560fe-996d-454e-9e24-27c95a04b100 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:33.280104 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1252/2502] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:33 2022] PUT /identity/v3/projects/854fd43ad44446ab81ba067bfc2661b9/users/97c161b0518547d8aab6f5797fcb011e/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:33.348178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae755c-d10b-4e06-9931-b90c7574cd46 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:33.348466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae755c-d10b-4e06-9931-b90c7574cd46 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:33.348749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae755c-d10b-4e06-9931-b90c7574cd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:33.376151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-2bae755c-d10b-4e06-9931-b90c7574cd46 None None] MFA Rules not processed for user `97c161b0518547d8aab6f5797fcb011e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:33.377367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-2bae755c-d10b-4e06-9931-b90c7574cd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:33.445402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1251/2503] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:33 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:33.455986 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c560fe-996d-454e-9e24-27c95a04b100 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:33.457905 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-33c560fe-996d-454e-9e24-27c95a04b100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:33.515098 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c560fe-996d-454e-9e24-27c95a04b100 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:33.518765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89736ee0-6df8-475c-a38a-c9c810783abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:33.519395 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89736ee0-6df8-475c-a38a-c9c810783abb service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:33.519675 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89736ee0-6df8-475c-a38a-c9c810783abb service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:33.519948 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89736ee0-6df8-475c-a38a-c9c810783abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:33.529512 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89736ee0-6df8-475c-a38a-c9c810783abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:33.530971 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89736ee0-6df8-475c-a38a-c9c810783abb service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:33.540565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1253/2504] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:33.623999 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae755c-d10b-4e06-9931-b90c7574cd46 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:33.635252 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae755c-d10b-4e06-9931-b90c7574cd46 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:33.639453 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf55a9-6fe8-429c-a783-aef1632e98bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:33.640152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf55a9-6fe8-429c-a783-aef1632e98bb service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:33.640475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf55a9-6fe8-429c-a783-aef1632e98bb service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:33.640815 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf55a9-6fe8-429c-a783-aef1632e98bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:33.706900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf55a9-6fe8-429c-a783-aef1632e98bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:33.708338 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf55a9-6fe8-429c-a783-aef1632e98bb service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:33.717515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1252/2505] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:37.814855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89736ee0-6df8-475c-a38a-c9c810783abb service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:37.823665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:37.880323 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89736ee0-6df8-475c-a38a-c9c810783abb service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:37.885012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14275c2-db91-4937-b994-f3b57288a3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:37.885659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14275c2-db91-4937-b994-f3b57288a3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:37.885946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14275c2-db91-4937-b994-f3b57288a3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:37.886251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14275c2-db91-4937-b994-f3b57288a3d2 admin admin] PATH_INFO: `/v3/users/370f44ac95da485ca2304f11dd159ada` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:37.887970 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14275c2-db91-4937-b994-f3b57288a3d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=370f44ac95da485ca2304f11dd159ada)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:37.890142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14275c2-db91-4937-b994-f3b57288a3d2 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:37.937662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c14275c2-db91-4937-b994-f3b57288a3d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '370f44ac95da485ca2304f11dd159ada'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:37.938275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c14275c2-db91-4937-b994-f3b57288a3d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '370f44ac95da485ca2304f11dd159ada'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:37.945478 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c14275c2-db91-4937-b994-f3b57288a3d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '370f44ac95da485ca2304f11dd159ada'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:37.952560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c14275c2-db91-4937-b994-f3b57288a3d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '370f44ac95da485ca2304f11dd159ada'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:37.953195 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c14275c2-db91-4937-b994-f3b57288a3d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '370f44ac95da485ca2304f11dd159ada'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:37.970884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1254/2506] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:57:37 2022] DELETE /identity/v3/users/370f44ac95da485ca2304f11dd159ada => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:37.975935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec6cc2-5bee-4a4d-afbe-eee66f75d67a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:37.976424 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec6cc2-5bee-4a4d-afbe-eee66f75d67a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:37.976535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec6cc2-5bee-4a4d-afbe-eee66f75d67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:37.995887 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-0cec6cc2-5bee-4a4d-afbe-eee66f75d67a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:37.997090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0cec6cc2-5bee-4a4d-afbe-eee66f75d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:38.058398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1253/2507] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:38.068241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14275c2-db91-4937-b994-f3b57288a3d2 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:38.069788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c14275c2-db91-4937-b994-f3b57288a3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:38.127028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14275c2-db91-4937-b994-f3b57288a3d2 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:38.130641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82756c-16a1-46a8-b91a-420de4a18776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:38.131254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82756c-16a1-46a8-b91a-420de4a18776 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:38.131532 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82756c-16a1-46a8-b91a-420de4a18776 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:38.131801 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82756c-16a1-46a8-b91a-420de4a18776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:38.140862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82756c-16a1-46a8-b91a-420de4a18776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:38.142314 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82756c-16a1-46a8-b91a-420de4a18776 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:38.152334 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1255/2508] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:57:38.429064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec6cc2-5bee-4a4d-afbe-eee66f75d67a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:38.430606 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0cec6cc2-5bee-4a4d-afbe-eee66f75d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:38.443513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec6cc2-5bee-4a4d-afbe-eee66f75d67a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:38.448390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:38.449045 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:38.449329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:38.449647 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] PATH_INFO: `/v3/projects/1270d8637d0b401eafa2d456eec57cd7` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:38.450884 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1270d8637d0b401eafa2d456eec57cd7)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:38.452905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:38.471307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:38.502103 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1270d8637d0b401eafa2d456eec57cd7', 'request_id': 'req-5ff3bebd-6bc7-4994-afec-865de49f85e1'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:38.509179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1270d8637d0b401eafa2d456eec57cd7', 'request_id': 'req-5ff3bebd-6bc7-4994-afec-865de49f85e1'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:38.516256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1270d8637d0b401eafa2d456eec57cd7', 'request_id': 'req-5ff3bebd-6bc7-4994-afec-865de49f85e1'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:38.527265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] The token cache is being invalidate because project 1270d8637d0b401eafa2d456eec57cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:57:38.527533 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:38.528159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:38.529713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1254/2509] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:57:38 2022] DELETE /identity/v3/projects/1270d8637d0b401eafa2d456eec57cd7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:38.533761 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82756c-16a1-46a8-b91a-420de4a18776 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:38.543678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82756c-16a1-46a8-b91a-420de4a18776 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:38.570809 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:38.604877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829588b4-ae54-4d04-88df-f92fae209a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:38.605511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829588b4-ae54-4d04-88df-f92fae209a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:38.605791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829588b4-ae54-4d04-88df-f92fae209a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:38.606063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829588b4-ae54-4d04-88df-f92fae209a25 admin admin] PATH_INFO: `/v3/users/97c161b0518547d8aab6f5797fcb011e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:38.607243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829588b4-ae54-4d04-88df-f92fae209a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c161b0518547d8aab6f5797fcb011e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:38.609477 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829588b4-ae54-4d04-88df-f92fae209a25 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:38.657398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-829588b4-ae54-4d04-88df-f92fae209a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c161b0518547d8aab6f5797fcb011e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:38.658046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-829588b4-ae54-4d04-88df-f92fae209a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c161b0518547d8aab6f5797fcb011e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:38.665434 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-829588b4-ae54-4d04-88df-f92fae209a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c161b0518547d8aab6f5797fcb011e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:38.672485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-829588b4-ae54-4d04-88df-f92fae209a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c161b0518547d8aab6f5797fcb011e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:38.673536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-829588b4-ae54-4d04-88df-f92fae209a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c161b0518547d8aab6f5797fcb011e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:38.690316 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1256/2510] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:57:38 2022] DELETE /identity/v3/users/97c161b0518547d8aab6f5797fcb011e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:38.968298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:38.969724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:38.983675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3bebd-6bc7-4994-afec-865de49f85e1 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:39.043516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a7906-674e-4b42-8c18-6f0e13c69309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:39.044220 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a7906-674e-4b42-8c18-6f0e13c69309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:39.044448 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a7906-674e-4b42-8c18-6f0e13c69309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:39.044728 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a7906-674e-4b42-8c18-6f0e13c69309 admin admin] PATH_INFO: `/v3/projects/854fd43ad44446ab81ba067bfc2661b9` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:39.045916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a7906-674e-4b42-8c18-6f0e13c69309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=854fd43ad44446ab81ba067bfc2661b9)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:39.047890 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a7906-674e-4b42-8c18-6f0e13c69309 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:39.095107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-3d3a7906-674e-4b42-8c18-6f0e13c69309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854fd43ad44446ab81ba067bfc2661b9', 'request_id': 'req-3d3a7906-674e-4b42-8c18-6f0e13c69309'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:39.101094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-3d3a7906-674e-4b42-8c18-6f0e13c69309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854fd43ad44446ab81ba067bfc2661b9', 'request_id': 'req-3d3a7906-674e-4b42-8c18-6f0e13c69309'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:39.108282 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-3d3a7906-674e-4b42-8c18-6f0e13c69309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854fd43ad44446ab81ba067bfc2661b9', 'request_id': 'req-3d3a7906-674e-4b42-8c18-6f0e13c69309'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:39.119695 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-3d3a7906-674e-4b42-8c18-6f0e13c69309 admin admin] The token cache is being invalidate because project 854fd43ad44446ab81ba067bfc2661b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:57:39.119974 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-3d3a7906-674e-4b42-8c18-6f0e13c69309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:39.120608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-3d3a7906-674e-4b42-8c18-6f0e13c69309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:39.122117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1255/2511] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:57:38 2022] DELETE /identity/v3/projects/854fd43ad44446ab81ba067bfc2661b9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:39.127050 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc21f94-61ca-4e3e-a52d-248f458ca35e None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:39.127540 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc21f94-61ca-4e3e-a52d-248f458ca35e None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:39.127638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc21f94-61ca-4e3e-a52d-248f458ca35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:39.148021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-2fc21f94-61ca-4e3e-a52d-248f458ca35e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:39.149368 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2fc21f94-61ca-4e3e-a52d-248f458ca35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:39.207638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1257/2512] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:39.215871 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0063c-a2f9-40e3-816b-24d9dedf23b8 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:39.216166 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0063c-a2f9-40e3-816b-24d9dedf23b8 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:39.216463 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0063c-a2f9-40e3-816b-24d9dedf23b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:39.237847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-6cf0063c-a2f9-40e3-816b-24d9dedf23b8 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:39.239174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6cf0063c-a2f9-40e3-816b-24d9dedf23b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:39.248413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1256/2513] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:39.252915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc21f94-61ca-4e3e-a52d-248f458ca35e None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:39.263113 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc21f94-61ca-4e3e-a52d-248f458ca35e None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:39.267615 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd73e2-aaad-437a-ac30-a25c69bfcdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:39.268221 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd73e2-aaad-437a-ac30-a25c69bfcdbf admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:39.268499 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd73e2-aaad-437a-ac30-a25c69bfcdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:39.268771 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd73e2-aaad-437a-ac30-a25c69bfcdbf admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:39.269503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd73e2-aaad-437a-ac30-a25c69bfcdbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:57:39.269807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd73e2-aaad-437a-ac30-a25c69bfcdbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:39.271501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd73e2-aaad-437a-ac30-a25c69bfcdbf admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:39.282773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1258/2514] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 10:57:39.287834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0063c-a2f9-40e3-816b-24d9dedf23b8 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:39.297321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0063c-a2f9-40e3-816b-24d9dedf23b8 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:39.302147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00de9d-19ff-4fab-8e33-ae7438d4423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:39.303534 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00de9d-19ff-4fab-8e33-ae7438d4423f admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:39.303817 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00de9d-19ff-4fab-8e33-ae7438d4423f admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:39.304094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00de9d-19ff-4fab-8e33-ae7438d4423f admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:39.304771 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00de9d-19ff-4fab-8e33-ae7438d4423f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:39.306689 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00de9d-19ff-4fab-8e33-ae7438d4423f admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:39.333598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1257/2515] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:57:39 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:39.338059 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd73e2-aaad-437a-ac30-a25c69bfcdbf admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:39.347978 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd73e2-aaad-437a-ac30-a25c69bfcdbf admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:39.381084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:39.408888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc19245-3cc2-488b-a255-7da8615e1626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:39.409502 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc19245-3cc2-488b-a255-7da8615e1626 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:39.409783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc19245-3cc2-488b-a255-7da8615e1626 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:39.410055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc19245-3cc2-488b-a255-7da8615e1626 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:39.410786 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc19245-3cc2-488b-a255-7da8615e1626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:39.413262 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc19245-3cc2-488b-a255-7da8615e1626 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:39.434689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1259/2516] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:57:39 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:39.439240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00de9d-19ff-4fab-8e33-ae7438d4423f admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:39.449785 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00de9d-19ff-4fab-8e33-ae7438d4423f admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:39.454533 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b20d9f-d145-431b-b2ed-2fa19fbc60d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:39.455143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20d9f-d145-431b-b2ed-2fa19fbc60d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:39.455431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20d9f-d145-431b-b2ed-2fa19fbc60d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:39.455712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20d9f-d145-431b-b2ed-2fa19fbc60d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:39.456449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b20d9f-d145-431b-b2ed-2fa19fbc60d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:39.458040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b20d9f-d145-431b-b2ed-2fa19fbc60d7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:39.459591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:39.470369 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1258/2517] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:39.474051 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc19245-3cc2-488b-a255-7da8615e1626 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:39.484430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc19245-3cc2-488b-a255-7da8615e1626 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:39.489055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597664fd-b1cd-428a-a396-fc8c08e5cba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:39.489651 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597664fd-b1cd-428a-a396-fc8c08e5cba7 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:39.489930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597664fd-b1cd-428a-a396-fc8c08e5cba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:39.490780 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597664fd-b1cd-428a-a396-fc8c08e5cba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:39.491466 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597664fd-b1cd-428a-a396-fc8c08e5cba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:39.493036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597664fd-b1cd-428a-a396-fc8c08e5cba7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:39.502873 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1260/2518] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:39.507547 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b20d9f-d145-431b-b2ed-2fa19fbc60d7 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:39.517688 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b20d9f-d145-431b-b2ed-2fa19fbc60d7 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:39.523730 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff9569-d5ba-4d7f-aa75-f964d67abdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:39.524394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9569-d5ba-4d7f-aa75-f964d67abdd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:39.524684 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9569-d5ba-4d7f-aa75-f964d67abdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:39.524966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9569-d5ba-4d7f-aa75-f964d67abdd7 admin admin] PATH_INFO: `/v3/projects/e16f45755c4d44468020d82b6617b4d3/users/c3971bcb8476448e8600ce637e3dcef3/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:39.540230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff9569-d5ba-4d7f-aa75-f964d67abdd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16f45755c4d44468020d82b6617b4d3, user_id=c3971bcb8476448e8600ce637e3dcef3, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:39.543017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff9569-d5ba-4d7f-aa75-f964d67abdd7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:39.557456 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1259/2519] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:39 2022] PUT /identity/v3/projects/e16f45755c4d44468020d82b6617b4d3/users/c3971bcb8476448e8600ce637e3dcef3/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:39.569667 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c8a22-38d0-4835-8bd0-391605031a4c None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:39.570112 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c8a22-38d0-4835-8bd0-391605031a4c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:39.570433 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c8a22-38d0-4835-8bd0-391605031a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:39.600888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-248c8a22-38d0-4835-8bd0-391605031a4c None None] MFA Rules not processed for user `c3971bcb8476448e8600ce637e3dcef3`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:39.602118 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-248c8a22-38d0-4835-8bd0-391605031a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:39.672469 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1261/2520] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:39.685345 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff9569-d5ba-4d7f-aa75-f964d67abdd7 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:39.687270 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e3ff9569-d5ba-4d7f-aa75-f964d67abdd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:39.746522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff9569-d5ba-4d7f-aa75-f964d67abdd7 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:39.750160 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e92ba2-6559-4866-a5cc-7414fefd3e3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:39.750808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e92ba2-6559-4866-a5cc-7414fefd3e3c service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:39.751088 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e92ba2-6559-4866-a5cc-7414fefd3e3c service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:39.751360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e92ba2-6559-4866-a5cc-7414fefd3e3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:39.760676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e92ba2-6559-4866-a5cc-7414fefd3e3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:39.762105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e92ba2-6559-4866-a5cc-7414fefd3e3c service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:39.770973 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1260/2521] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:42.804037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c8a22-38d0-4835-8bd0-391605031a4c None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:42.865457 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c8a22-38d0-4835-8bd0-391605031a4c None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:42.870025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091766e8-7cdb-4025-91ff-5e09177d6230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:42.870710 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091766e8-7cdb-4025-91ff-5e09177d6230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:42.870996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091766e8-7cdb-4025-91ff-5e09177d6230 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:42.871280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091766e8-7cdb-4025-91ff-5e09177d6230 admin admin] PATH_INFO: `/v3/users/c3971bcb8476448e8600ce637e3dcef3` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:42.872485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091766e8-7cdb-4025-91ff-5e09177d6230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3971bcb8476448e8600ce637e3dcef3)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:42.874437 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091766e8-7cdb-4025-91ff-5e09177d6230 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:42.920574 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:42.922152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-091766e8-7cdb-4025-91ff-5e09177d6230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3971bcb8476448e8600ce637e3dcef3'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:42.922953 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-091766e8-7cdb-4025-91ff-5e09177d6230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3971bcb8476448e8600ce637e3dcef3'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:42.931371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-091766e8-7cdb-4025-91ff-5e09177d6230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3971bcb8476448e8600ce637e3dcef3'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:42.938788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-091766e8-7cdb-4025-91ff-5e09177d6230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3971bcb8476448e8600ce637e3dcef3'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:42.939423 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-091766e8-7cdb-4025-91ff-5e09177d6230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3971bcb8476448e8600ce637e3dcef3'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:42.956652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1262/2522] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:57:42 2022] DELETE /identity/v3/users/c3971bcb8476448e8600ce637e3dcef3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:42.961823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b07567-b675-4ddb-9531-1d8ea1c75d4f None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:42.962327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b07567-b675-4ddb-9531-1d8ea1c75d4f None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:42.962437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b07567-b675-4ddb-9531-1d8ea1c75d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:42.981659 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e4b07567-b675-4ddb-9531-1d8ea1c75d4f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:42.982903 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e4b07567-b675-4ddb-9531-1d8ea1c75d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:43.042038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1261/2523] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:43.051969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091766e8-7cdb-4025-91ff-5e09177d6230 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:43.053422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-091766e8-7cdb-4025-91ff-5e09177d6230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:43.132976 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091766e8-7cdb-4025-91ff-5e09177d6230 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:43.136733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0e241-32fe-4596-b245-3da966cff2df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:43.137350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0e241-32fe-4596-b245-3da966cff2df service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:43.137632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0e241-32fe-4596-b245-3da966cff2df service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:43.137913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0e241-32fe-4596-b245-3da966cff2df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:43.147483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0e241-32fe-4596-b245-3da966cff2df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:43.148901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0e241-32fe-4596-b245-3da966cff2df service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:43.158359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1263/2524] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:43.433844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b07567-b675-4ddb-9531-1d8ea1c75d4f None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:43.435354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e4b07567-b675-4ddb-9531-1d8ea1c75d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:43.448187 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b07567-b675-4ddb-9531-1d8ea1c75d4f None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:43.452850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe0448-661c-46bb-9c63-f4f92c7274aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:43.453498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe0448-661c-46bb-9c63-f4f92c7274aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:43.453780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe0448-661c-46bb-9c63-f4f92c7274aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:43.454057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe0448-661c-46bb-9c63-f4f92c7274aa admin admin] PATH_INFO: `/v3/projects/e16f45755c4d44468020d82b6617b4d3` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:43.455258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe0448-661c-46bb-9c63-f4f92c7274aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e16f45755c4d44468020d82b6617b4d3)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:43.457170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe0448-661c-46bb-9c63-f4f92c7274aa admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:43.502696 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9ebe0448-661c-46bb-9c63-f4f92c7274aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16f45755c4d44468020d82b6617b4d3', 'request_id': 'req-9ebe0448-661c-46bb-9c63-f4f92c7274aa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:43.509666 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9ebe0448-661c-46bb-9c63-f4f92c7274aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16f45755c4d44468020d82b6617b4d3', 'request_id': 'req-9ebe0448-661c-46bb-9c63-f4f92c7274aa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:43.516794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9ebe0448-661c-46bb-9c63-f4f92c7274aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16f45755c4d44468020d82b6617b4d3', 'request_id': 'req-9ebe0448-661c-46bb-9c63-f4f92c7274aa'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:43.523418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:43.528673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9ebe0448-661c-46bb-9c63-f4f92c7274aa admin admin] The token cache is being invalidate because project e16f45755c4d44468020d82b6617b4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:57:43.529142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9ebe0448-661c-46bb-9c63-f4f92c7274aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:43.530238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9ebe0448-661c-46bb-9c63-f4f92c7274aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:43.531892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1262/2525] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:57:43 2022] DELETE /identity/v3/projects/e16f45755c4d44468020d82b6617b4d3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:43.536959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8ff1d-28f8-48d2-bfb4-87cbcaead396 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:43.537254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8ff1d-28f8-48d2-bfb4-87cbcaead396 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:43.537620 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8ff1d-28f8-48d2-bfb4-87cbcaead396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:43.559365 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-39a8ff1d-28f8-48d2-bfb4-87cbcaead396 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:43.560505 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-39a8ff1d-28f8-48d2-bfb4-87cbcaead396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:43.618863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1264/2526] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:43.626721 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a8c9e-39f4-45f0-b209-702e2d1dd1df None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:43.627012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a8c9e-39f4-45f0-b209-702e2d1dd1df None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:43.627293 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a8c9e-39f4-45f0-b209-702e2d1dd1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:43.647497 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-cf3a8c9e-39f4-45f0-b209-702e2d1dd1df None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:43.648695 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-cf3a8c9e-39f4-45f0-b209-702e2d1dd1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:43.656591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1263/2527] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:43.660723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8ff1d-28f8-48d2-bfb4-87cbcaead396 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:43.670663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8ff1d-28f8-48d2-bfb4-87cbcaead396 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:43.675440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5bf5d-b300-4d8b-9b08-d6a6e8dff58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:43.676067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5bf5d-b300-4d8b-9b08-d6a6e8dff58b admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:43.676353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5bf5d-b300-4d8b-9b08-d6a6e8dff58b admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:43.676635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5bf5d-b300-4d8b-9b08-d6a6e8dff58b admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:43.677841 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5bf5d-b300-4d8b-9b08-d6a6e8dff58b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:57:43.678149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5bf5d-b300-4d8b-9b08-d6a6e8dff58b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:43.679762 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5bf5d-b300-4d8b-9b08-d6a6e8dff58b admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:43.691058 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1265/2528] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:57:43.696073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a8c9e-39f4-45f0-b209-702e2d1dd1df None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:43.705262 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a8c9e-39f4-45f0-b209-702e2d1dd1df None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:43.709934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9351e-3e3d-4e4e-8d76-8a626fdcd286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:43.710567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9351e-3e3d-4e4e-8d76-8a626fdcd286 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:43.710850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9351e-3e3d-4e4e-8d76-8a626fdcd286 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:43.711126 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9351e-3e3d-4e4e-8d76-8a626fdcd286 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:43.711783 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9351e-3e3d-4e4e-8d76-8a626fdcd286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:43.713664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9351e-3e3d-4e4e-8d76-8a626fdcd286 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:43.741201 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1264/2529] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:57:43 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:43.745478 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5bf5d-b300-4d8b-9b08-d6a6e8dff58b admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:43.755385 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5bf5d-b300-4d8b-9b08-d6a6e8dff58b admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:43.785210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:43.814160 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b35c4-8a13-42b0-92f0-8b7f58be8682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:43.814814 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b35c4-8a13-42b0-92f0-8b7f58be8682 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:43.815010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b35c4-8a13-42b0-92f0-8b7f58be8682 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:43.815285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b35c4-8a13-42b0-92f0-8b7f58be8682 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:43.815988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b35c4-8a13-42b0-92f0-8b7f58be8682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:43.817925 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b35c4-8a13-42b0-92f0-8b7f58be8682 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:43.838404 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1266/2530] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:57:43 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:57:43.842490 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9351e-3e3d-4e4e-8d76-8a626fdcd286 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:43.853329 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9351e-3e3d-4e4e-8d76-8a626fdcd286 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:43.857873 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11e419-b25b-42d9-87be-9855f97d2961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:43.858510 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11e419-b25b-42d9-87be-9855f97d2961 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:43.858793 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11e419-b25b-42d9-87be-9855f97d2961 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:43.859063 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11e419-b25b-42d9-87be-9855f97d2961 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:43.859753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11e419-b25b-42d9-87be-9855f97d2961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:43.861371 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11e419-b25b-42d9-87be-9855f97d2961 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:43.872023 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1265/2531] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:43.875967 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b35c4-8a13-42b0-92f0-8b7f58be8682 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:43.886577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b35c4-8a13-42b0-92f0-8b7f58be8682 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:43.891318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854c28c-d606-4ef7-8aa6-6e936da36c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:43.891933 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c28c-d606-4ef7-8aa6-6e936da36c9f admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:43.892218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c28c-d606-4ef7-8aa6-6e936da36c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:43.892498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c28c-d606-4ef7-8aa6-6e936da36c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:43.893201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854c28c-d606-4ef7-8aa6-6e936da36c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:43.894895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854c28c-d606-4ef7-8aa6-6e936da36c9f admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:43.905652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1267/2532] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:43.910320 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11e419-b25b-42d9-87be-9855f97d2961 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:43.921458 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11e419-b25b-42d9-87be-9855f97d2961 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:43.926452 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e78de-4bbf-4d75-b1a0-32a952a9ed65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:43.927109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e78de-4bbf-4d75-b1a0-32a952a9ed65 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:43.928019 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e78de-4bbf-4d75-b1a0-32a952a9ed65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:43.928375 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e78de-4bbf-4d75-b1a0-32a952a9ed65 admin admin] PATH_INFO: `/v3/projects/3af6c32723fb4bdd8c154c49944a755b/users/97b3c0f9e91e419ead0705549ed51e07/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:43.942823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e78de-4bbf-4d75-b1a0-32a952a9ed65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af6c32723fb4bdd8c154c49944a755b, user_id=97b3c0f9e91e419ead0705549ed51e07, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:43.945608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e78de-4bbf-4d75-b1a0-32a952a9ed65 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:43.957866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1266/2533] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:43 2022] PUT /identity/v3/projects/3af6c32723fb4bdd8c154c49944a755b/users/97b3c0f9e91e419ead0705549ed51e07/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:43.968242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d21d7f-23fc-440d-9452-536bcb9fcda1 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:43.968534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d21d7f-23fc-440d-9452-536bcb9fcda1 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:43.968817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d21d7f-23fc-440d-9452-536bcb9fcda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:43.996997 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-98d21d7f-23fc-440d-9452-536bcb9fcda1 None None] MFA Rules not processed for user `97b3c0f9e91e419ead0705549ed51e07`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:43.998241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-98d21d7f-23fc-440d-9452-536bcb9fcda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:44.063327 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1268/2534] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:44.074742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e78de-4bbf-4d75-b1a0-32a952a9ed65 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:44.076456 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-488e78de-4bbf-4d75-b1a0-32a952a9ed65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:44.133520 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e78de-4bbf-4d75-b1a0-32a952a9ed65 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:44.137112 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72260557-4e88-4397-86fc-03900e1ebde7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:44.137719 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72260557-4e88-4397-86fc-03900e1ebde7 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:44.137998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72260557-4e88-4397-86fc-03900e1ebde7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:44.138301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72260557-4e88-4397-86fc-03900e1ebde7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:44.146979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72260557-4e88-4397-86fc-03900e1ebde7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:44.148389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72260557-4e88-4397-86fc-03900e1ebde7 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:44.157079 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1267/2535] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:44.182486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d21d7f-23fc-440d-9452-536bcb9fcda1 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:44.245219 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d21d7f-23fc-440d-9452-536bcb9fcda1 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:44.249807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d6464-c045-420f-a8aa-38287738e965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:44.250490 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d6464-c045-420f-a8aa-38287738e965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:44.250775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d6464-c045-420f-a8aa-38287738e965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:44.251055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d6464-c045-420f-a8aa-38287738e965 admin admin] PATH_INFO: `/v3/users/97b3c0f9e91e419ead0705549ed51e07` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:44.252239 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d6464-c045-420f-a8aa-38287738e965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b3c0f9e91e419ead0705549ed51e07)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:44.254160 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d6464-c045-420f-a8aa-38287738e965 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:44.302369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:44.305681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-df4d6464-c045-420f-a8aa-38287738e965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b3c0f9e91e419ead0705549ed51e07'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:44.306459 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-df4d6464-c045-420f-a8aa-38287738e965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b3c0f9e91e419ead0705549ed51e07'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:44.314658 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-df4d6464-c045-420f-a8aa-38287738e965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b3c0f9e91e419ead0705549ed51e07'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:44.321813 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-df4d6464-c045-420f-a8aa-38287738e965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b3c0f9e91e419ead0705549ed51e07'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:44.322437 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-df4d6464-c045-420f-a8aa-38287738e965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b3c0f9e91e419ead0705549ed51e07'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:44.339970 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1269/2536] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:57:44 2022] DELETE /identity/v3/users/97b3c0f9e91e419ead0705549ed51e07 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:44.344924 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bdc0e-f9fe-416a-97f3-b5117745f5dd None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:44.345211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bdc0e-f9fe-416a-97f3-b5117745f5dd None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:44.345492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bdc0e-f9fe-416a-97f3-b5117745f5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:44.364834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-f20bdc0e-f9fe-416a-97f3-b5117745f5dd None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:44.366161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f20bdc0e-f9fe-416a-97f3-b5117745f5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:44.423057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1268/2537] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:44.433195 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d6464-c045-420f-a8aa-38287738e965 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:44.434632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-df4d6464-c045-420f-a8aa-38287738e965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:44.492032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d6464-c045-420f-a8aa-38287738e965 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:44.495665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1c5f3-2d97-487b-8c84-248141850058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:44.496282 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1c5f3-2d97-487b-8c84-248141850058 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:44.496566 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1c5f3-2d97-487b-8c84-248141850058 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:44.496842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1c5f3-2d97-487b-8c84-248141850058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:44.506394 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1c5f3-2d97-487b-8c84-248141850058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:44.507807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1c5f3-2d97-487b-8c84-248141850058 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:44.517152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1270/2538] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:44.779366 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bdc0e-f9fe-416a-97f3-b5117745f5dd None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:44.780800 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f20bdc0e-f9fe-416a-97f3-b5117745f5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:44.793602 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bdc0e-f9fe-416a-97f3-b5117745f5dd None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:44.798583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552a179-1778-435c-808f-93fd837dff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:44.799230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552a179-1778-435c-808f-93fd837dff23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:44.799532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552a179-1778-435c-808f-93fd837dff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:44.799799 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552a179-1778-435c-808f-93fd837dff23 admin admin] PATH_INFO: `/v3/projects/3af6c32723fb4bdd8c154c49944a755b` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:44.800973 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552a179-1778-435c-808f-93fd837dff23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af6c32723fb4bdd8c154c49944a755b)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:44.803762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552a179-1778-435c-808f-93fd837dff23 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:44.839572 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:44.853620 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9552a179-1778-435c-808f-93fd837dff23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af6c32723fb4bdd8c154c49944a755b', 'request_id': 'req-9552a179-1778-435c-808f-93fd837dff23'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:44.859819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9552a179-1778-435c-808f-93fd837dff23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af6c32723fb4bdd8c154c49944a755b', 'request_id': 'req-9552a179-1778-435c-808f-93fd837dff23'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:44.867479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9552a179-1778-435c-808f-93fd837dff23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af6c32723fb4bdd8c154c49944a755b', 'request_id': 'req-9552a179-1778-435c-808f-93fd837dff23'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:44.879327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9552a179-1778-435c-808f-93fd837dff23 admin admin] The token cache is being invalidate because project 3af6c32723fb4bdd8c154c49944a755b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:57:44.879619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9552a179-1778-435c-808f-93fd837dff23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:44.880298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-9552a179-1778-435c-808f-93fd837dff23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:57:44.881948 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1269/2539] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:57:44 2022] DELETE /identity/v3/projects/3af6c32723fb4bdd8c154c49944a755b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:44.886886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf5a33-1ada-4245-abc6-96d34a7d3627 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:44.887322 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf5a33-1ada-4245-abc6-96d34a7d3627 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:44.887430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf5a33-1ada-4245-abc6-96d34a7d3627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:44.907150 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-45cf5a33-1ada-4245-abc6-96d34a7d3627 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:44.908347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-45cf5a33-1ada-4245-abc6-96d34a7d3627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:44.967626 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1271/2540] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:44.977285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f01fc3-527d-4dbf-a30b-0bb3ff6df38d None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:44.977569 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f01fc3-527d-4dbf-a30b-0bb3ff6df38d None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:44.977839 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f01fc3-527d-4dbf-a30b-0bb3ff6df38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:44.997619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-86f01fc3-527d-4dbf-a30b-0bb3ff6df38d None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:44.998836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-86f01fc3-527d-4dbf-a30b-0bb3ff6df38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:45.006656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1270/2541] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:45.011017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf5a33-1ada-4245-abc6-96d34a7d3627 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:45.020563 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf5a33-1ada-4245-abc6-96d34a7d3627 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:45.025724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a473776-99a7-4e5f-ab8e-ec6539eaaf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:45.026356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a473776-99a7-4e5f-ab8e-ec6539eaaf60 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:45.026638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a473776-99a7-4e5f-ab8e-ec6539eaaf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:45.026917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a473776-99a7-4e5f-ab8e-ec6539eaaf60 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:45.027627 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a473776-99a7-4e5f-ab8e-ec6539eaaf60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 10:57:45.027933 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a473776-99a7-4e5f-ab8e-ec6539eaaf60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:45.029509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a473776-99a7-4e5f-ab8e-ec6539eaaf60 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:45.041283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1272/2542] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 10:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 10:57:45.045785 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f01fc3-527d-4dbf-a30b-0bb3ff6df38d None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:45.055554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f01fc3-527d-4dbf-a30b-0bb3ff6df38d None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:45.060310 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3307354-874d-4551-82c3-760da5cf7bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:45.060923 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3307354-874d-4551-82c3-760da5cf7bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:45.061206 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3307354-874d-4551-82c3-760da5cf7bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:45.061484 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3307354-874d-4551-82c3-760da5cf7bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:45.062159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3307354-874d-4551-82c3-760da5cf7bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:45.064100 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3307354-874d-4551-82c3-760da5cf7bd2 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:45.091583 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1271/2543] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:57:45 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 10:57:45.095688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a473776-99a7-4e5f-ab8e-ec6539eaaf60 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:45.106775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a473776-99a7-4e5f-ab8e-ec6539eaaf60 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:45.153505 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:45.165419 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba548a3-15d9-4cc8-8aaa-3a53f06f7cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:45.166040 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba548a3-15d9-4cc8-8aaa-3a53f06f7cac admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:45.166362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba548a3-15d9-4cc8-8aaa-3a53f06f7cac admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:45.166641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba548a3-15d9-4cc8-8aaa-3a53f06f7cac admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:45.167315 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba548a3-15d9-4cc8-8aaa-3a53f06f7cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:45.169250 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba548a3-15d9-4cc8-8aaa-3a53f06f7cac admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:45.190242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1273/2544] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:57:45 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:45.194455 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3307354-874d-4551-82c3-760da5cf7bd2 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:45.204726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3307354-874d-4551-82c3-760da5cf7bd2 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:45.210118 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976b396-e939-4ae6-a908-bab4bec478fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:45.210857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976b396-e939-4ae6-a908-bab4bec478fe admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:45.211133 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976b396-e939-4ae6-a908-bab4bec478fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:45.211412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976b396-e939-4ae6-a908-bab4bec478fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:45.212111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976b396-e939-4ae6-a908-bab4bec478fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:45.213699 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976b396-e939-4ae6-a908-bab4bec478fe admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:45.223646 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1272/2545] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:45.228148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba548a3-15d9-4cc8-8aaa-3a53f06f7cac admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:45.238312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba548a3-15d9-4cc8-8aaa-3a53f06f7cac admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:45.243262 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676274f-7847-4097-ba42-2e11511401a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:45.243874 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676274f-7847-4097-ba42-2e11511401a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:45.244162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676274f-7847-4097-ba42-2e11511401a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:45.244444 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676274f-7847-4097-ba42-2e11511401a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:45.245142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676274f-7847-4097-ba42-2e11511401a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:45.246774 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676274f-7847-4097-ba42-2e11511401a7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:45.257944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1274/2546] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:45.262124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976b396-e939-4ae6-a908-bab4bec478fe admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:45.272874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976b396-e939-4ae6-a908-bab4bec478fe admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:45.277601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72927f6d-d34b-4115-8388-45e550cfac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:45.278331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72927f6d-d34b-4115-8388-45e550cfac1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:45.278620 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72927f6d-d34b-4115-8388-45e550cfac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:45.278903 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72927f6d-d34b-4115-8388-45e550cfac1e admin admin] PATH_INFO: `/v3/projects/62d9c291cb4d455392549453dfca3c3d/users/93777aec68ca4a5cab4aa88ab6371809/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:45.293569 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72927f6d-d34b-4115-8388-45e550cfac1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d9c291cb4d455392549453dfca3c3d, user_id=93777aec68ca4a5cab4aa88ab6371809, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:45.296248 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72927f6d-d34b-4115-8388-45e550cfac1e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:45.309181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1273/2547] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:45 2022] PUT /identity/v3/projects/62d9c291cb4d455392549453dfca3c3d/users/93777aec68ca4a5cab4aa88ab6371809/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:45.314386 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65599bdb-47ee-4744-b93e-4d2794368f41 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:45.314679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65599bdb-47ee-4744-b93e-4d2794368f41 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:45.314962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65599bdb-47ee-4744-b93e-4d2794368f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:45.335593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-65599bdb-47ee-4744-b93e-4d2794368f41 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:45.336811 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-65599bdb-47ee-4744-b93e-4d2794368f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:45.396034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1275/2548] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:45.406212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72927f6d-d34b-4115-8388-45e550cfac1e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:45.407888 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-72927f6d-d34b-4115-8388-45e550cfac1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:45.467827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72927f6d-d34b-4115-8388-45e550cfac1e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:45.471506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f597632-94b7-4ede-a83f-eafb29ec2960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:45.472123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f597632-94b7-4ede-a83f-eafb29ec2960 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:45.472406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f597632-94b7-4ede-a83f-eafb29ec2960 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:45.472704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f597632-94b7-4ede-a83f-eafb29ec2960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:45.482078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f597632-94b7-4ede-a83f-eafb29ec2960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:45.483569 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f597632-94b7-4ede-a83f-eafb29ec2960 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:45.493047 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1274/2549] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:49.456646 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3d1da-cbcd-41d7-8f95-78810792800f None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:49.458616 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3d1da-cbcd-41d7-8f95-78810792800f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:49.459017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3d1da-cbcd-41d7-8f95-78810792800f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:49.498398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-42f3d1da-cbcd-41d7-8f95-78810792800f None None] MFA Rules not processed for user `93777aec68ca4a5cab4aa88ab6371809`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:49.499603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-42f3d1da-cbcd-41d7-8f95-78810792800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:49.570428 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1276/2550] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:49.574981 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f597632-94b7-4ede-a83f-eafb29ec2960 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:49.604290 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f597632-94b7-4ede-a83f-eafb29ec2960 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:49.609112 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb47838-a0af-4fab-9416-db7358c01451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:49.609837 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb47838-a0af-4fab-9416-db7358c01451 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:49.610226 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb47838-a0af-4fab-9416-db7358c01451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:49.610629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb47838-a0af-4fab-9416-db7358c01451 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:49.611389 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb47838-a0af-4fab-9416-db7358c01451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:49.613716 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb47838-a0af-4fab-9416-db7358c01451 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:49.645735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1275/2551] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 10:57:49 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:49.649877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3d1da-cbcd-41d7-8f95-78810792800f None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:49.660942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3d1da-cbcd-41d7-8f95-78810792800f None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:49.721582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f1256-567f-418c-ba46-716d8165d940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:49.722133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f1256-567f-418c-ba46-716d8165d940 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:49.722478 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f1256-567f-418c-ba46-716d8165d940 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:49.722749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f1256-567f-418c-ba46-716d8165d940 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:49.723427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f1256-567f-418c-ba46-716d8165d940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:49.725921 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07f1256-567f-418c-ba46-716d8165d940 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:49.734593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:49.752334 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1277/2552] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 10:57:49 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 10:57:49.756349 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb47838-a0af-4fab-9416-db7358c01451 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:49.766951 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb47838-a0af-4fab-9416-db7358c01451 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:49.771938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08aa26-b4cf-4cb3-8d32-02b0574af55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:49.772570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08aa26-b4cf-4cb3-8d32-02b0574af55b admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:49.772862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08aa26-b4cf-4cb3-8d32-02b0574af55b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:49.773743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08aa26-b4cf-4cb3-8d32-02b0574af55b admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:49.773892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08aa26-b4cf-4cb3-8d32-02b0574af55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:49.775576 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08aa26-b4cf-4cb3-8d32-02b0574af55b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:49.787530 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1276/2553] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 10:57:49.791806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f1256-567f-418c-ba46-716d8165d940 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:49.802942 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f1256-567f-418c-ba46-716d8165d940 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:49.807807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcd2a0-655d-4bc7-9e00-35a3a22e75a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:49.808501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcd2a0-655d-4bc7-9e00-35a3a22e75a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:49.808787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcd2a0-655d-4bc7-9e00-35a3a22e75a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:49.809072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcd2a0-655d-4bc7-9e00-35a3a22e75a1 admin admin] PATH_INFO: `/v3/projects/4e7c9e073cce4b41afb857c1634cf932/users/e0ca7ed706fb4bc29054f321a6230438/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:49.826508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcd2a0-655d-4bc7-9e00-35a3a22e75a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7c9e073cce4b41afb857c1634cf932, user_id=e0ca7ed706fb4bc29054f321a6230438, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:49.829232 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcd2a0-655d-4bc7-9e00-35a3a22e75a1 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:49.845630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1278/2554] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:49 2022] PUT /identity/v3/projects/4e7c9e073cce4b41afb857c1634cf932/users/e0ca7ed706fb4bc29054f321a6230438/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:49.850457 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08aa26-b4cf-4cb3-8d32-02b0574af55b admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:49.861006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08aa26-b4cf-4cb3-8d32-02b0574af55b admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:49.904469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:49.956312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759026e-fda8-4154-83c7-15d479b5702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:49.957047 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759026e-fda8-4154-83c7-15d479b5702c admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:49.957397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759026e-fda8-4154-83c7-15d479b5702c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:49.957737 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759026e-fda8-4154-83c7-15d479b5702c admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:49.959314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759026e-fda8-4154-83c7-15d479b5702c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:49.960981 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759026e-fda8-4154-83c7-15d479b5702c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:49.971858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1277/2555] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 10:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 10:57:49.980251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcd2a0-655d-4bc7-9e00-35a3a22e75a1 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:49.991864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcd2a0-655d-4bc7-9e00-35a3a22e75a1 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:49.996609 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19832d-c17b-4c09-a8a1-ea7dfdc3a016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:49.997291 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19832d-c17b-4c09-a8a1-ea7dfdc3a016 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:49.997570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19832d-c17b-4c09-a8a1-ea7dfdc3a016 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:49.997842 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19832d-c17b-4c09-a8a1-ea7dfdc3a016 admin admin] PATH_INFO: `/v3/projects/4e7c9e073cce4b41afb857c1634cf932/users/e0ca7ed706fb4bc29054f321a6230438/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:49.999875 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19832d-c17b-4c09-a8a1-ea7dfdc3a016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7c9e073cce4b41afb857c1634cf932, user_id=e0ca7ed706fb4bc29054f321a6230438, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:50.002626 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19832d-c17b-4c09-a8a1-ea7dfdc3a016 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:50.014601 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1279/2556] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 10:57:49 2022] PUT /identity/v3/projects/4e7c9e073cce4b41afb857c1634cf932/users/e0ca7ed706fb4bc29054f321a6230438/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:57:54.277062 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2ad2a-c09e-4618-92bc-85c767378d8a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:54.277540 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2ad2a-c09e-4618-92bc-85c767378d8a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:54.277640 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2ad2a-c09e-4618-92bc-85c767378d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:54.309396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-5ff2ad2a-c09e-4618-92bc-85c767378d8a None None] MFA Rules not processed for user `e0ca7ed706fb4bc29054f321a6230438`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:54.310571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5ff2ad2a-c09e-4618-92bc-85c767378d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:54.383798 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1278/2557] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:57:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:54.396906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19832d-c17b-4c09-a8a1-ea7dfdc3a016 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:54.399071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7b19832d-c17b-4c09-a8a1-ea7dfdc3a016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:54.461815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19832d-c17b-4c09-a8a1-ea7dfdc3a016 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:54.465432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea9887-dab3-475a-982a-b20cabf636b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4e81eb81934784b8632248ecf0894f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:54.466052 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea9887-dab3-475a-982a-b20cabf636b4 service glance] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:54.466373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea9887-dab3-475a-982a-b20cabf636b4 service glance] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:54.466654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea9887-dab3-475a-982a-b20cabf636b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:54.529822 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea9887-dab3-475a-982a-b20cabf636b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:54.531347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea9887-dab3-475a-982a-b20cabf636b4 service glance] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:54.541312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1280/2558] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:57:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:57:54.702482 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472db20-5b75-4f10-b16b-ae0b43d8c836 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:54.702779 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472db20-5b75-4f10-b16b-ae0b43d8c836 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:54.703069 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472db20-5b75-4f10-b16b-ae0b43d8c836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:54.735109 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-6472db20-5b75-4f10-b16b-ae0b43d8c836 None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:57:54.736353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6472db20-5b75-4f10-b16b-ae0b43d8c836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:54.813949 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1279/2559] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 10:57:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:57:54.865025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea9887-dab3-475a-982a-b20cabf636b4 service glance] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:57:54.866579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a8ea9887-dab3-475a-982a-b20cabf636b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:57:54.938821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea9887-dab3-475a-982a-b20cabf636b4 service glance] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:57:54.945101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d14441-cf0e-4403-8952-765ce2446cf8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:57:54.945739 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d14441-cf0e-4403-8952-765ce2446cf8 service swift] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:57:54.946023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d14441-cf0e-4403-8952-765ce2446cf8 service swift] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:57:54.946330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d14441-cf0e-4403-8952-765ce2446cf8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:57:54.953562 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:57:54.961255 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d14441-cf0e-4403-8952-765ce2446cf8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:57:54.962084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d14441-cf0e-4403-8952-765ce2446cf8 service swift] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:57:54.989903 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1281/2560] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 10:57:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 10:58:03.635426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d45fe-e991-4fdc-a8a7-f406614d89c4 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:58:03.635971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d45fe-e991-4fdc-a8a7-f406614d89c4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:58:03.635971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d45fe-e991-4fdc-a8a7-f406614d89c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:58:03.658173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-d29d45fe-e991-4fdc-a8a7-f406614d89c4 None None] MFA Rules not processed for user `93777aec68ca4a5cab4aa88ab6371809`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:58:03.659391 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d29d45fe-e991-4fdc-a8a7-f406614d89c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:58:03.666308 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1280/2561] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:58:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:58:04.982788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:58:05.538623 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3938-4016-428f-bf8e-9b3caaabe5c6 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:58:05.538907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3938-4016-428f-bf8e-9b3caaabe5c6 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:58:05.539186 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3938-4016-428f-bf8e-9b3caaabe5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:58:05.565528 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-744a3938-4016-428f-bf8e-9b3caaabe5c6 None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:58:05.567799 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-744a3938-4016-428f-bf8e-9b3caaabe5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:58:05.575411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1282/2562] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 10:58:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:58:05.588149 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d45fe-e991-4fdc-a8a7-f406614d89c4 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:58:05.600126 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d45fe-e991-4fdc-a8a7-f406614d89c4 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:58:05.605165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a18e2-fb4b-4210-b57a-f9b7eb303807 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:58:05.605808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a18e2-fb4b-4210-b57a-f9b7eb303807 service swift] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:58:05.606092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a18e2-fb4b-4210-b57a-f9b7eb303807 service swift] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:58:05.606405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a18e2-fb4b-4210-b57a-f9b7eb303807 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:58:05.614983 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a18e2-fb4b-4210-b57a-f9b7eb303807 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:58:05.616643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a18e2-fb4b-4210-b57a-f9b7eb303807 service swift] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:58:05.626714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1281/2563] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 10:58:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 10:58:15.559951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:58:15.621699 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:58:34.233583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3938-4016-428f-bf8e-9b3caaabe5c6 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:58:34.235896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-744a3938-4016-428f-bf8e-9b3caaabe5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:58:34.436193 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3938-4016-428f-bf8e-9b3caaabe5c6 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:58:34.448776 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cff138-e4e5-4acc-b421-222f67e4330e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:58:34.449443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cff138-e4e5-4acc-b421-222f67e4330e service placement] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:58:34.449729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cff138-e4e5-4acc-b421-222f67e4330e service placement] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:58:34.450013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cff138-e4e5-4acc-b421-222f67e4330e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:58:34.452370 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-73cff138-e4e5-4acc-b421-222f67e4330e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:58:34.475225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cff138-e4e5-4acc-b421-222f67e4330e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:58:34.477082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cff138-e4e5-4acc-b421-222f67e4330e service placement] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:58:34.491093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1283/2564] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:58:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:58:35.806147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a18e2-fb4b-4210-b57a-f9b7eb303807 service swift] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:58:35.885405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a18e2-fb4b-4210-b57a-f9b7eb303807 service swift] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:58:35.889320 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a01d6-19ca-4912-bca2-b2764e9fa9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:58:35.889948 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a01d6-19ca-4912-bca2-b2764e9fa9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:58:35.890254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a01d6-19ca-4912-bca2-b2764e9fa9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:58:35.890531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a01d6-19ca-4912-bca2-b2764e9fa9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:58:35.902388 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a01d6-19ca-4912-bca2-b2764e9fa9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:58:35.903839 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a01d6-19ca-4912-bca2-b2764e9fa9a1 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:58:35.914123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1282/2565] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:58:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:58:39.585364 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6beda3-99bf-4dec-afc8-3bcc9c9bb909 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:58:39.585944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6beda3-99bf-4dec-afc8-3bcc9c9bb909 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:58:39.586128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6beda3-99bf-4dec-afc8-3bcc9c9bb909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:58:39.605062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-bd6beda3-99bf-4dec-afc8-3bcc9c9bb909 None None] MFA Rules not processed for user `00e8fb23313f4e168eb2f690039379ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:58:39.606338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-bd6beda3-99bf-4dec-afc8-3bcc9c9bb909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:58:39.674692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1284/2566] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 10:58:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:58:42.712546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63d7ef-c115-4485-bf36-aa43355178d2 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:58:42.712546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63d7ef-c115-4485-bf36-aa43355178d2 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:58:42.713097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63d7ef-c115-4485-bf36-aa43355178d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:58:42.744588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-ea63d7ef-c115-4485-bf36-aa43355178d2 None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:58:42.745823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ea63d7ef-c115-4485-bf36-aa43355178d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:58:42.756814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1283/2567] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 10:58:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:58:42.770004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6beda3-99bf-4dec-afc8-3bcc9c9bb909 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:58:42.784807 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6beda3-99bf-4dec-afc8-3bcc9c9bb909 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:58:42.792498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82318da8-5720-4829-b8f0-5551c00b3f1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:58:42.793757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82318da8-5720-4829-b8f0-5551c00b3f1f service swift] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:58:42.794263 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82318da8-5720-4829-b8f0-5551c00b3f1f service swift] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:58:42.794546 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82318da8-5720-4829-b8f0-5551c00b3f1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:58:42.805125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82318da8-5720-4829-b8f0-5551c00b3f1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:58:42.807970 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82318da8-5720-4829-b8f0-5551c00b3f1f service swift] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:58:42.816787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1285/2568] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 10:58:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 10:58:52.737663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=29 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:58:52.813866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=72 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:59:01.103115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9c88-f49d-486e-b1f5-cd185ce1f751 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:59:01.103623 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9c88-f49d-486e-b1f5-cd185ce1f751 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:59:01.103725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a9c88-f49d-486e-b1f5-cd185ce1f751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:59:01.123407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-073a9c88-f49d-486e-b1f5-cd185ce1f751 None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:59:01.124532 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-073a9c88-f49d-486e-b1f5-cd185ce1f751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:59:01.131664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1284/2569] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 10:59:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:59:01.154595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82318da8-5720-4829-b8f0-5551c00b3f1f service swift] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:59:01.167206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82318da8-5720-4829-b8f0-5551c00b3f1f service swift] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:59:01.172611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0af341-9c9e-4537-9cf7-a597626487c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:59:01.173225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0af341-9c9e-4537-9cf7-a597626487c2 service swift] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:59:01.173512 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0af341-9c9e-4537-9cf7-a597626487c2 service swift] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:59:01.173789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0af341-9c9e-4537-9cf7-a597626487c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:59:01.183011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0af341-9c9e-4537-9cf7-a597626487c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:59:01.184622 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0af341-9c9e-4537-9cf7-a597626487c2 service swift] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:59:01.192949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1286/2570] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 10:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 10:59:11.117752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:59:11.189688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=6 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:59:23.952393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390dd1c-ae03-41d0-be19-25877066cf07 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:59:23.952876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390dd1c-ae03-41d0-be19-25877066cf07 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:59:23.952969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390dd1c-ae03-41d0-be19-25877066cf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:59:23.972105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-5390dd1c-ae03-41d0-be19-25877066cf07 None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 10:59:23.973277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5390dd1c-ae03-41d0-be19-25877066cf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:59:23.980931 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1285/2571] 10.222.0.43 () {58 vars in 967 bytes} [Wed Jul 27 10:59:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 10:59:23.992976 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0af341-9c9e-4537-9cf7-a597626487c2 service swift] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:59:24.003735 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0af341-9c9e-4537-9cf7-a597626487c2 service swift] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:59:24.008697 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bced97-ebef-4cb8-8d90-527ee025daf8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:59:24.009881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bced97-ebef-4cb8-8d90-527ee025daf8 service swift] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:59:24.010213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bced97-ebef-4cb8-8d90-527ee025daf8 service swift] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:59:24.010532 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bced97-ebef-4cb8-8d90-527ee025daf8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:59:24.018544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bced97-ebef-4cb8-8d90-527ee025daf8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:59:24.020148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bced97-ebef-4cb8-8d90-527ee025daf8 service swift] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:59:24.029021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1287/2572] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 10:59:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 10:59:33.967048 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:59:34.025183 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=6 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:59:34.597606 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390dd1c-ae03-41d0-be19-25877066cf07 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:59:34.608061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390dd1c-ae03-41d0-be19-25877066cf07 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:59:34.611702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751455f-ad69-46e9-9de1-4b066d041c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:59:34.612314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751455f-ad69-46e9-9de1-4b066d041c68 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:59:34.612600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751455f-ad69-46e9-9de1-4b066d041c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:59:34.612879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751455f-ad69-46e9-9de1-4b066d041c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:59:34.614673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-8751455f-ad69-46e9-9de1-4b066d041c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:59:34.675938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751455f-ad69-46e9-9de1-4b066d041c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:59:34.677383 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751455f-ad69-46e9-9de1-4b066d041c68 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:59:34.687148 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1286/2573] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:59:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:59:39.979916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bced97-ebef-4cb8-8d90-527ee025daf8 service swift] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:59:39.989682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bced97-ebef-4cb8-8d90-527ee025daf8 service swift] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:59:39.993422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a69c2c-91e7-4f76-b800-8d7c1a8a31fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:59:39.994032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a69c2c-91e7-4f76-b800-8d7c1a8a31fb service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:59:39.994414 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a69c2c-91e7-4f76-b800-8d7c1a8a31fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:59:39.994732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a69c2c-91e7-4f76-b800-8d7c1a8a31fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:59:39.996444 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-24a69c2c-91e7-4f76-b800-8d7c1a8a31fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:59:40.060114 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a69c2c-91e7-4f76-b800-8d7c1a8a31fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:59:40.061500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a69c2c-91e7-4f76-b800-8d7c1a8a31fb service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:59:40.071855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1288/2574] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:59:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 10:59:44.683002 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=28 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:59:45.878233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751455f-ad69-46e9-9de1-4b066d041c68 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:59:45.880346 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-8751455f-ad69-46e9-9de1-4b066d041c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:59:45.897058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751455f-ad69-46e9-9de1-4b066d041c68 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:59:45.903108 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d796642-71e2-4a32-90f4-6a450d25a285 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:59:45.903753 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d796642-71e2-4a32-90f4-6a450d25a285 service placement] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:59:45.903934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d796642-71e2-4a32-90f4-6a450d25a285 service placement] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:59:45.904224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d796642-71e2-4a32-90f4-6a450d25a285 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:59:45.906359 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1d796642-71e2-4a32-90f4-6a450d25a285 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:59:45.930939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d796642-71e2-4a32-90f4-6a450d25a285 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:59:45.932550 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d796642-71e2-4a32-90f4-6a450d25a285 service placement] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:59:45.941855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a69c2c-91e7-4f76-b800-8d7c1a8a31fb service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:59:45.943916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-24a69c2c-91e7-4f76-b800-8d7c1a8a31fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:59:45.944698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1287/2575] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 10:59:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 10:59:45.958020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a69c2c-91e7-4f76-b800-8d7c1a8a31fb service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:59:45.966727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e864c7e-01a0-4dab-a3e0-5796aae736a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:59:45.967585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e864c7e-01a0-4dab-a3e0-5796aae736a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:59:45.967869 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e864c7e-01a0-4dab-a3e0-5796aae736a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:59:45.968179 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e864c7e-01a0-4dab-a3e0-5796aae736a6 admin admin] PATH_INFO: `/v3/users/30c3ac076b014aa6a5c26e7b8ae99232` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:59:45.969377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e864c7e-01a0-4dab-a3e0-5796aae736a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c3ac076b014aa6a5c26e7b8ae99232)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:59:45.971412 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e864c7e-01a0-4dab-a3e0-5796aae736a6 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:59:46.025540 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-7e864c7e-01a0-4dab-a3e0-5796aae736a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c3ac076b014aa6a5c26e7b8ae99232'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.026281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-7e864c7e-01a0-4dab-a3e0-5796aae736a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c3ac076b014aa6a5c26e7b8ae99232'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.033483 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-7e864c7e-01a0-4dab-a3e0-5796aae736a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c3ac076b014aa6a5c26e7b8ae99232'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.040810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-7e864c7e-01a0-4dab-a3e0-5796aae736a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c3ac076b014aa6a5c26e7b8ae99232'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.041558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-7e864c7e-01a0-4dab-a3e0-5796aae736a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c3ac076b014aa6a5c26e7b8ae99232'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.059897 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1289/2576] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:59:45 2022] DELETE /identity/v3/users/30c3ac076b014aa6a5c26e7b8ae99232 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:59:46.495233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d796642-71e2-4a32-90f4-6a450d25a285 service placement] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:59:46.508815 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d796642-71e2-4a32-90f4-6a450d25a285 service placement] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:59:46.568630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:59:46.569280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:59:46.569564 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:59:46.569840 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] PATH_INFO: `/v3/projects/24b63e695b094979bec660b3aeb8b069` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:59:46.571544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b63e695b094979bec660b3aeb8b069)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:59:46.573427 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:59:46.618810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b63e695b094979bec660b3aeb8b069', 'request_id': 'req-977e3ae7-629f-40bd-9e5d-a237d01a30c3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.624763 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b63e695b094979bec660b3aeb8b069', 'request_id': 'req-977e3ae7-629f-40bd-9e5d-a237d01a30c3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.632130 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b63e695b094979bec660b3aeb8b069', 'request_id': 'req-977e3ae7-629f-40bd-9e5d-a237d01a30c3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.643164 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] The token cache is being invalidate because project 24b63e695b094979bec660b3aeb8b069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:59:46.643459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.644124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.645674 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1288/2577] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:59:46 2022] DELETE /identity/v3/projects/24b63e695b094979bec660b3aeb8b069 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:59:46.650465 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e864c7e-01a0-4dab-a3e0-5796aae736a6 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:59:46.651926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7e864c7e-01a0-4dab-a3e0-5796aae736a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:59:46.665851 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e864c7e-01a0-4dab-a3e0-5796aae736a6 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:59:46.722338 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cdbdb-47c8-4ae3-8c21-b008da42fcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:59:46.722903 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cdbdb-47c8-4ae3-8c21-b008da42fcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:59:46.723186 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cdbdb-47c8-4ae3-8c21-b008da42fcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:59:46.723462 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cdbdb-47c8-4ae3-8c21-b008da42fcfe admin admin] PATH_INFO: `/v3/users/99d09b701dbc48a4a495cf003577e6c5` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:59:46.724639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cdbdb-47c8-4ae3-8c21-b008da42fcfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d09b701dbc48a4a495cf003577e6c5)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:59:46.726653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cdbdb-47c8-4ae3-8c21-b008da42fcfe admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:59:46.732562 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:59:46.776969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9e2cdbdb-47c8-4ae3-8c21-b008da42fcfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d09b701dbc48a4a495cf003577e6c5'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.777642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9e2cdbdb-47c8-4ae3-8c21-b008da42fcfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d09b701dbc48a4a495cf003577e6c5'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.785198 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9e2cdbdb-47c8-4ae3-8c21-b008da42fcfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d09b701dbc48a4a495cf003577e6c5'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.792840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9e2cdbdb-47c8-4ae3-8c21-b008da42fcfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d09b701dbc48a4a495cf003577e6c5'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.793507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9e2cdbdb-47c8-4ae3-8c21-b008da42fcfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d09b701dbc48a4a495cf003577e6c5'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:46.811200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1290/2578] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 10:59:46 2022] DELETE /identity/v3/users/99d09b701dbc48a4a495cf003577e6c5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 10:59:46.991150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 10:59:46.992654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 10:59:47.006662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e3ae7-629f-40bd-9e5d-a237d01a30c3 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 10:59:47.068959 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 10:59:47.069646 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 10:59:47.069944 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 10:59:47.070294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] PATH_INFO: `/v3/projects/19c36a59531d463f8220d6efe7dbd46c` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 10:59:47.071539 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c36a59531d463f8220d6efe7dbd46c)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 10:59:47.073422 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 10:59:47.094851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:59:47.122093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c36a59531d463f8220d6efe7dbd46c', 'request_id': 'req-518afb97-ea8a-49e8-b898-bb1d18f540ef'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:47.128371 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c36a59531d463f8220d6efe7dbd46c', 'request_id': 'req-518afb97-ea8a-49e8-b898-bb1d18f540ef'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:47.135144 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c36a59531d463f8220d6efe7dbd46c', 'request_id': 'req-518afb97-ea8a-49e8-b898-bb1d18f540ef'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:47.145983 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] The token cache is being invalidate because project 19c36a59531d463f8220d6efe7dbd46c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 10:59:47.146316 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:47.146948 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 10:59:47.148461 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1289/2579] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 10:59:46 2022] DELETE /identity/v3/projects/19c36a59531d463f8220d6efe7dbd46c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 10:59:56.807690 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 10:59:57.142672 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:00:07.437180 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cdbdb-47c8-4ae3-8c21-b008da42fcfe admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:07.438663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9e2cdbdb-47c8-4ae3-8c21-b008da42fcfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:07.500116 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cdbdb-47c8-4ae3-8c21-b008da42fcfe admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:07.551402 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607ea4e-4b36-4933-8b4f-dc190c9af117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:07.551940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607ea4e-4b36-4933-8b4f-dc190c9af117 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:07.552226 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607ea4e-4b36-4933-8b4f-dc190c9af117 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:07.552506 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607ea4e-4b36-4933-8b4f-dc190c9af117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:07.554361 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b607ea4e-4b36-4933-8b4f-dc190c9af117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:07.642443 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607ea4e-4b36-4933-8b4f-dc190c9af117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:07.643914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607ea4e-4b36-4933-8b4f-dc190c9af117 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:07.665287 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1291/2580] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:00:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 11:00:08.864652 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:08.866070 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:08.879073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518afb97-ea8a-49e8-b898-bb1d18f540ef admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:08.882678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62eea0d-9569-40f8-a9ce-1a785f31f4e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:08.883297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eea0d-9569-40f8-a9ce-1a785f31f4e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:08.883584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eea0d-9569-40f8-a9ce-1a785f31f4e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:08.883866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eea0d-9569-40f8-a9ce-1a785f31f4e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:08.885581 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d62eea0d-9569-40f8-a9ce-1a785f31f4e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:08.899324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62eea0d-9569-40f8-a9ce-1a785f31f4e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:08.900749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62eea0d-9569-40f8-a9ce-1a785f31f4e5 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:08.911909 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1290/2581] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:00:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:00:17.662585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=83 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:00:18.906977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=6 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:00:36.905665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607ea4e-4b36-4933-8b4f-dc190c9af117 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:36.907122 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b607ea4e-4b36-4933-8b4f-dc190c9af117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:36.918235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607ea4e-4b36-4933-8b4f-dc190c9af117 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:36.922369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d9e3d-f44b-41df-a193-cf66d2a1c40b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:36.922981 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d9e3d-f44b-41df-a193-cf66d2a1c40b service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:36.923267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d9e3d-f44b-41df-a193-cf66d2a1c40b service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:36.923547 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d9e3d-f44b-41df-a193-cf66d2a1c40b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:36.925264 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ca2d9e3d-f44b-41df-a193-cf66d2a1c40b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:36.935278 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d9e3d-f44b-41df-a193-cf66d2a1c40b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:36.936700 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d9e3d-f44b-41df-a193-cf66d2a1c40b service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:36.944693 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1292/2582] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:00:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:00:46.941109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=6 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:00:51.345192 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62eea0d-9569-40f8-a9ce-1a785f31f4e5 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:51.354051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62eea0d-9569-40f8-a9ce-1a785f31f4e5 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:51.357776 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2f120-e47e-4767-b444-360087b14c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:51.358418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2f120-e47e-4767-b444-360087b14c80 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:51.358706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2f120-e47e-4767-b444-360087b14c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:51.358987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2f120-e47e-4767-b444-360087b14c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:51.360742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f3a2f120-e47e-4767-b444-360087b14c80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:51.425875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2f120-e47e-4767-b444-360087b14c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:51.430145 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2f120-e47e-4767-b444-360087b14c80 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:51.437060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1291/2583] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:00:54.446936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d9e3d-f44b-41df-a193-cf66d2a1c40b service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:54.459099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d9e3d-f44b-41df-a193-cf66d2a1c40b service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:54.467726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d31f9-561c-4a64-b617-72962ef2b193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:54.468429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d31f9-561c-4a64-b617-72962ef2b193 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:54.468717 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d31f9-561c-4a64-b617-72962ef2b193 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:54.468993 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d31f9-561c-4a64-b617-72962ef2b193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:54.470939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7e1d31f9-561c-4a64-b617-72962ef2b193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:54.487317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d31f9-561c-4a64-b617-72962ef2b193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:54.488760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d31f9-561c-4a64-b617-72962ef2b193 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:54.506042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1293/2584] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:00:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 11:00:54.785735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2f120-e47e-4767-b444-360087b14c80 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:54.787654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f3a2f120-e47e-4767-b444-360087b14c80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:54.804247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2f120-e47e-4767-b444-360087b14c80 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:54.810502 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a795114-e42d-4fe4-a90e-eb75b54d6ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:54.811512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a795114-e42d-4fe4-a90e-eb75b54d6ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:54.812316 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a795114-e42d-4fe4-a90e-eb75b54d6ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:54.812773 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a795114-e42d-4fe4-a90e-eb75b54d6ce8 admin admin] PATH_INFO: `/v3/users/9c6c44ca3dc44632b7d064d19a9cf1b1` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:54.829953 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a795114-e42d-4fe4-a90e-eb75b54d6ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6c44ca3dc44632b7d064d19a9cf1b1)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:54.832508 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a795114-e42d-4fe4-a90e-eb75b54d6ce8 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:54.905022 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-3a795114-e42d-4fe4-a90e-eb75b54d6ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6c44ca3dc44632b7d064d19a9cf1b1'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:54.905241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-3a795114-e42d-4fe4-a90e-eb75b54d6ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6c44ca3dc44632b7d064d19a9cf1b1'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:54.913027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-3a795114-e42d-4fe4-a90e-eb75b54d6ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6c44ca3dc44632b7d064d19a9cf1b1'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:54.913850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-3a795114-e42d-4fe4-a90e-eb75b54d6ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6c44ca3dc44632b7d064d19a9cf1b1'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:54.924466 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-3a795114-e42d-4fe4-a90e-eb75b54d6ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6c44ca3dc44632b7d064d19a9cf1b1'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:54.944674 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1292/2585] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:00:54 2022] DELETE /identity/v3/users/9c6c44ca3dc44632b7d064d19a9cf1b1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:00:55.157933 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d31f9-561c-4a64-b617-72962ef2b193 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:55.176280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d31f9-561c-4a64-b617-72962ef2b193 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:55.245688 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7ebca-1340-4cb6-8312-a288d7e12f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:55.248117 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7ebca-1340-4cb6-8312-a288d7e12f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:55.248881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7ebca-1340-4cb6-8312-a288d7e12f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:55.249606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7ebca-1340-4cb6-8312-a288d7e12f24 admin admin] PATH_INFO: `/v3/projects/07940c3aa68f4dd3bc96fdb74b8bb2eb` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:55.269103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7ebca-1340-4cb6-8312-a288d7e12f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07940c3aa68f4dd3bc96fdb74b8bb2eb)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:55.272993 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7ebca-1340-4cb6-8312-a288d7e12f24 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:55.346321 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-53d7ebca-1340-4cb6-8312-a288d7e12f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07940c3aa68f4dd3bc96fdb74b8bb2eb', 'request_id': 'req-53d7ebca-1340-4cb6-8312-a288d7e12f24'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:55.359372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-53d7ebca-1340-4cb6-8312-a288d7e12f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07940c3aa68f4dd3bc96fdb74b8bb2eb', 'request_id': 'req-53d7ebca-1340-4cb6-8312-a288d7e12f24'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:55.374513 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-53d7ebca-1340-4cb6-8312-a288d7e12f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07940c3aa68f4dd3bc96fdb74b8bb2eb', 'request_id': 'req-53d7ebca-1340-4cb6-8312-a288d7e12f24'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:55.393079 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-53d7ebca-1340-4cb6-8312-a288d7e12f24 admin admin] The token cache is being invalidate because project 07940c3aa68f4dd3bc96fdb74b8bb2eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:00:55.393690 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-53d7ebca-1340-4cb6-8312-a288d7e12f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:55.394672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-53d7ebca-1340-4cb6-8312-a288d7e12f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:55.397110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1294/2586] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:00:55 2022] DELETE /identity/v3/projects/07940c3aa68f4dd3bc96fdb74b8bb2eb => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:00:55.402066 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3320d8-51bb-4690-9370-def88c838bda None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:55.402499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3320d8-51bb-4690-9370-def88c838bda None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:55.402712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3320d8-51bb-4690-9370-def88c838bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:55.423981 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-8f3320d8-51bb-4690-9370-def88c838bda None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:00:55.425246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-8f3320d8-51bb-4690-9370-def88c838bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:55.483512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:00:55.504064 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1293/2587] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:00:55.506112 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5116b-9804-4785-b596-4038a20b047d None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:55.506567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5116b-9804-4785-b596-4038a20b047d None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:55.506699 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5116b-9804-4785-b596-4038a20b047d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:55.531249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-f6e5116b-9804-4785-b596-4038a20b047d None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:00:55.532569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f6e5116b-9804-4785-b596-4038a20b047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:55.541042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1295/2588] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 11:00:55.545918 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3320d8-51bb-4690-9370-def88c838bda None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:55.556217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3320d8-51bb-4690-9370-def88c838bda None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:55.562246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cd8b5-4772-440f-8247-b1ba6cf0f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:55.562876 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cd8b5-4772-440f-8247-b1ba6cf0f744 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:55.563153 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cd8b5-4772-440f-8247-b1ba6cf0f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:55.563430 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cd8b5-4772-440f-8247-b1ba6cf0f744 admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:55.564788 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cd8b5-4772-440f-8247-b1ba6cf0f744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 11:00:55.564788 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cd8b5-4772-440f-8247-b1ba6cf0f744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:55.566581 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cd8b5-4772-440f-8247-b1ba6cf0f744 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:55.581825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1294/2589] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 11:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 11:00:55.587035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5116b-9804-4785-b596-4038a20b047d None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:55.601294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5116b-9804-4785-b596-4038a20b047d None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:55.606559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06ce9-7bbb-4641-835e-78d38930f6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:55.607178 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06ce9-7bbb-4641-835e-78d38930f6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:55.607500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06ce9-7bbb-4641-835e-78d38930f6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:55.607781 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b06ce9-7bbb-4641-835e-78d38930f6c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:55.608455 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b06ce9-7bbb-4641-835e-78d38930f6c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:55.610470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b06ce9-7bbb-4641-835e-78d38930f6c2 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:55.653886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1296/2590] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:00:55 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:00:55.657862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cd8b5-4772-440f-8247-b1ba6cf0f744 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:55.672982 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cd8b5-4772-440f-8247-b1ba6cf0f744 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:55.769671 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8fba7-9c9b-49b7-9f49-05b7015202d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:55.770854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8fba7-9c9b-49b7-9f49-05b7015202d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:55.771439 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8fba7-9c9b-49b7-9f49-05b7015202d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:55.772015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8fba7-9c9b-49b7-9f49-05b7015202d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:55.773360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8fba7-9c9b-49b7-9f49-05b7015202d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:55.777406 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8fba7-9c9b-49b7-9f49-05b7015202d2 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:55.816865 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1295/2591] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:00:55 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 11:00:55.821056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06ce9-7bbb-4641-835e-78d38930f6c2 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:55.836610 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b06ce9-7bbb-4641-835e-78d38930f6c2 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:55.843030 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6b906-92ac-4604-929a-6f57d3522bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:55.843591 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6b906-92ac-4604-929a-6f57d3522bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:55.843880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6b906-92ac-4604-929a-6f57d3522bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:55.844230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6b906-92ac-4604-929a-6f57d3522bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:55.844925 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6b906-92ac-4604-929a-6f57d3522bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:55.846588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6b906-92ac-4604-929a-6f57d3522bb1 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:55.863594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1297/2592] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:00:55.867057 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8fba7-9c9b-49b7-9f49-05b7015202d2 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:55.886889 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8fba7-9c9b-49b7-9f49-05b7015202d2 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:55.897597 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156eba1e-a497-4bb5-be77-27cfa618768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:55.898791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156eba1e-a497-4bb5-be77-27cfa618768b admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:55.899074 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156eba1e-a497-4bb5-be77-27cfa618768b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:55.899537 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156eba1e-a497-4bb5-be77-27cfa618768b admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:55.900308 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156eba1e-a497-4bb5-be77-27cfa618768b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:55.901915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156eba1e-a497-4bb5-be77-27cfa618768b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:55.914069 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1296/2593] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:00:55.919701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6b906-92ac-4604-929a-6f57d3522bb1 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:55.930576 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6b906-92ac-4604-929a-6f57d3522bb1 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:55.936378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b23fb-48fa-4829-a072-e443969fc64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:55.937103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b23fb-48fa-4829-a072-e443969fc64d admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:55.937384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b23fb-48fa-4829-a072-e443969fc64d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:55.937661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b23fb-48fa-4829-a072-e443969fc64d admin admin] PATH_INFO: `/v3/projects/89e8e08ecf5c410f8fef5e4b71d7920e/users/d064436405f449b8b6f4dd78e3792991/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:55.954359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b23fb-48fa-4829-a072-e443969fc64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e8e08ecf5c410f8fef5e4b71d7920e, user_id=d064436405f449b8b6f4dd78e3792991, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:55.956946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b23fb-48fa-4829-a072-e443969fc64d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:55.960367 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:00:55.973865 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1298/2594] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:00:55 2022] PUT /identity/v3/projects/89e8e08ecf5c410f8fef5e4b71d7920e/users/d064436405f449b8b6f4dd78e3792991/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 11:00:55.978866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5dffa-6b03-4d65-80f0-98120427320d None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:55.979150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5dffa-6b03-4d65-80f0-98120427320d None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:55.979422 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5dffa-6b03-4d65-80f0-98120427320d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:56.001021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-36e5dffa-6b03-4d65-80f0-98120427320d None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:00:56.002298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-36e5dffa-6b03-4d65-80f0-98120427320d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:56.073614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1297/2595] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:00:56.080343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b23fb-48fa-4829-a072-e443969fc64d admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:56.082240 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-b56b23fb-48fa-4829-a072-e443969fc64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:56.141418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b23fb-48fa-4829-a072-e443969fc64d admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:56.145189 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ccbe3-8c63-41c2-86ea-1bcb5e4cc481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:56.145847 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ccbe3-8c63-41c2-86ea-1bcb5e4cc481 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:56.146133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ccbe3-8c63-41c2-86ea-1bcb5e4cc481 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:56.146447 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ccbe3-8c63-41c2-86ea-1bcb5e4cc481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:56.157047 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ccbe3-8c63-41c2-86ea-1bcb5e4cc481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:56.158526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ccbe3-8c63-41c2-86ea-1bcb5e4cc481 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:56.169803 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1299/2596] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:00:58.822522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5dffa-6b03-4d65-80f0-98120427320d None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:58.825140 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-36e5dffa-6b03-4d65-80f0-98120427320d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:58.839823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5dffa-6b03-4d65-80f0-98120427320d None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:58.847065 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66d6be-1dde-4358-86ca-8cdc855d917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:58.848124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66d6be-1dde-4358-86ca-8cdc855d917f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:58.848559 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66d6be-1dde-4358-86ca-8cdc855d917f admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:58.849161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66d6be-1dde-4358-86ca-8cdc855d917f admin admin] PATH_INFO: `/v3/users/00e8fb23313f4e168eb2f690039379ae` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:58.868035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66d6be-1dde-4358-86ca-8cdc855d917f admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e8fb23313f4e168eb2f690039379ae)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:58.869993 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66d6be-1dde-4358-86ca-8cdc855d917f admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:58.926563 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:00:58.928982 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7c66d6be-1dde-4358-86ca-8cdc855d917f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e8fb23313f4e168eb2f690039379ae'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:58.929970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7c66d6be-1dde-4358-86ca-8cdc855d917f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e8fb23313f4e168eb2f690039379ae'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:58.942703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7c66d6be-1dde-4358-86ca-8cdc855d917f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e8fb23313f4e168eb2f690039379ae'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:58.943446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7c66d6be-1dde-4358-86ca-8cdc855d917f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e8fb23313f4e168eb2f690039379ae'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:58.958337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7c66d6be-1dde-4358-86ca-8cdc855d917f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e8fb23313f4e168eb2f690039379ae'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:58.980599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1298/2597] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:00:58 2022] DELETE /identity/v3/users/00e8fb23313f4e168eb2f690039379ae => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:00:59.220951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ccbe3-8c63-41c2-86ea-1bcb5e4cc481 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:59.236901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ccbe3-8c63-41c2-86ea-1bcb5e4cc481 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:59.333654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20515004-fa98-48e3-89ce-631fd8e81d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:59.334383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20515004-fa98-48e3-89ce-631fd8e81d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:59.334761 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20515004-fa98-48e3-89ce-631fd8e81d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:59.335069 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20515004-fa98-48e3-89ce-631fd8e81d36 admin admin] PATH_INFO: `/v3/projects/d27a34fd28584fe9841976117eff7636` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:59.357991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20515004-fa98-48e3-89ce-631fd8e81d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27a34fd28584fe9841976117eff7636)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:59.360106 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20515004-fa98-48e3-89ce-631fd8e81d36 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:59.463121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-20515004-fa98-48e3-89ce-631fd8e81d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27a34fd28584fe9841976117eff7636', 'request_id': 'req-20515004-fa98-48e3-89ce-631fd8e81d36'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:59.475275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-20515004-fa98-48e3-89ce-631fd8e81d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27a34fd28584fe9841976117eff7636', 'request_id': 'req-20515004-fa98-48e3-89ce-631fd8e81d36'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:59.482372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-20515004-fa98-48e3-89ce-631fd8e81d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27a34fd28584fe9841976117eff7636', 'request_id': 'req-20515004-fa98-48e3-89ce-631fd8e81d36'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:59.499591 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-20515004-fa98-48e3-89ce-631fd8e81d36 admin admin] The token cache is being invalidate because project d27a34fd28584fe9841976117eff7636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:00:59.499948 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-20515004-fa98-48e3-89ce-631fd8e81d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:59.500706 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-20515004-fa98-48e3-89ce-631fd8e81d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:00:59.502677 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1300/2598] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:00:59 2022] DELETE /identity/v3/projects/d27a34fd28584fe9841976117eff7636 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:00:59.507333 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7167a-0b63-46ea-9346-0b780b45424e None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:59.507633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7167a-0b63-46ea-9346-0b780b45424e None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:59.507918 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7167a-0b63-46ea-9346-0b780b45424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:59.530418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-ecc7167a-0b63-46ea-9346-0b780b45424e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:00:59.531655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ecc7167a-0b63-46ea-9346-0b780b45424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:59.601041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1299/2599] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:00:59.608918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedbd92-761b-4c0f-b717-9906de75fdc2 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:59.609207 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedbd92-761b-4c0f-b717-9906de75fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:59.609480 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedbd92-761b-4c0f-b717-9906de75fdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:59.630114 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-9aedbd92-761b-4c0f-b717-9906de75fdc2 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:00:59.631454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9aedbd92-761b-4c0f-b717-9906de75fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:00:59.640902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1301/2600] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:00:59.645204 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7167a-0b63-46ea-9346-0b780b45424e None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:59.655664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7167a-0b63-46ea-9346-0b780b45424e None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:59.660312 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0cba1-dab7-4dab-a134-1bfe129c1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:59.660934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0cba1-dab7-4dab-a134-1bfe129c1d67 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:59.661219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0cba1-dab7-4dab-a134-1bfe129c1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:59.661494 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0cba1-dab7-4dab-a134-1bfe129c1d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:59.662215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0cba1-dab7-4dab-a134-1bfe129c1d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 11:00:59.662546 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0cba1-dab7-4dab-a134-1bfe129c1d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:59.664181 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0cba1-dab7-4dab-a134-1bfe129c1d67 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:59.677874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1300/2601] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 11:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 11:00:59.682313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedbd92-761b-4c0f-b717-9906de75fdc2 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:59.693014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedbd92-761b-4c0f-b717-9906de75fdc2 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:59.697937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125606ea-109c-418a-adbc-e3cf40b4e2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:59.698787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125606ea-109c-418a-adbc-e3cf40b4e2fc admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:59.700307 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125606ea-109c-418a-adbc-e3cf40b4e2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:59.700763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125606ea-109c-418a-adbc-e3cf40b4e2fc admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:59.701654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125606ea-109c-418a-adbc-e3cf40b4e2fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:59.703833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125606ea-109c-418a-adbc-e3cf40b4e2fc admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:59.717241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:00:59.749197 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1302/2602] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:00:59 2022] POST /identity/v3/projects => generated 355 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 11:00:59.750473 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0cba1-dab7-4dab-a134-1bfe129c1d67 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:59.762591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0cba1-dab7-4dab-a134-1bfe129c1d67 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:59.841451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed56646-e013-4276-8f7c-183a49d403b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:59.842076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed56646-e013-4276-8f7c-183a49d403b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:59.842076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed56646-e013-4276-8f7c-183a49d403b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:59.842314 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed56646-e013-4276-8f7c-183a49d403b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:59.842906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed56646-e013-4276-8f7c-183a49d403b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:59.844842 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed56646-e013-4276-8f7c-183a49d403b1 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:59.869964 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1301/2603] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:00:59 2022] POST /identity/v3/users => generated 278 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 11:00:59.873872 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125606ea-109c-418a-adbc-e3cf40b4e2fc admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:59.887593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125606ea-109c-418a-adbc-e3cf40b4e2fc admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:59.898173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff6350-e475-4767-9fb1-9917b01478b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:59.898862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff6350-e475-4767-9fb1-9917b01478b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:59.899149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff6350-e475-4767-9fb1-9917b01478b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:59.899430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff6350-e475-4767-9fb1-9917b01478b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:59.900148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff6350-e475-4767-9fb1-9917b01478b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:59.901794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff6350-e475-4767-9fb1-9917b01478b7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:59.921298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1303/2604] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:00:59.925460 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed56646-e013-4276-8f7c-183a49d403b1 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:59.939212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed56646-e013-4276-8f7c-183a49d403b1 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:59.944951 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bf376-992a-41fe-b310-5be4a60b1db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:59.945881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bf376-992a-41fe-b310-5be4a60b1db6 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:59.946168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bf376-992a-41fe-b310-5be4a60b1db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:59.946492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bf376-992a-41fe-b310-5be4a60b1db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:00:59.947332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bf376-992a-41fe-b310-5be4a60b1db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:00:59.949927 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bf376-992a-41fe-b310-5be4a60b1db6 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:00:59.970679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1302/2605] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:00:59.971719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff6350-e475-4767-9fb1-9917b01478b7 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:00:59.984315 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff6350-e475-4767-9fb1-9917b01478b7 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:00:59.991791 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8a088-feca-4692-87b8-e3f4f274671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:00:59.992690 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8a088-feca-4692-87b8-e3f4f274671a admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:00:59.993073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8a088-feca-4692-87b8-e3f4f274671a admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:00:59.993453 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8a088-feca-4692-87b8-e3f4f274671a admin admin] PATH_INFO: `/v3/projects/55af2af8f6014f4f8d5077a8a0b274be/users/30f801f0b6e949a398e7e44d4f8e9c13/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:00.011621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8a088-feca-4692-87b8-e3f4f274671a admin admin] RBAC: Authorizing `identity:create_grant(project_id=55af2af8f6014f4f8d5077a8a0b274be, user_id=30f801f0b6e949a398e7e44d4f8e9c13, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:00.016018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8a088-feca-4692-87b8-e3f4f274671a admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:00.047162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1304/2606] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:00:59 2022] PUT /identity/v3/projects/55af2af8f6014f4f8d5077a8a0b274be/users/30f801f0b6e949a398e7e44d4f8e9c13/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 11:01:00.047480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612408ae-4423-40eb-805d-436965ba40e0 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:00.047822 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612408ae-4423-40eb-805d-436965ba40e0 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:00.048771 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612408ae-4423-40eb-805d-436965ba40e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:00.084646 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-612408ae-4423-40eb-805d-436965ba40e0 None None] MFA Rules not processed for user `30f801f0b6e949a398e7e44d4f8e9c13`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:00.086363 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-612408ae-4423-40eb-805d-436965ba40e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:00.106867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:00.161816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1303/2607] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:00 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:00.166559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8a088-feca-4692-87b8-e3f4f274671a admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:00.238175 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8a088-feca-4692-87b8-e3f4f274671a admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:00.244007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897862b1-6509-49c3-9605-b5785607c073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:00.244630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897862b1-6509-49c3-9605-b5785607c073 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:00.244914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897862b1-6509-49c3-9605-b5785607c073 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:00.245199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897862b1-6509-49c3-9605-b5785607c073 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:00.245892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897862b1-6509-49c3-9605-b5785607c073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:00.248456 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897862b1-6509-49c3-9605-b5785607c073 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:00.278114 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1305/2608] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:01:00 2022] POST /identity/v3/projects => generated 355 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:00.282073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612408ae-4423-40eb-805d-436965ba40e0 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:00.299133 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612408ae-4423-40eb-805d-436965ba40e0 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:00.399945 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193f12-022d-40a5-bf28-3ed3b7718db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:00.400601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193f12-022d-40a5-bf28-3ed3b7718db7 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:00.400891 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193f12-022d-40a5-bf28-3ed3b7718db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:00.401171 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193f12-022d-40a5-bf28-3ed3b7718db7 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:00.401877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90193f12-022d-40a5-bf28-3ed3b7718db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:00.405047 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90193f12-022d-40a5-bf28-3ed3b7718db7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:00.440889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897862b1-6509-49c3-9605-b5785607c073 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:00.441638 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1304/2609] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:01:00 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 11:01:00.453249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897862b1-6509-49c3-9605-b5785607c073 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:00.460251 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4de500-980b-4011-9d83-bc84289f37a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:00.460479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de500-980b-4011-9d83-bc84289f37a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:00.460769 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de500-980b-4011-9d83-bc84289f37a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:00.461048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de500-980b-4011-9d83-bc84289f37a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:00.461825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4de500-980b-4011-9d83-bc84289f37a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:00.463848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4de500-980b-4011-9d83-bc84289f37a1 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:00.482018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1306/2610] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 11:01:00.486086 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193f12-022d-40a5-bf28-3ed3b7718db7 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:00.502948 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193f12-022d-40a5-bf28-3ed3b7718db7 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:00.508704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b49815-da77-469d-a92d-633a13264082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:00.509748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b49815-da77-469d-a92d-633a13264082 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:00.510040 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b49815-da77-469d-a92d-633a13264082 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:00.515304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b49815-da77-469d-a92d-633a13264082 admin admin] PATH_INFO: `/v3/projects/53fecec360984ee4a295fe00cfcfe8c2/users/2631a42071ac4ce6901d2d1b47ed6c89/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:00.541118 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b49815-da77-469d-a92d-633a13264082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53fecec360984ee4a295fe00cfcfe8c2, user_id=2631a42071ac4ce6901d2d1b47ed6c89, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:00.544354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b49815-da77-469d-a92d-633a13264082 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:00.560724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1305/2611] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:01:00 2022] PUT /identity/v3/projects/53fecec360984ee4a295fe00cfcfe8c2/users/2631a42071ac4ce6901d2d1b47ed6c89/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 11:01:00.565908 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4de500-980b-4011-9d83-bc84289f37a1 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:00.580448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4de500-980b-4011-9d83-bc84289f37a1 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:00.656927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db613f-9c7b-4189-81b5-578a02b4d847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:00.657573 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db613f-9c7b-4189-81b5-578a02b4d847 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:00.657862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db613f-9c7b-4189-81b5-578a02b4d847 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:00.658158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db613f-9c7b-4189-81b5-578a02b4d847 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:00.658897 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db613f-9c7b-4189-81b5-578a02b4d847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:00.660517 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db613f-9c7b-4189-81b5-578a02b4d847 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:00.673360 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1307/2612] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:01:00.677449 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b49815-da77-469d-a92d-633a13264082 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:00.688266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b49815-da77-469d-a92d-633a13264082 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:00.693319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad0070-bee0-4a97-b0e8-7e16849186f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:00.694013 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0070-bee0-4a97-b0e8-7e16849186f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:00.694339 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0070-bee0-4a97-b0e8-7e16849186f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:00.694745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0070-bee0-4a97-b0e8-7e16849186f9 admin admin] PATH_INFO: `/v3/projects/53fecec360984ee4a295fe00cfcfe8c2/users/2631a42071ac4ce6901d2d1b47ed6c89/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:00.697488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad0070-bee0-4a97-b0e8-7e16849186f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53fecec360984ee4a295fe00cfcfe8c2, user_id=2631a42071ac4ce6901d2d1b47ed6c89, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:00.700194 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad0070-bee0-4a97-b0e8-7e16849186f9 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:00.712272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1306/2613] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:01:00 2022] PUT /identity/v3/projects/53fecec360984ee4a295fe00cfcfe8c2/users/2631a42071ac4ce6901d2d1b47ed6c89/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:00.724663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d425c-ffef-4e24-b321-5d6739c87a39 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:00.725479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d425c-ffef-4e24-b321-5d6739c87a39 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:00.725479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d425c-ffef-4e24-b321-5d6739c87a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:00.759563 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-266d425c-ffef-4e24-b321-5d6739c87a39 None None] MFA Rules not processed for user `2631a42071ac4ce6901d2d1b47ed6c89`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:00.761289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-266d425c-ffef-4e24-b321-5d6739c87a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:00.777959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:00.862454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1308/2614] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:00 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:00.876131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad0070-bee0-4a97-b0e8-7e16849186f9 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:00.878226 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b6ad0070-bee0-4a97-b0e8-7e16849186f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:00.970767 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad0070-bee0-4a97-b0e8-7e16849186f9 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:00.974889 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b405a-950a-4c91-8280-bb5554229e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:00.975535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b405a-950a-4c91-8280-bb5554229e4f service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:00.975787 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b405a-950a-4c91-8280-bb5554229e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:00.976058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b405a-950a-4c91-8280-bb5554229e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:00.984348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:00.989582 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b405a-950a-4c91-8280-bb5554229e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:00.991536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b405a-950a-4c91-8280-bb5554229e4f service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:01.004227 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1307/2615] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:00 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:01:01.115082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d425c-ffef-4e24-b321-5d6739c87a39 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:01.126214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d425c-ffef-4e24-b321-5d6739c87a39 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:01.130777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a40a85-a8d9-4810-bb29-1d5865beaed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:01.131441 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a40a85-a8d9-4810-bb29-1d5865beaed6 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:01.131911 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a40a85-a8d9-4810-bb29-1d5865beaed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:01.132286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a40a85-a8d9-4810-bb29-1d5865beaed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:01.216159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a40a85-a8d9-4810-bb29-1d5865beaed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:01.218073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a40a85-a8d9-4810-bb29-1d5865beaed6 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:01.234279 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1309/2616] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:01 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 11:01:01.494936 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2ae8b-9d34-4729-933c-18b0c8974820 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:01.495225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2ae8b-9d34-4729-933c-18b0c8974820 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:01.495710 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2ae8b-9d34-4729-933c-18b0c8974820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:01.538878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-28b2ae8b-9d34-4729-933c-18b0c8974820 None None] MFA Rules not processed for user `d064436405f449b8b6f4dd78e3792991`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:01.540368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-28b2ae8b-9d34-4729-933c-18b0c8974820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:01.645950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1308/2617] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:01.661317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a40a85-a8d9-4810-bb29-1d5865beaed6 service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:01.663053 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-10a40a85-a8d9-4810-bb29-1d5865beaed6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:01.749719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a40a85-a8d9-4810-bb29-1d5865beaed6 service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:01.756838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbded29-1d35-434d-8ca6-22f27794b184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:01.757378 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbded29-1d35-434d-8ca6-22f27794b184 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:01.757642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbded29-1d35-434d-8ca6-22f27794b184 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:01.757991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbded29-1d35-434d-8ca6-22f27794b184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:01.769135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbded29-1d35-434d-8ca6-22f27794b184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:01.770789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbded29-1d35-434d-8ca6-22f27794b184 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:01.781198 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1310/2618] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 11:01:03.347119 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70639d31-b544-4c41-b6a1-917cc3a0052a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:03.347681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70639d31-b544-4c41-b6a1-917cc3a0052a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:03.347788 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70639d31-b544-4c41-b6a1-917cc3a0052a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:03.369033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-70639d31-b544-4c41-b6a1-917cc3a0052a None None] MFA Rules not processed for user `d064436405f449b8b6f4dd78e3792991`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:03.370319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-70639d31-b544-4c41-b6a1-917cc3a0052a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:03.377749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1309/2619] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:11.776206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=84 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:13.362830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=38 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:16.629400 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbded29-1d35-434d-8ca6-22f27794b184 service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:16.695213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbded29-1d35-434d-8ca6-22f27794b184 service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:16.699861 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba4ef3-87b7-4537-9eaf-0615aca82af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:16.700515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba4ef3-87b7-4537-9eaf-0615aca82af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:16.700802 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba4ef3-87b7-4537-9eaf-0615aca82af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:16.701115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba4ef3-87b7-4537-9eaf-0615aca82af4 admin admin] PATH_INFO: `/v3/users/30f801f0b6e949a398e7e44d4f8e9c13` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:16.702353 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba4ef3-87b7-4537-9eaf-0615aca82af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f801f0b6e949a398e7e44d4f8e9c13)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:16.704286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba4ef3-87b7-4537-9eaf-0615aca82af4 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:16.753989 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-23ba4ef3-87b7-4537-9eaf-0615aca82af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f801f0b6e949a398e7e44d4f8e9c13'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:16.754674 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-23ba4ef3-87b7-4537-9eaf-0615aca82af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f801f0b6e949a398e7e44d4f8e9c13'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:16.761954 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-23ba4ef3-87b7-4537-9eaf-0615aca82af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f801f0b6e949a398e7e44d4f8e9c13'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:16.769745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-23ba4ef3-87b7-4537-9eaf-0615aca82af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f801f0b6e949a398e7e44d4f8e9c13'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:16.770448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-23ba4ef3-87b7-4537-9eaf-0615aca82af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f801f0b6e949a398e7e44d4f8e9c13'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:16.788369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1311/2620] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:01:16 2022] DELETE /identity/v3/users/30f801f0b6e949a398e7e44d4f8e9c13 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:16.794803 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bc861-2b78-442d-8db9-74234750e07f None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:16.795303 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bc861-2b78-442d-8db9-74234750e07f None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:16.795434 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bc861-2b78-442d-8db9-74234750e07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:16.814970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-5b3bc861-2b78-442d-8db9-74234750e07f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:16.816173 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5b3bc861-2b78-442d-8db9-74234750e07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:16.886990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1310/2621] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:16.897445 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba4ef3-87b7-4537-9eaf-0615aca82af4 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:16.901837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-23ba4ef3-87b7-4537-9eaf-0615aca82af4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:16.961641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba4ef3-87b7-4537-9eaf-0615aca82af4 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:16.965558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64507277-8b09-4868-8f6f-7f1d23a51944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:16.966211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64507277-8b09-4868-8f6f-7f1d23a51944 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:16.966503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64507277-8b09-4868-8f6f-7f1d23a51944 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:16.966783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64507277-8b09-4868-8f6f-7f1d23a51944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:16.976063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64507277-8b09-4868-8f6f-7f1d23a51944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:16.977500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64507277-8b09-4868-8f6f-7f1d23a51944 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:16.988490 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1312/2622] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:01:17.265253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bc861-2b78-442d-8db9-74234750e07f None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:17.267005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5b3bc861-2b78-442d-8db9-74234750e07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:17.279312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64507277-8b09-4868-8f6f-7f1d23a51944 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:17.281198 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-64507277-8b09-4868-8f6f-7f1d23a51944 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:17.297502 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64507277-8b09-4868-8f6f-7f1d23a51944 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:17.302552 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:17.303347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:17.303638 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:17.304037 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] PATH_INFO: `/v3/projects/55af2af8f6014f4f8d5077a8a0b274be` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:17.305277 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=55af2af8f6014f4f8d5077a8a0b274be)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:17.307298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:17.330723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:17.362679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bc861-2b78-442d-8db9-74234750e07f None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:17.378436 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55af2af8f6014f4f8d5077a8a0b274be', 'request_id': 'req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:17.384996 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55af2af8f6014f4f8d5077a8a0b274be', 'request_id': 'req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:17.391233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55af2af8f6014f4f8d5077a8a0b274be', 'request_id': 'req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:17.409970 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] The token cache is being invalidate because project 55af2af8f6014f4f8d5077a8a0b274be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:01:17.410295 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:17.411262 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:17.412808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1313/2623] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:01:17 2022] DELETE /identity/v3/projects/55af2af8f6014f4f8d5077a8a0b274be => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:17.416833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:17.419093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:17.438263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19019177-81f1-4f19-8ec1-7a0bb4dbeebb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:17.438901 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19019177-81f1-4f19-8ec1-7a0bb4dbeebb service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:17.439743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19019177-81f1-4f19-8ec1-7a0bb4dbeebb service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:17.440105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19019177-81f1-4f19-8ec1-7a0bb4dbeebb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:17.442368 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-19019177-81f1-4f19-8ec1-7a0bb4dbeebb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:17.457054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19019177-81f1-4f19-8ec1-7a0bb4dbeebb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:17.460150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19019177-81f1-4f19-8ec1-7a0bb4dbeebb service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:17.474728 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1311/2624] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:01:17.493929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e8efd-63a9-4f6b-a3ba-66f3f55d4cbf admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:17.499383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4f0d7-2fcd-48f9-a9c5-326b5668543a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:17.500097 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4f0d7-2fcd-48f9-a9c5-326b5668543a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:17.500388 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4f0d7-2fcd-48f9-a9c5-326b5668543a admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:17.500719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4f0d7-2fcd-48f9-a9c5-326b5668543a admin admin] PATH_INFO: `/v3/users/2631a42071ac4ce6901d2d1b47ed6c89` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:17.502082 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4f0d7-2fcd-48f9-a9c5-326b5668543a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2631a42071ac4ce6901d2d1b47ed6c89)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:17.504275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4f0d7-2fcd-48f9-a9c5-326b5668543a admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:17.557000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2bd4f0d7-2fcd-48f9-a9c5-326b5668543a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2631a42071ac4ce6901d2d1b47ed6c89'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:17.557714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2bd4f0d7-2fcd-48f9-a9c5-326b5668543a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2631a42071ac4ce6901d2d1b47ed6c89'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:17.567028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2bd4f0d7-2fcd-48f9-a9c5-326b5668543a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2631a42071ac4ce6901d2d1b47ed6c89'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:17.576397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2bd4f0d7-2fcd-48f9-a9c5-326b5668543a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2631a42071ac4ce6901d2d1b47ed6c89'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:17.577144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2bd4f0d7-2fcd-48f9-a9c5-326b5668543a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2631a42071ac4ce6901d2d1b47ed6c89'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:17.600916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1314/2625] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:01:17 2022] DELETE /identity/v3/users/2631a42071ac4ce6901d2d1b47ed6c89 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 11:01:18.290177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19019177-81f1-4f19-8ec1-7a0bb4dbeebb service nova] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:18.313395 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19019177-81f1-4f19-8ec1-7a0bb4dbeebb service nova] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:18.351869 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:18.396495 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:18.397165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:18.397450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:18.397731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8 admin admin] PATH_INFO: `/v3/projects/53fecec360984ee4a295fe00cfcfe8c2` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:18.398928 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53fecec360984ee4a295fe00cfcfe8c2)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:18.400825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:18.454117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53fecec360984ee4a295fe00cfcfe8c2', 'request_id': 'req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:18.460365 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53fecec360984ee4a295fe00cfcfe8c2', 'request_id': 'req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:18.468278 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53fecec360984ee4a295fe00cfcfe8c2', 'request_id': 'req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:18.478714 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8 admin admin] The token cache is being invalidate because project 53fecec360984ee4a295fe00cfcfe8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:01:18.479004 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:18.479635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-667a25e9-8d55-4377-a6cb-7b33e9d96fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:18.481844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1312/2626] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:01:18 2022] DELETE /identity/v3/projects/53fecec360984ee4a295fe00cfcfe8c2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:18.487560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce96c02-aa8c-4ef5-a789-219f78663c60 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:18.488043 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce96c02-aa8c-4ef5-a789-219f78663c60 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:18.488149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce96c02-aa8c-4ef5-a789-219f78663c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:18.508152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-0ce96c02-aa8c-4ef5-a789-219f78663c60 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:18.509362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0ce96c02-aa8c-4ef5-a789-219f78663c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:18.528103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:18.572632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1315/2627] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:18.580450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac5254-34ab-467a-8e87-40a63fcc8181 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:18.580720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac5254-34ab-467a-8e87-40a63fcc8181 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:18.581027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac5254-34ab-467a-8e87-40a63fcc8181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:18.601104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-43ac5254-34ab-467a-8e87-40a63fcc8181 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:18.602353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-43ac5254-34ab-467a-8e87-40a63fcc8181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:18.611204 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1313/2628] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:18.615317 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce96c02-aa8c-4ef5-a789-219f78663c60 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:18.624994 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce96c02-aa8c-4ef5-a789-219f78663c60 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:18.629524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c71f8-80f5-45c1-ab03-597f2bb6b87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:18.630130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c71f8-80f5-45c1-ab03-597f2bb6b87e admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:18.630444 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c71f8-80f5-45c1-ab03-597f2bb6b87e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:18.630721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c71f8-80f5-45c1-ab03-597f2bb6b87e admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:18.631413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c71f8-80f5-45c1-ab03-597f2bb6b87e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 11:01:18.631720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c71f8-80f5-45c1-ab03-597f2bb6b87e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:18.633294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c71f8-80f5-45c1-ab03-597f2bb6b87e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:18.651448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1316/2629] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 11:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 11:01:18.656143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac5254-34ab-467a-8e87-40a63fcc8181 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:18.665390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac5254-34ab-467a-8e87-40a63fcc8181 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:18.670981 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fe94f-b45f-46cf-a0f2-5ad78af049c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:18.671591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fe94f-b45f-46cf-a0f2-5ad78af049c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:18.671877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fe94f-b45f-46cf-a0f2-5ad78af049c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:18.672161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fe94f-b45f-46cf-a0f2-5ad78af049c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:18.672836 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fe94f-b45f-46cf-a0f2-5ad78af049c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:18.674761 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fe94f-b45f-46cf-a0f2-5ad78af049c6 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:18.701785 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1314/2630] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:01:18 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:18.706951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c71f8-80f5-45c1-ab03-597f2bb6b87e admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:18.717748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c71f8-80f5-45c1-ab03-597f2bb6b87e admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:18.897817 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24990d7f-76ac-4b76-a420-70d5c6362e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:18.898479 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24990d7f-76ac-4b76-a420-70d5c6362e19 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:18.898765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24990d7f-76ac-4b76-a420-70d5c6362e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:18.899041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24990d7f-76ac-4b76-a420-70d5c6362e19 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:18.899727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24990d7f-76ac-4b76-a420-70d5c6362e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:18.901627 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24990d7f-76ac-4b76-a420-70d5c6362e19 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:18.924662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1317/2631] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:01:18 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:18.928401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fe94f-b45f-46cf-a0f2-5ad78af049c6 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:18.939044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fe94f-b45f-46cf-a0f2-5ad78af049c6 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:18.943676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c93d12-c97e-4a11-a759-d6a1978ef636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:18.944284 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c93d12-c97e-4a11-a759-d6a1978ef636 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:18.944567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c93d12-c97e-4a11-a759-d6a1978ef636 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:18.944845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c93d12-c97e-4a11-a759-d6a1978ef636 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:18.945554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c93d12-c97e-4a11-a759-d6a1978ef636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:18.947172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c93d12-c97e-4a11-a759-d6a1978ef636 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:18.957717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1315/2632] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:01:18.961540 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24990d7f-76ac-4b76-a420-70d5c6362e19 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:18.972309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24990d7f-76ac-4b76-a420-70d5c6362e19 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:18.976909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce84a77-5cb3-4fd3-8d57-1866b503c21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:18.977507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84a77-5cb3-4fd3-8d57-1866b503c21b admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:18.977788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84a77-5cb3-4fd3-8d57-1866b503c21b admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:18.978071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84a77-5cb3-4fd3-8d57-1866b503c21b admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:18.978790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce84a77-5cb3-4fd3-8d57-1866b503c21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:18.980349 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce84a77-5cb3-4fd3-8d57-1866b503c21b admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:18.990034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1318/2633] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:01:18.994120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c93d12-c97e-4a11-a759-d6a1978ef636 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:19.004450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c93d12-c97e-4a11-a759-d6a1978ef636 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:19.009185 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd69e02-87f6-4c76-9df6-bccc14df4fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:19.009834 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69e02-87f6-4c76-9df6-bccc14df4fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:19.010114 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69e02-87f6-4c76-9df6-bccc14df4fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:19.010441 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd69e02-87f6-4c76-9df6-bccc14df4fe9 admin admin] PATH_INFO: `/v3/projects/1511138790dd411b96bcc3c5c9c461d3/users/d17299adf9144238b9db15ab85a6008d/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:19.025174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd69e02-87f6-4c76-9df6-bccc14df4fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1511138790dd411b96bcc3c5c9c461d3, user_id=d17299adf9144238b9db15ab85a6008d, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:19.028540 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd69e02-87f6-4c76-9df6-bccc14df4fe9 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:19.042412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1316/2634] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:01:18 2022] PUT /identity/v3/projects/1511138790dd411b96bcc3c5c9c461d3/users/d17299adf9144238b9db15ab85a6008d/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:19.054738 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1534e-5394-4860-b069-24ddc038f3e2 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:19.055030 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1534e-5394-4860-b069-24ddc038f3e2 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:19.055312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1534e-5394-4860-b069-24ddc038f3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:19.082995 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-8cc1534e-5394-4860-b069-24ddc038f3e2 None None] MFA Rules not processed for user `d17299adf9144238b9db15ab85a6008d`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:19.084201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8cc1534e-5394-4860-b069-24ddc038f3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:19.148266 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1319/2635] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:19.153372 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd69e02-87f6-4c76-9df6-bccc14df4fe9 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:19.206922 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:19.219921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd69e02-87f6-4c76-9df6-bccc14df4fe9 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:19.224757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c0250-ec3e-46d3-8ab9-3556b32042b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:19.225377 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c0250-ec3e-46d3-8ab9-3556b32042b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:19.225663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c0250-ec3e-46d3-8ab9-3556b32042b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:19.225941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c0250-ec3e-46d3-8ab9-3556b32042b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:19.226637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c0250-ec3e-46d3-8ab9-3556b32042b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:19.228540 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c0250-ec3e-46d3-8ab9-3556b32042b4 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:19.255839 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1317/2636] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:01:19 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:19.259941 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1534e-5394-4860-b069-24ddc038f3e2 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:19.271794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1534e-5394-4860-b069-24ddc038f3e2 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:19.288476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:19.330508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49567ad-ea3e-442d-8f37-704e52472b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:19.331128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49567ad-ea3e-442d-8f37-704e52472b44 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:19.331413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49567ad-ea3e-442d-8f37-704e52472b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:19.331691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49567ad-ea3e-442d-8f37-704e52472b44 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:19.332401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49567ad-ea3e-442d-8f37-704e52472b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:19.334334 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49567ad-ea3e-442d-8f37-704e52472b44 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:19.354867 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1320/2637] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:01:19 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:19.359097 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c0250-ec3e-46d3-8ab9-3556b32042b4 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:19.370056 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c0250-ec3e-46d3-8ab9-3556b32042b4 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:19.375358 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709610a-31b5-4b77-a038-5cebb25c906e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:19.375970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709610a-31b5-4b77-a038-5cebb25c906e admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:19.376255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709610a-31b5-4b77-a038-5cebb25c906e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:19.376534 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709610a-31b5-4b77-a038-5cebb25c906e admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:19.377232 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709610a-31b5-4b77-a038-5cebb25c906e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:19.378899 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709610a-31b5-4b77-a038-5cebb25c906e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:19.390042 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1318/2638] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:01:19.394080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49567ad-ea3e-442d-8f37-704e52472b44 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:19.404181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49567ad-ea3e-442d-8f37-704e52472b44 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:19.408676 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8df15d-e072-4a31-979f-9468c0572703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:19.409329 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8df15d-e072-4a31-979f-9468c0572703 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:19.409606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8df15d-e072-4a31-979f-9468c0572703 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:19.409877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8df15d-e072-4a31-979f-9468c0572703 admin admin] PATH_INFO: `/v3/projects/2efd53553aa141e1b8eacebc47bd0a5e/users/866701291aa64e4abb461dce919b7ca6/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:19.425088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8df15d-e072-4a31-979f-9468c0572703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efd53553aa141e1b8eacebc47bd0a5e, user_id=866701291aa64e4abb461dce919b7ca6, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:19.427741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8df15d-e072-4a31-979f-9468c0572703 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:19.440881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1321/2639] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:01:19 2022] PUT /identity/v3/projects/2efd53553aa141e1b8eacebc47bd0a5e/users/866701291aa64e4abb461dce919b7ca6/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:19.444750 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709610a-31b5-4b77-a038-5cebb25c906e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:19.455429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709610a-31b5-4b77-a038-5cebb25c906e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:19.512533 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eac73-983e-4cdb-8a09-a452eeb008e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:19.513149 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eac73-983e-4cdb-8a09-a452eeb008e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:19.513435 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eac73-983e-4cdb-8a09-a452eeb008e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:19.513699 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eac73-983e-4cdb-8a09-a452eeb008e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:19.514589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eac73-983e-4cdb-8a09-a452eeb008e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:19.516102 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eac73-983e-4cdb-8a09-a452eeb008e4 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:19.526021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1319/2640] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:01:19.530435 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8df15d-e072-4a31-979f-9468c0572703 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:19.540604 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8df15d-e072-4a31-979f-9468c0572703 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:19.545746 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204f66d-c88d-435b-bb87-67c6006902ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:19.546433 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204f66d-c88d-435b-bb87-67c6006902ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:19.546718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204f66d-c88d-435b-bb87-67c6006902ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:19.546995 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204f66d-c88d-435b-bb87-67c6006902ee admin admin] PATH_INFO: `/v3/projects/2efd53553aa141e1b8eacebc47bd0a5e/users/866701291aa64e4abb461dce919b7ca6/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:19.548938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204f66d-c88d-435b-bb87-67c6006902ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2efd53553aa141e1b8eacebc47bd0a5e, user_id=866701291aa64e4abb461dce919b7ca6, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:19.551580 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204f66d-c88d-435b-bb87-67c6006902ee admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:19.562171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1322/2641] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:01:19 2022] PUT /identity/v3/projects/2efd53553aa141e1b8eacebc47bd0a5e/users/866701291aa64e4abb461dce919b7ca6/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:19.572651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d3077-5138-4dcd-94cf-561a2b842025 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:19.573137 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d3077-5138-4dcd-94cf-561a2b842025 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:19.573560 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d3077-5138-4dcd-94cf-561a2b842025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:19.601294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-ec2d3077-5138-4dcd-94cf-561a2b842025 None None] MFA Rules not processed for user `866701291aa64e4abb461dce919b7ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:19.602527 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ec2d3077-5138-4dcd-94cf-561a2b842025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:19.670867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1320/2642] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:19.682029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204f66d-c88d-435b-bb87-67c6006902ee admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:19.684385 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f204f66d-c88d-435b-bb87-67c6006902ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:19.749178 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204f66d-c88d-435b-bb87-67c6006902ee admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:19.752852 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad48bdd-054a-48ed-956b-0fb4b7c5fd6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:19.753537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad48bdd-054a-48ed-956b-0fb4b7c5fd6d service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:19.753816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad48bdd-054a-48ed-956b-0fb4b7c5fd6d service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:19.754091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad48bdd-054a-48ed-956b-0fb4b7c5fd6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:19.809797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad48bdd-054a-48ed-956b-0fb4b7c5fd6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:19.811254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad48bdd-054a-48ed-956b-0fb4b7c5fd6d service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:19.820020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1323/2643] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:01:21.174457 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d3077-5138-4dcd-94cf-561a2b842025 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:21.175960 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ec2d3077-5138-4dcd-94cf-561a2b842025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:21.189163 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d3077-5138-4dcd-94cf-561a2b842025 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:21.192766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0ba15-32b3-42fa-8e36-2faa3c3008f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:21.193386 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0ba15-32b3-42fa-8e36-2faa3c3008f0 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:21.193670 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0ba15-32b3-42fa-8e36-2faa3c3008f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:21.193945 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0ba15-32b3-42fa-8e36-2faa3c3008f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:21.203034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0ba15-32b3-42fa-8e36-2faa3c3008f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:21.204457 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0ba15-32b3-42fa-8e36-2faa3c3008f0 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:21.213914 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1321/2644] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:01:24.990299 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad48bdd-054a-48ed-956b-0fb4b7c5fd6d service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:25.020021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:25.055134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad48bdd-054a-48ed-956b-0fb4b7c5fd6d service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:25.060340 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13891e-0185-48d3-b3b9-f5e994002f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:25.060975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13891e-0185-48d3-b3b9-f5e994002f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:25.061259 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13891e-0185-48d3-b3b9-f5e994002f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:25.061531 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13891e-0185-48d3-b3b9-f5e994002f07 admin admin] PATH_INFO: `/v3/users/d17299adf9144238b9db15ab85a6008d` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:25.062719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13891e-0185-48d3-b3b9-f5e994002f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17299adf9144238b9db15ab85a6008d)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:25.064614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13891e-0185-48d3-b3b9-f5e994002f07 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:25.108647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-7c13891e-0185-48d3-b3b9-f5e994002f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17299adf9144238b9db15ab85a6008d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.109222 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-7c13891e-0185-48d3-b3b9-f5e994002f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17299adf9144238b9db15ab85a6008d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.117118 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-7c13891e-0185-48d3-b3b9-f5e994002f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17299adf9144238b9db15ab85a6008d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.124544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-7c13891e-0185-48d3-b3b9-f5e994002f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17299adf9144238b9db15ab85a6008d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.125168 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-7c13891e-0185-48d3-b3b9-f5e994002f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17299adf9144238b9db15ab85a6008d'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.141845 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1324/2645] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:01:24 2022] DELETE /identity/v3/users/d17299adf9144238b9db15ab85a6008d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:25.146297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9eac6-625c-49e5-b6bd-9472e676e241 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:25.146806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9eac6-625c-49e5-b6bd-9472e676e241 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:25.146905 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9eac6-625c-49e5-b6bd-9472e676e241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:25.165729 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-75f9eac6-625c-49e5-b6bd-9472e676e241 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:25.166973 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-75f9eac6-625c-49e5-b6bd-9472e676e241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:25.197538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:25.229827 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1322/2646] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:25.240293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13891e-0185-48d3-b3b9-f5e994002f07 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:25.241656 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7c13891e-0185-48d3-b3b9-f5e994002f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:25.302244 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13891e-0185-48d3-b3b9-f5e994002f07 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:25.306199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37670181-4784-49d7-bad0-770352e513dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:25.306839 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37670181-4784-49d7-bad0-770352e513dc service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:25.307123 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37670181-4784-49d7-bad0-770352e513dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:25.307399 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37670181-4784-49d7-bad0-770352e513dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:25.317561 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37670181-4784-49d7-bad0-770352e513dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:25.319015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37670181-4784-49d7-bad0-770352e513dc service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:25.328864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1325/2647] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:01:25.605654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9eac6-625c-49e5-b6bd-9472e676e241 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:25.607156 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-75f9eac6-625c-49e5-b6bd-9472e676e241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:25.619810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9eac6-625c-49e5-b6bd-9472e676e241 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:25.625301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:25.625941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:25.626260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:25.626548 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] PATH_INFO: `/v3/projects/1511138790dd411b96bcc3c5c9c461d3` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:25.627733 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1511138790dd411b96bcc3c5c9c461d3)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:25.629717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:25.680326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1511138790dd411b96bcc3c5c9c461d3', 'request_id': 'req-01249b31-507c-4e57-92fc-215aac3da211'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.687255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1511138790dd411b96bcc3c5c9c461d3', 'request_id': 'req-01249b31-507c-4e57-92fc-215aac3da211'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.694545 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1511138790dd411b96bcc3c5c9c461d3', 'request_id': 'req-01249b31-507c-4e57-92fc-215aac3da211'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.704848 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] The token cache is being invalidate because project 1511138790dd411b96bcc3c5c9c461d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:01:25.705135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.705755 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.707301 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1323/2648] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:01:25 2022] DELETE /identity/v3/projects/1511138790dd411b96bcc3c5c9c461d3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:25.711308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37670181-4784-49d7-bad0-770352e513dc service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:25.721418 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37670181-4784-49d7-bad0-770352e513dc service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:25.765432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:25.779917 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6811e2-d16a-4f16-b76e-cc73a35ca886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:25.780560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6811e2-d16a-4f16-b76e-cc73a35ca886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:25.780843 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6811e2-d16a-4f16-b76e-cc73a35ca886 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:25.781119 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6811e2-d16a-4f16-b76e-cc73a35ca886 admin admin] PATH_INFO: `/v3/users/866701291aa64e4abb461dce919b7ca6` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:25.782306 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6811e2-d16a-4f16-b76e-cc73a35ca886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=866701291aa64e4abb461dce919b7ca6)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:25.784220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6811e2-d16a-4f16-b76e-cc73a35ca886 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:25.830595 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-0a6811e2-d16a-4f16-b76e-cc73a35ca886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '866701291aa64e4abb461dce919b7ca6'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.831228 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-0a6811e2-d16a-4f16-b76e-cc73a35ca886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '866701291aa64e4abb461dce919b7ca6'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.838303 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-0a6811e2-d16a-4f16-b76e-cc73a35ca886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '866701291aa64e4abb461dce919b7ca6'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.845384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-0a6811e2-d16a-4f16-b76e-cc73a35ca886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '866701291aa64e4abb461dce919b7ca6'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.846058 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-0a6811e2-d16a-4f16-b76e-cc73a35ca886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '866701291aa64e4abb461dce919b7ca6'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:25.864227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1326/2649] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:01:25 2022] DELETE /identity/v3/users/866701291aa64e4abb461dce919b7ca6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 11:01:26.141935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:26.143641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:26.161141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01249b31-507c-4e57-92fc-215aac3da211 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:26.219815 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86fe69-6b0b-423b-9403-462002cd1c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:26.220501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86fe69-6b0b-423b-9403-462002cd1c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:26.220788 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86fe69-6b0b-423b-9403-462002cd1c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:26.221069 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86fe69-6b0b-423b-9403-462002cd1c17 admin admin] PATH_INFO: `/v3/projects/2efd53553aa141e1b8eacebc47bd0a5e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:26.222311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86fe69-6b0b-423b-9403-462002cd1c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2efd53553aa141e1b8eacebc47bd0a5e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:26.224256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86fe69-6b0b-423b-9403-462002cd1c17 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:26.272138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5b86fe69-6b0b-423b-9403-462002cd1c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2efd53553aa141e1b8eacebc47bd0a5e', 'request_id': 'req-5b86fe69-6b0b-423b-9403-462002cd1c17'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:26.279172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5b86fe69-6b0b-423b-9403-462002cd1c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2efd53553aa141e1b8eacebc47bd0a5e', 'request_id': 'req-5b86fe69-6b0b-423b-9403-462002cd1c17'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:26.283044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:26.289055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5b86fe69-6b0b-423b-9403-462002cd1c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2efd53553aa141e1b8eacebc47bd0a5e', 'request_id': 'req-5b86fe69-6b0b-423b-9403-462002cd1c17'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:26.301817 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5b86fe69-6b0b-423b-9403-462002cd1c17 admin admin] The token cache is being invalidate because project 2efd53553aa141e1b8eacebc47bd0a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:01:26.302102 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5b86fe69-6b0b-423b-9403-462002cd1c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:26.302767 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5b86fe69-6b0b-423b-9403-462002cd1c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:26.304285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1324/2650] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:01:26 2022] DELETE /identity/v3/projects/2efd53553aa141e1b8eacebc47bd0a5e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:26.309904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ebda8-4d73-490c-af69-7a1890ae5723 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:26.310453 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ebda8-4d73-490c-af69-7a1890ae5723 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:26.310541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ebda8-4d73-490c-af69-7a1890ae5723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:26.330843 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-e28ebda8-4d73-490c-af69-7a1890ae5723 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:26.332046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-e28ebda8-4d73-490c-af69-7a1890ae5723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:26.393265 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1327/2651] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:26.401203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be14db-0208-4d3c-bbd5-1f13185fa04e None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:26.401492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be14db-0208-4d3c-bbd5-1f13185fa04e None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:26.401769 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be14db-0208-4d3c-bbd5-1f13185fa04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:26.423336 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-64be14db-0208-4d3c-bbd5-1f13185fa04e None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:26.424555 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-64be14db-0208-4d3c-bbd5-1f13185fa04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:26.432505 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1325/2652] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:26.437133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ebda8-4d73-490c-af69-7a1890ae5723 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:26.446828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ebda8-4d73-490c-af69-7a1890ae5723 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:26.452004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0b941-335a-4dc3-ba19-94649ba54fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:26.452611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0b941-335a-4dc3-ba19-94649ba54fef admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:26.452889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0b941-335a-4dc3-ba19-94649ba54fef admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:26.453161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0b941-335a-4dc3-ba19-94649ba54fef admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:26.453853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0b941-335a-4dc3-ba19-94649ba54fef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 11:01:26.454158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0b941-335a-4dc3-ba19-94649ba54fef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:26.455782 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0b941-335a-4dc3-ba19-94649ba54fef admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:26.468217 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1328/2653] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 11:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 11:01:26.472589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be14db-0208-4d3c-bbd5-1f13185fa04e None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:26.482094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be14db-0208-4d3c-bbd5-1f13185fa04e None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:26.486865 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696836b-e6f2-4ece-9904-3edd5d362cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:26.487632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696836b-e6f2-4ece-9904-3edd5d362cde admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:26.488118 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696836b-e6f2-4ece-9904-3edd5d362cde admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:26.488679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696836b-e6f2-4ece-9904-3edd5d362cde admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:26.489957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696836b-e6f2-4ece-9904-3edd5d362cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:26.493664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696836b-e6f2-4ece-9904-3edd5d362cde admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:26.527762 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1326/2654] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:01:26 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:26.532041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0b941-335a-4dc3-ba19-94649ba54fef admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:26.541885 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0b941-335a-4dc3-ba19-94649ba54fef admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:26.592785 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:26.601036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa4bf9-9afa-4316-86fa-1e248316165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:26.601759 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4bf9-9afa-4316-86fa-1e248316165e admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:26.602085 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4bf9-9afa-4316-86fa-1e248316165e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:26.602376 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4bf9-9afa-4316-86fa-1e248316165e admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:26.603320 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa4bf9-9afa-4316-86fa-1e248316165e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:26.605641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa4bf9-9afa-4316-86fa-1e248316165e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:26.626789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1329/2655] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:01:26 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:26.631233 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696836b-e6f2-4ece-9904-3edd5d362cde admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:26.642601 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696836b-e6f2-4ece-9904-3edd5d362cde admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:26.647345 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86e0fb-800b-4390-acb3-39520338de60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:26.647898 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86e0fb-800b-4390-acb3-39520338de60 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:26.648182 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86e0fb-800b-4390-acb3-39520338de60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:26.648457 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86e0fb-800b-4390-acb3-39520338de60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:26.649221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86e0fb-800b-4390-acb3-39520338de60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:26.650866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86e0fb-800b-4390-acb3-39520338de60 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:26.662066 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1327/2656] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:01:26.666323 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa4bf9-9afa-4316-86fa-1e248316165e admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:26.678216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa4bf9-9afa-4316-86fa-1e248316165e admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:26.682943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62045c6d-9708-4472-97fd-b2f2607e36c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:26.684161 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62045c6d-9708-4472-97fd-b2f2607e36c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:26.684450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62045c6d-9708-4472-97fd-b2f2607e36c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:26.684714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62045c6d-9708-4472-97fd-b2f2607e36c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:26.685406 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62045c6d-9708-4472-97fd-b2f2607e36c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:26.687062 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62045c6d-9708-4472-97fd-b2f2607e36c3 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:26.697749 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1330/2657] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:01:26.702065 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86e0fb-800b-4390-acb3-39520338de60 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:26.712255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86e0fb-800b-4390-acb3-39520338de60 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:26.717266 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2740d1-387b-4a8b-adea-eebbedd73823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:26.717932 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2740d1-387b-4a8b-adea-eebbedd73823 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:26.718249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2740d1-387b-4a8b-adea-eebbedd73823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:26.718535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2740d1-387b-4a8b-adea-eebbedd73823 admin admin] PATH_INFO: `/v3/projects/f1f76c500e7e4d5186b02d9e137f46d5/users/80fc383d60994523a998becaf55dc229/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:26.734046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2740d1-387b-4a8b-adea-eebbedd73823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f76c500e7e4d5186b02d9e137f46d5, user_id=80fc383d60994523a998becaf55dc229, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:26.736842 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2740d1-387b-4a8b-adea-eebbedd73823 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:26.750526 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1328/2658] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:01:26 2022] PUT /identity/v3/projects/f1f76c500e7e4d5186b02d9e137f46d5/users/80fc383d60994523a998becaf55dc229/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:26.761893 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57834256-543f-4f72-9b2b-c2115ef0c393 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:26.762195 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57834256-543f-4f72-9b2b-c2115ef0c393 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:26.762489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57834256-543f-4f72-9b2b-c2115ef0c393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:26.790039 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-57834256-543f-4f72-9b2b-c2115ef0c393 None None] MFA Rules not processed for user `80fc383d60994523a998becaf55dc229`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:26.791308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-57834256-543f-4f72-9b2b-c2115ef0c393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:26.857438 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1331/2659] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:26.862093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2740d1-387b-4a8b-adea-eebbedd73823 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:26.927764 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2740d1-387b-4a8b-adea-eebbedd73823 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:26.932332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b4173-e631-4c4f-825d-81eac88b2e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:26.932948 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b4173-e631-4c4f-825d-81eac88b2e14 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:26.933275 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b4173-e631-4c4f-825d-81eac88b2e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:26.933754 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b4173-e631-4c4f-825d-81eac88b2e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:26.934634 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b4173-e631-4c4f-825d-81eac88b2e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:26.936529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b4173-e631-4c4f-825d-81eac88b2e14 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:26.963673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1329/2660] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:01:26 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:26.968778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57834256-543f-4f72-9b2b-c2115ef0c393 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:26.979470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57834256-543f-4f72-9b2b-c2115ef0c393 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:27.037143 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3d2a3-ee0d-47d2-917f-a4c3085e9c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:27.037775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3d2a3-ee0d-47d2-917f-a4c3085e9c1e admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:27.038055 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3d2a3-ee0d-47d2-917f-a4c3085e9c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:27.038354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3d2a3-ee0d-47d2-917f-a4c3085e9c1e admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:27.039018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3d2a3-ee0d-47d2-917f-a4c3085e9c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:27.040922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3d2a3-ee0d-47d2-917f-a4c3085e9c1e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:27.063577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1332/2661] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:01:26 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:27.067706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b4173-e631-4c4f-825d-81eac88b2e14 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:27.079468 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b4173-e631-4c4f-825d-81eac88b2e14 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:27.084441 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40e59c-b394-4da4-8b14-2310800312ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:27.085072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40e59c-b394-4da4-8b14-2310800312ac admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:27.085354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40e59c-b394-4da4-8b14-2310800312ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:27.085687 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40e59c-b394-4da4-8b14-2310800312ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:27.086420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40e59c-b394-4da4-8b14-2310800312ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:27.088051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40e59c-b394-4da4-8b14-2310800312ac admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:27.099808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1330/2662] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:01:27.104007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3d2a3-ee0d-47d2-917f-a4c3085e9c1e admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:27.115266 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3d2a3-ee0d-47d2-917f-a4c3085e9c1e admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:27.120073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e745fa5-b327-4dbd-b85b-0d4f350857b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:27.120771 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e745fa5-b327-4dbd-b85b-0d4f350857b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:27.121056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e745fa5-b327-4dbd-b85b-0d4f350857b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:27.121408 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e745fa5-b327-4dbd-b85b-0d4f350857b8 admin admin] PATH_INFO: `/v3/projects/aa8787a435084736aebec935e690ddc2/users/e717f745745b4189bf2eee02e0bfd64e/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:27.136309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e745fa5-b327-4dbd-b85b-0d4f350857b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8787a435084736aebec935e690ddc2, user_id=e717f745745b4189bf2eee02e0bfd64e, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:27.139080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e745fa5-b327-4dbd-b85b-0d4f350857b8 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:27.152524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1333/2663] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:01:27 2022] PUT /identity/v3/projects/aa8787a435084736aebec935e690ddc2/users/e717f745745b4189bf2eee02e0bfd64e/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:27.156528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40e59c-b394-4da4-8b14-2310800312ac admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:27.166777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40e59c-b394-4da4-8b14-2310800312ac admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:27.219220 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:27.225874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f0c34-13fd-4e3d-ad55-704b413ee839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:27.226540 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f0c34-13fd-4e3d-ad55-704b413ee839 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:27.227146 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f0c34-13fd-4e3d-ad55-704b413ee839 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:27.227464 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f0c34-13fd-4e3d-ad55-704b413ee839 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:27.228332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f0c34-13fd-4e3d-ad55-704b413ee839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:27.230733 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f0c34-13fd-4e3d-ad55-704b413ee839 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:27.241307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1331/2664] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:01:27.245341 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e745fa5-b327-4dbd-b85b-0d4f350857b8 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:27.255828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e745fa5-b327-4dbd-b85b-0d4f350857b8 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:27.260395 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a95e2e-e77d-4e98-9e48-17653072097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:27.261061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a95e2e-e77d-4e98-9e48-17653072097e admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:27.261928 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a95e2e-e77d-4e98-9e48-17653072097e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:27.262229 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a95e2e-e77d-4e98-9e48-17653072097e admin admin] PATH_INFO: `/v3/projects/aa8787a435084736aebec935e690ddc2/users/e717f745745b4189bf2eee02e0bfd64e/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:27.264194 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a95e2e-e77d-4e98-9e48-17653072097e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8787a435084736aebec935e690ddc2, user_id=e717f745745b4189bf2eee02e0bfd64e, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:27.266860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a95e2e-e77d-4e98-9e48-17653072097e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:27.278243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1334/2665] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:01:27 2022] PUT /identity/v3/projects/aa8787a435084736aebec935e690ddc2/users/e717f745745b4189bf2eee02e0bfd64e/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:27.288516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a22a45-68df-4fea-bf9c-71c26f9a1d88 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:27.288830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a22a45-68df-4fea-bf9c-71c26f9a1d88 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:27.289113 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a22a45-68df-4fea-bf9c-71c26f9a1d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:27.319517 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-95a22a45-68df-4fea-bf9c-71c26f9a1d88 None None] MFA Rules not processed for user `e717f745745b4189bf2eee02e0bfd64e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:27.320754 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-95a22a45-68df-4fea-bf9c-71c26f9a1d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:27.391578 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1332/2666] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:27.402878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a95e2e-e77d-4e98-9e48-17653072097e admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:27.404662 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-69a95e2e-e77d-4e98-9e48-17653072097e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:27.424289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:27.467411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a95e2e-e77d-4e98-9e48-17653072097e admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:27.471160 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cb348-d1b4-4501-b580-9db844fc8440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:27.471707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cb348-d1b4-4501-b580-9db844fc8440 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:27.471990 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cb348-d1b4-4501-b580-9db844fc8440 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:27.472270 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cb348-d1b4-4501-b580-9db844fc8440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:27.481951 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cb348-d1b4-4501-b580-9db844fc8440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:27.483411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cb348-d1b4-4501-b580-9db844fc8440 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:27.492810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1335/2667] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:01:28.041600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a22a45-68df-4fea-bf9c-71c26f9a1d88 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:28.104990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a22a45-68df-4fea-bf9c-71c26f9a1d88 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:28.109878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9357d6-37b4-436d-a37b-3e98ad6a4ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:28.110607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9357d6-37b4-436d-a37b-3e98ad6a4ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:28.110892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9357d6-37b4-436d-a37b-3e98ad6a4ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:28.111172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9357d6-37b4-436d-a37b-3e98ad6a4ab3 admin admin] PATH_INFO: `/v3/users/80fc383d60994523a998becaf55dc229` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:28.112397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9357d6-37b4-436d-a37b-3e98ad6a4ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80fc383d60994523a998becaf55dc229)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:28.114370 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9357d6-37b4-436d-a37b-3e98ad6a4ab3 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:28.165633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fe9357d6-37b4-436d-a37b-3e98ad6a4ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80fc383d60994523a998becaf55dc229'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.166324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fe9357d6-37b4-436d-a37b-3e98ad6a4ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80fc383d60994523a998becaf55dc229'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.174129 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fe9357d6-37b4-436d-a37b-3e98ad6a4ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80fc383d60994523a998becaf55dc229'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.174805 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fe9357d6-37b4-436d-a37b-3e98ad6a4ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80fc383d60994523a998becaf55dc229'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.181952 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fe9357d6-37b4-436d-a37b-3e98ad6a4ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80fc383d60994523a998becaf55dc229'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.194973 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:28.201863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1333/2668] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:01:28 2022] DELETE /identity/v3/users/80fc383d60994523a998becaf55dc229 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:28.206557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd6704-befd-47d2-afbe-ce1ce0a81069 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:28.206844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd6704-befd-47d2-afbe-ce1ce0a81069 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:28.207115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd6704-befd-47d2-afbe-ce1ce0a81069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:28.226003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-1fbd6704-befd-47d2-afbe-ce1ce0a81069 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:28.227241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1fbd6704-befd-47d2-afbe-ce1ce0a81069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:28.285914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1336/2669] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 11:01:28.296138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9357d6-37b4-436d-a37b-3e98ad6a4ab3 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:28.297550 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-fe9357d6-37b4-436d-a37b-3e98ad6a4ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:28.356379 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9357d6-37b4-436d-a37b-3e98ad6a4ab3 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:28.360020 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a0439-1ccf-4858-b283-ed8e88f023b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:28.360631 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a0439-1ccf-4858-b283-ed8e88f023b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:28.360910 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a0439-1ccf-4858-b283-ed8e88f023b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:28.361187 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a0439-1ccf-4858-b283-ed8e88f023b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:28.370262 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a0439-1ccf-4858-b283-ed8e88f023b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:28.373347 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a0439-1ccf-4858-b283-ed8e88f023b1 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:28.383225 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1334/2670] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:01:28.654989 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd6704-befd-47d2-afbe-ce1ce0a81069 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:28.656856 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1fbd6704-befd-47d2-afbe-ce1ce0a81069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:28.670815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd6704-befd-47d2-afbe-ce1ce0a81069 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:28.675736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:28.676446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:28.676729 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:28.677003 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] PATH_INFO: `/v3/projects/f1f76c500e7e4d5186b02d9e137f46d5` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:28.678203 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f76c500e7e4d5186b02d9e137f46d5)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:28.680249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:28.728741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f76c500e7e4d5186b02d9e137f46d5', 'request_id': 'req-c96939fd-2171-4069-b7fd-a0b7c8633b5f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.735031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f76c500e7e4d5186b02d9e137f46d5', 'request_id': 'req-c96939fd-2171-4069-b7fd-a0b7c8633b5f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.740678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f76c500e7e4d5186b02d9e137f46d5', 'request_id': 'req-c96939fd-2171-4069-b7fd-a0b7c8633b5f'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.752992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] The token cache is being invalidate because project f1f76c500e7e4d5186b02d9e137f46d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:01:28.753281 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.753894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.755525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1337/2671] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:01:28 2022] DELETE /identity/v3/projects/f1f76c500e7e4d5186b02d9e137f46d5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:28.759648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a0439-1ccf-4858-b283-ed8e88f023b1 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:28.770165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a0439-1ccf-4858-b283-ed8e88f023b1 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:28.827571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08869f5f-5cbc-4719-b1b8-fb0a9fa48f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:28.828217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08869f5f-5cbc-4719-b1b8-fb0a9fa48f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:28.828500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08869f5f-5cbc-4719-b1b8-fb0a9fa48f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:28.828778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08869f5f-5cbc-4719-b1b8-fb0a9fa48f26 admin admin] PATH_INFO: `/v3/users/e717f745745b4189bf2eee02e0bfd64e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:28.830016 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08869f5f-5cbc-4719-b1b8-fb0a9fa48f26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e717f745745b4189bf2eee02e0bfd64e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:28.831902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08869f5f-5cbc-4719-b1b8-fb0a9fa48f26 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:28.878049 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-08869f5f-5cbc-4719-b1b8-fb0a9fa48f26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e717f745745b4189bf2eee02e0bfd64e'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.878740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-08869f5f-5cbc-4719-b1b8-fb0a9fa48f26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e717f745745b4189bf2eee02e0bfd64e'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.885562 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-08869f5f-5cbc-4719-b1b8-fb0a9fa48f26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e717f745745b4189bf2eee02e0bfd64e'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.886781 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-08869f5f-5cbc-4719-b1b8-fb0a9fa48f26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e717f745745b4189bf2eee02e0bfd64e'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.896898 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-08869f5f-5cbc-4719-b1b8-fb0a9fa48f26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e717f745745b4189bf2eee02e0bfd64e'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:28.915234 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1335/2672] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:01:28 2022] DELETE /identity/v3/users/e717f745745b4189bf2eee02e0bfd64e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:29.194242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:29.195705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:29.209273 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96939fd-2171-4069-b7fd-a0b7c8633b5f admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:29.250800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:29.270741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:29.271388 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:29.271671 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:29.271947 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1 admin admin] PATH_INFO: `/v3/projects/aa8787a435084736aebec935e690ddc2` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:29.273128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8787a435084736aebec935e690ddc2)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:29.275073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:29.322783 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8787a435084736aebec935e690ddc2', 'request_id': 'req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:29.329630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8787a435084736aebec935e690ddc2', 'request_id': 'req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:29.335142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8787a435084736aebec935e690ddc2', 'request_id': 'req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:29.348485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1 admin admin] The token cache is being invalidate because project aa8787a435084736aebec935e690ddc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:01:29.348772 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:29.349389 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-333ef472-b2c9-4e26-8d96-ebd8efebf0a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:29.350919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1338/2673] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:01:29 2022] DELETE /identity/v3/projects/aa8787a435084736aebec935e690ddc2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:29.355833 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c68500-e0e0-4938-8aba-a613ce5f1f28 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:29.356343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c68500-e0e0-4938-8aba-a613ce5f1f28 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:29.356452 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c68500-e0e0-4938-8aba-a613ce5f1f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:29.376277 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-93c68500-e0e0-4938-8aba-a613ce5f1f28 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:29.377475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-93c68500-e0e0-4938-8aba-a613ce5f1f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:29.390785 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:29.439387 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1336/2674] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:29.447092 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8bc40-d0bb-47a8-999d-10da65cf32e2 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:29.447410 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8bc40-d0bb-47a8-999d-10da65cf32e2 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:29.447694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8bc40-d0bb-47a8-999d-10da65cf32e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:29.467508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-31f8bc40-d0bb-47a8-999d-10da65cf32e2 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:29.468735 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-31f8bc40-d0bb-47a8-999d-10da65cf32e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:29.476765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1339/2675] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:29.481875 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c68500-e0e0-4938-8aba-a613ce5f1f28 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:29.492029 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c68500-e0e0-4938-8aba-a613ce5f1f28 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:29.497456 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd5756-d7cd-4b62-83af-9f162f6d2479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:29.498078 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd5756-d7cd-4b62-83af-9f162f6d2479 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:29.498538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd5756-d7cd-4b62-83af-9f162f6d2479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:29.498825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd5756-d7cd-4b62-83af-9f162f6d2479 admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:29.499531 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd5756-d7cd-4b62-83af-9f162f6d2479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 11:01:29.499841 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd5756-d7cd-4b62-83af-9f162f6d2479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:29.501426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd5756-d7cd-4b62-83af-9f162f6d2479 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:29.513384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1337/2676] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 11:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 11:01:29.517915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8bc40-d0bb-47a8-999d-10da65cf32e2 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:29.527277 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8bc40-d0bb-47a8-999d-10da65cf32e2 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:29.532057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595370ef-1586-4ea6-9773-e46beade2fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:29.532700 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595370ef-1586-4ea6-9773-e46beade2fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:29.532982 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595370ef-1586-4ea6-9773-e46beade2fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:29.533260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595370ef-1586-4ea6-9773-e46beade2fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:29.533926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595370ef-1586-4ea6-9773-e46beade2fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:29.535891 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595370ef-1586-4ea6-9773-e46beade2fe2 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:29.564726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1340/2677] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:01:29 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:29.569092 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd5756-d7cd-4b62-83af-9f162f6d2479 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:29.580825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd5756-d7cd-4b62-83af-9f162f6d2479 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:29.637711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da1b1c-0e7d-481e-a173-582a8ca2499f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:29.638367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da1b1c-0e7d-481e-a173-582a8ca2499f admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:29.638656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da1b1c-0e7d-481e-a173-582a8ca2499f admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:29.638935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da1b1c-0e7d-481e-a173-582a8ca2499f admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:29.639622 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da1b1c-0e7d-481e-a173-582a8ca2499f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:29.641544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da1b1c-0e7d-481e-a173-582a8ca2499f admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:29.662315 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1338/2678] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:01:29 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:29.666481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595370ef-1586-4ea6-9773-e46beade2fe2 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:29.678505 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595370ef-1586-4ea6-9773-e46beade2fe2 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:29.683881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6060ea-0984-40ff-ae8d-ba98a7a0e9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:29.684498 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6060ea-0984-40ff-ae8d-ba98a7a0e9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:29.684778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6060ea-0984-40ff-ae8d-ba98a7a0e9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:29.685070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6060ea-0984-40ff-ae8d-ba98a7a0e9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:29.685745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6060ea-0984-40ff-ae8d-ba98a7a0e9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:29.687364 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6060ea-0984-40ff-ae8d-ba98a7a0e9a6 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:29.697492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1341/2679] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:01:29.701599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da1b1c-0e7d-481e-a173-582a8ca2499f admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:29.711910 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da1b1c-0e7d-481e-a173-582a8ca2499f admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:29.716625 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6524bfa-2423-406c-bc09-815ed95e2ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:29.717237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6524bfa-2423-406c-bc09-815ed95e2ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:29.717517 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6524bfa-2423-406c-bc09-815ed95e2ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:29.717791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6524bfa-2423-406c-bc09-815ed95e2ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:29.718544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6524bfa-2423-406c-bc09-815ed95e2ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:29.720165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6524bfa-2423-406c-bc09-815ed95e2ed3 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:29.731501 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1339/2680] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:01:29.735603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6060ea-0984-40ff-ae8d-ba98a7a0e9a6 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:29.746298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6060ea-0984-40ff-ae8d-ba98a7a0e9a6 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:29.751094 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9cb4f-fdd9-4231-beaa-cbe6d8699bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:29.751767 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9cb4f-fdd9-4231-beaa-cbe6d8699bff admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:29.752048 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9cb4f-fdd9-4231-beaa-cbe6d8699bff admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:29.752326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9cb4f-fdd9-4231-beaa-cbe6d8699bff admin admin] PATH_INFO: `/v3/projects/8052b197bee545979e1a63a1143ebd74/users/d6efb40865a44126b2d2483819cd7565/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:29.767812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9cb4f-fdd9-4231-beaa-cbe6d8699bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8052b197bee545979e1a63a1143ebd74, user_id=d6efb40865a44126b2d2483819cd7565, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:29.770467 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9cb4f-fdd9-4231-beaa-cbe6d8699bff admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:29.783524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1342/2681] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:01:29 2022] PUT /identity/v3/projects/8052b197bee545979e1a63a1143ebd74/users/d6efb40865a44126b2d2483819cd7565/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:29.795552 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373928d-5ab7-468d-bc9a-29cda6c4c01c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:29.795841 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373928d-5ab7-468d-bc9a-29cda6c4c01c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:29.796118 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373928d-5ab7-468d-bc9a-29cda6c4c01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:29.825304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-3373928d-5ab7-468d-bc9a-29cda6c4c01c None None] MFA Rules not processed for user `d6efb40865a44126b2d2483819cd7565`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:29.826561 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3373928d-5ab7-468d-bc9a-29cda6c4c01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:29.892160 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1340/2682] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:29.903943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9cb4f-fdd9-4231-beaa-cbe6d8699bff admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:29.905630 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3fe9cb4f-fdd9-4231-beaa-cbe6d8699bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:29.963142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9cb4f-fdd9-4231-beaa-cbe6d8699bff admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:29.967695 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c31b9-1aba-4b7d-8a8f-391f047ebdf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:29.968307 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c31b9-1aba-4b7d-8a8f-391f047ebdf9 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:29.968584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c31b9-1aba-4b7d-8a8f-391f047ebdf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:29.968853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c31b9-1aba-4b7d-8a8f-391f047ebdf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:29.977643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c31b9-1aba-4b7d-8a8f-391f047ebdf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:29.979105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c31b9-1aba-4b7d-8a8f-391f047ebdf9 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:29.989149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1343/2683] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:01:30.009480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373928d-5ab7-468d-bc9a-29cda6c4c01c None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:30.027538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:30.075837 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373928d-5ab7-468d-bc9a-29cda6c4c01c None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:30.080500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023094d-0ae7-412b-b83e-56b9ea014974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:30.081184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023094d-0ae7-412b-b83e-56b9ea014974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:30.081465 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023094d-0ae7-412b-b83e-56b9ea014974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:30.081738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023094d-0ae7-412b-b83e-56b9ea014974 admin admin] PATH_INFO: `/v3/users/d6efb40865a44126b2d2483819cd7565` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:30.082970 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023094d-0ae7-412b-b83e-56b9ea014974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6efb40865a44126b2d2483819cd7565)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:30.084894 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023094d-0ae7-412b-b83e-56b9ea014974 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:30.133147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5023094d-0ae7-412b-b83e-56b9ea014974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6efb40865a44126b2d2483819cd7565'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:30.133893 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5023094d-0ae7-412b-b83e-56b9ea014974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6efb40865a44126b2d2483819cd7565'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:30.142499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5023094d-0ae7-412b-b83e-56b9ea014974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6efb40865a44126b2d2483819cd7565'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:30.143108 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5023094d-0ae7-412b-b83e-56b9ea014974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6efb40865a44126b2d2483819cd7565'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:30.150597 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5023094d-0ae7-412b-b83e-56b9ea014974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6efb40865a44126b2d2483819cd7565'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:30.169365 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1341/2684] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:01:30 2022] DELETE /identity/v3/users/d6efb40865a44126b2d2483819cd7565 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:30.173826 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6b8b5-43b3-414e-94d2-7abe0f5829a0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:30.174117 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6b8b5-43b3-414e-94d2-7abe0f5829a0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:30.174428 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6b8b5-43b3-414e-94d2-7abe0f5829a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:30.194660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-ccc6b8b5-43b3-414e-94d2-7abe0f5829a0 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:30.195902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ccc6b8b5-43b3-414e-94d2-7abe0f5829a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:30.201278 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:30.257900 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1344/2685] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:30.267741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023094d-0ae7-412b-b83e-56b9ea014974 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:30.269153 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-5023094d-0ae7-412b-b83e-56b9ea014974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:30.327386 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023094d-0ae7-412b-b83e-56b9ea014974 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:30.331052 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1750b71-896d-43a0-9815-c157a84253e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:30.331676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750b71-896d-43a0-9815-c157a84253e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:30.331962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750b71-896d-43a0-9815-c157a84253e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:30.332240 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750b71-896d-43a0-9815-c157a84253e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:30.341524 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1750b71-896d-43a0-9815-c157a84253e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:30.342984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1750b71-896d-43a0-9815-c157a84253e5 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:30.352454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1342/2686] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:01:30.631167 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6b8b5-43b3-414e-94d2-7abe0f5829a0 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:30.632672 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ccc6b8b5-43b3-414e-94d2-7abe0f5829a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:30.645433 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6b8b5-43b3-414e-94d2-7abe0f5829a0 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:30.650039 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918384d3-e444-4094-a0b2-194868bb798a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:30.650728 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918384d3-e444-4094-a0b2-194868bb798a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:30.651007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918384d3-e444-4094-a0b2-194868bb798a admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:30.651333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918384d3-e444-4094-a0b2-194868bb798a admin admin] PATH_INFO: `/v3/projects/8052b197bee545979e1a63a1143ebd74` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:30.652618 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918384d3-e444-4094-a0b2-194868bb798a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8052b197bee545979e1a63a1143ebd74)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:30.654565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918384d3-e444-4094-a0b2-194868bb798a admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:30.708663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-918384d3-e444-4094-a0b2-194868bb798a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8052b197bee545979e1a63a1143ebd74', 'request_id': 'req-918384d3-e444-4094-a0b2-194868bb798a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:30.715121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-918384d3-e444-4094-a0b2-194868bb798a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8052b197bee545979e1a63a1143ebd74', 'request_id': 'req-918384d3-e444-4094-a0b2-194868bb798a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:30.720775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-918384d3-e444-4094-a0b2-194868bb798a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8052b197bee545979e1a63a1143ebd74', 'request_id': 'req-918384d3-e444-4094-a0b2-194868bb798a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:30.733410 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-918384d3-e444-4094-a0b2-194868bb798a admin admin] The token cache is being invalidate because project 8052b197bee545979e1a63a1143ebd74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:01:30.733704 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-918384d3-e444-4094-a0b2-194868bb798a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:30.734374 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-918384d3-e444-4094-a0b2-194868bb798a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:30.735896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1345/2687] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:01:30 2022] DELETE /identity/v3/projects/8052b197bee545979e1a63a1143ebd74 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:30.740917 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81c3f7-3e03-42f8-8da4-8a7c3e42625c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:30.741447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81c3f7-3e03-42f8-8da4-8a7c3e42625c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:30.741447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81c3f7-3e03-42f8-8da4-8a7c3e42625c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:30.763512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-be81c3f7-3e03-42f8-8da4-8a7c3e42625c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:30.764725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-be81c3f7-3e03-42f8-8da4-8a7c3e42625c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:30.798327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:30.828091 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1343/2688] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:30.835776 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36e228-b41e-4951-a196-9cdf8beeb8a0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:30.836066 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36e228-b41e-4951-a196-9cdf8beeb8a0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:30.836345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36e228-b41e-4951-a196-9cdf8beeb8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:30.856379 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-dd36e228-b41e-4951-a196-9cdf8beeb8a0 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:30.857596 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-dd36e228-b41e-4951-a196-9cdf8beeb8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:30.865685 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1346/2689] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:30.870110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81c3f7-3e03-42f8-8da4-8a7c3e42625c None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:30.880786 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81c3f7-3e03-42f8-8da4-8a7c3e42625c None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:30.885440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae30ec2-0761-4a96-9f0e-9ae043ff738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:30.886691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae30ec2-0761-4a96-9f0e-9ae043ff738a admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:30.886984 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae30ec2-0761-4a96-9f0e-9ae043ff738a admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:30.887268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae30ec2-0761-4a96-9f0e-9ae043ff738a admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:30.887975 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae30ec2-0761-4a96-9f0e-9ae043ff738a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 11:01:30.888292 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae30ec2-0761-4a96-9f0e-9ae043ff738a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:30.889918 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae30ec2-0761-4a96-9f0e-9ae043ff738a admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:30.902612 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1344/2690] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 11:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 11:01:30.907133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36e228-b41e-4951-a196-9cdf8beeb8a0 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:30.916690 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36e228-b41e-4951-a196-9cdf8beeb8a0 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:30.922332 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbb14-103b-4031-b6bb-96c2efb57677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:30.922955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbb14-103b-4031-b6bb-96c2efb57677 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:30.923238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbb14-103b-4031-b6bb-96c2efb57677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:30.923508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fbb14-103b-4031-b6bb-96c2efb57677 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:30.924197 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fbb14-103b-4031-b6bb-96c2efb57677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:30.926070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fbb14-103b-4031-b6bb-96c2efb57677 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:30.954477 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1347/2691] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:01:30 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:30.958845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae30ec2-0761-4a96-9f0e-9ae043ff738a admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:30.969134 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae30ec2-0761-4a96-9f0e-9ae043ff738a admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:31.025328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9f44b-3f62-4860-99bf-e60db60f5116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:31.025950 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9f44b-3f62-4860-99bf-e60db60f5116 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:31.026273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9f44b-3f62-4860-99bf-e60db60f5116 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:31.026576 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9f44b-3f62-4860-99bf-e60db60f5116 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:31.027461 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9f44b-3f62-4860-99bf-e60db60f5116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:31.029385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9f44b-3f62-4860-99bf-e60db60f5116 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:31.052055 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1345/2692] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:01:30 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:31.056151 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbb14-103b-4031-b6bb-96c2efb57677 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:31.067308 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fbb14-103b-4031-b6bb-96c2efb57677 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:31.071979 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92fa3b-9e52-4771-aa86-3bb07f0daeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:31.072628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92fa3b-9e52-4771-aa86-3bb07f0daeda admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:31.072923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92fa3b-9e52-4771-aa86-3bb07f0daeda admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:31.073188 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92fa3b-9e52-4771-aa86-3bb07f0daeda admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:31.073927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92fa3b-9e52-4771-aa86-3bb07f0daeda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:31.075583 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92fa3b-9e52-4771-aa86-3bb07f0daeda admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:31.086097 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1348/2693] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:01:31.090294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9f44b-3f62-4860-99bf-e60db60f5116 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:31.100646 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9f44b-3f62-4860-99bf-e60db60f5116 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:31.105820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ed069-9d39-47b9-b8a1-58f0e9593618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:31.106480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ed069-9d39-47b9-b8a1-58f0e9593618 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:31.106766 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ed069-9d39-47b9-b8a1-58f0e9593618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:31.107044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ed069-9d39-47b9-b8a1-58f0e9593618 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:31.107752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ed069-9d39-47b9-b8a1-58f0e9593618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:31.109354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ed069-9d39-47b9-b8a1-58f0e9593618 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:31.120955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1346/2694] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 11:01:31.125162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92fa3b-9e52-4771-aa86-3bb07f0daeda admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:31.135192 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92fa3b-9e52-4771-aa86-3bb07f0daeda admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:31.139889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1089d8-b158-49cb-98ef-cd9ab2a9bfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:31.140560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1089d8-b158-49cb-98ef-cd9ab2a9bfe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:31.140845 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1089d8-b158-49cb-98ef-cd9ab2a9bfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:31.141123 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1089d8-b158-49cb-98ef-cd9ab2a9bfe7 admin admin] PATH_INFO: `/v3/projects/8fae47f18f824f35b549a9a76627dae8/users/b627c8121c3a478485a4ab73741cbba8/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:31.156109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1089d8-b158-49cb-98ef-cd9ab2a9bfe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fae47f18f824f35b549a9a76627dae8, user_id=b627c8121c3a478485a4ab73741cbba8, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:31.158806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1089d8-b158-49cb-98ef-cd9ab2a9bfe7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:31.173130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1349/2695] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:01:31 2022] PUT /identity/v3/projects/8fae47f18f824f35b549a9a76627dae8/users/b627c8121c3a478485a4ab73741cbba8/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:31.184043 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf764382-84d6-4f3a-b2c5-c85230920ecd None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:31.184332 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf764382-84d6-4f3a-b2c5-c85230920ecd None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:31.184613 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf764382-84d6-4f3a-b2c5-c85230920ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:31.212327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-cf764382-84d6-4f3a-b2c5-c85230920ecd None None] MFA Rules not processed for user `b627c8121c3a478485a4ab73741cbba8`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:31.213468 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-cf764382-84d6-4f3a-b2c5-c85230920ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:31.278358 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1347/2696] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:31.289717 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1089d8-b158-49cb-98ef-cd9ab2a9bfe7 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:31.291470 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-bb1089d8-b158-49cb-98ef-cd9ab2a9bfe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:31.326641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:31.374396 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1089d8-b158-49cb-98ef-cd9ab2a9bfe7 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:31.378017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8082c-4aec-4047-8d6c-47a192524666 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4e81eb81934784b8632248ecf0894f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:31.378678 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8082c-4aec-4047-8d6c-47a192524666 service glance] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:31.378965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8082c-4aec-4047-8d6c-47a192524666 service glance] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:31.379243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8082c-4aec-4047-8d6c-47a192524666 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:31.387983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8082c-4aec-4047-8d6c-47a192524666 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:31.389420 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8082c-4aec-4047-8d6c-47a192524666 service glance] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:31.398506 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1350/2697] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:01:32.372685 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf764382-84d6-4f3a-b2c5-c85230920ecd None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:32.374247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-cf764382-84d6-4f3a-b2c5-c85230920ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:32.457956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:32.517850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf764382-84d6-4f3a-b2c5-c85230920ecd None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:32.525903 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0e20e-858a-4256-b9a6-18eb8bff4570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:32.527324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0e20e-858a-4256-b9a6-18eb8bff4570 service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:32.527738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0e20e-858a-4256-b9a6-18eb8bff4570 service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:32.528117 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0e20e-858a-4256-b9a6-18eb8bff4570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:32.531200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-fce0e20e-858a-4256-b9a6-18eb8bff4570 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:32.550179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0e20e-858a-4256-b9a6-18eb8bff4570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:32.552143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0e20e-858a-4256-b9a6-18eb8bff4570 service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:32.566749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1348/2698] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:01:41.009705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e0f81-3108-4c4e-9dcf-080b117aa873 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:41.010212 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e0f81-3108-4c4e-9dcf-080b117aa873 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:41.010310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e0f81-3108-4c4e-9dcf-080b117aa873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:41.064416 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-827e0f81-3108-4c4e-9dcf-080b117aa873 None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:41.065640 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-827e0f81-3108-4c4e-9dcf-080b117aa873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:41.131935 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1351/2699] 10.222.0.43 () {58 vars in 967 bytes} [Wed Jul 27 11:01:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:41.181321 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0e20e-858a-4256-b9a6-18eb8bff4570 service nova] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:41.183268 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-fce0e20e-858a-4256-b9a6-18eb8bff4570 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:41.280107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0e20e-858a-4256-b9a6-18eb8bff4570 service nova] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:41.285182 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15b5d5-0941-4fb2-94f6-a053caf705fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:41.285812 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15b5d5-0941-4fb2-94f6-a053caf705fc service swift] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:41.286093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15b5d5-0941-4fb2-94f6-a053caf705fc service swift] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:41.286399 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15b5d5-0941-4fb2-94f6-a053caf705fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:41.296051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15b5d5-0941-4fb2-94f6-a053caf705fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:41.297675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15b5d5-0941-4fb2-94f6-a053caf705fc service swift] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:41.305987 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1349/2700] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 11:01:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 11:01:48.181385 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e0f81-3108-4c4e-9dcf-080b117aa873 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:48.183083 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-827e0f81-3108-4c4e-9dcf-080b117aa873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:48.258647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e0f81-3108-4c4e-9dcf-080b117aa873 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:48.263882 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b8c39-ef0b-4c4f-9a64-a2b0372f5699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:48.264529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b8c39-ef0b-4c4f-9a64-a2b0372f5699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:48.264814 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b8c39-ef0b-4c4f-9a64-a2b0372f5699 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:48.265093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b8c39-ef0b-4c4f-9a64-a2b0372f5699 admin admin] PATH_INFO: `/v3/users/93777aec68ca4a5cab4aa88ab6371809` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:48.266361 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b8c39-ef0b-4c4f-9a64-a2b0372f5699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93777aec68ca4a5cab4aa88ab6371809)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:48.268274 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b8c39-ef0b-4c4f-9a64-a2b0372f5699 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:48.298579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:48.318013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-226b8c39-ef0b-4c4f-9a64-a2b0372f5699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93777aec68ca4a5cab4aa88ab6371809'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.318706 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-226b8c39-ef0b-4c4f-9a64-a2b0372f5699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93777aec68ca4a5cab4aa88ab6371809'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.326544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-226b8c39-ef0b-4c4f-9a64-a2b0372f5699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93777aec68ca4a5cab4aa88ab6371809'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.333704 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-226b8c39-ef0b-4c4f-9a64-a2b0372f5699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93777aec68ca4a5cab4aa88ab6371809'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.334405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-226b8c39-ef0b-4c4f-9a64-a2b0372f5699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93777aec68ca4a5cab4aa88ab6371809'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.351510 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1352/2701] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:01:48 2022] DELETE /identity/v3/users/93777aec68ca4a5cab4aa88ab6371809 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:48.531246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15b5d5-0941-4fb2-94f6-a053caf705fc service swift] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:48.541693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15b5d5-0941-4fb2-94f6-a053caf705fc service swift] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:48.605638 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:48.606337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:48.606621 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:48.606899 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] PATH_INFO: `/v3/projects/62d9c291cb4d455392549453dfca3c3d` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:48.608058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d9c291cb4d455392549453dfca3c3d)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:48.609994 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:48.644003 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:48.657675 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d9c291cb4d455392549453dfca3c3d', 'request_id': 'req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.663842 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d9c291cb4d455392549453dfca3c3d', 'request_id': 'req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.671037 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d9c291cb4d455392549453dfca3c3d', 'request_id': 'req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.681529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] The token cache is being invalidate because project 62d9c291cb4d455392549453dfca3c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:01:48.681823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.682492 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.684198 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1350/2702] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:01:48 2022] DELETE /identity/v3/projects/62d9c291cb4d455392549453dfca3c3d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:48.688260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b8c39-ef0b-4c4f-9a64-a2b0372f5699 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:48.689784 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-226b8c39-ef0b-4c4f-9a64-a2b0372f5699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:48.703896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b8c39-ef0b-4c4f-9a64-a2b0372f5699 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:48.764787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2bc84-a552-4fd0-bf5f-2e1dd9c74969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:48.765440 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2bc84-a552-4fd0-bf5f-2e1dd9c74969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:48.765742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2bc84-a552-4fd0-bf5f-2e1dd9c74969 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:48.765999 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2bc84-a552-4fd0-bf5f-2e1dd9c74969 admin admin] PATH_INFO: `/v3/users/e0ca7ed706fb4bc29054f321a6230438` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:48.767216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2bc84-a552-4fd0-bf5f-2e1dd9c74969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ca7ed706fb4bc29054f321a6230438)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:48.769123 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2bc84-a552-4fd0-bf5f-2e1dd9c74969 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:48.817272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-dfd2bc84-a552-4fd0-bf5f-2e1dd9c74969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ca7ed706fb4bc29054f321a6230438'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.817966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-dfd2bc84-a552-4fd0-bf5f-2e1dd9c74969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ca7ed706fb4bc29054f321a6230438'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.826530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-dfd2bc84-a552-4fd0-bf5f-2e1dd9c74969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ca7ed706fb4bc29054f321a6230438'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.834359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-dfd2bc84-a552-4fd0-bf5f-2e1dd9c74969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ca7ed706fb4bc29054f321a6230438'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.835135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-dfd2bc84-a552-4fd0-bf5f-2e1dd9c74969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ca7ed706fb4bc29054f321a6230438'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:48.853450 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1353/2703] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:01:48 2022] DELETE /identity/v3/users/e0ca7ed706fb4bc29054f321a6230438 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:49.030706 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:49.032118 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:49.045599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d0f15-fa4e-457b-9e86-c48a6073e03c admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:49.104384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c095d5-7c27-4f0f-ab6e-42970b082ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:49.105118 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c095d5-7c27-4f0f-ab6e-42970b082ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:49.105384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c095d5-7c27-4f0f-ab6e-42970b082ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:49.105754 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c095d5-7c27-4f0f-ab6e-42970b082ba2 admin admin] PATH_INFO: `/v3/projects/4e7c9e073cce4b41afb857c1634cf932` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:49.106985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c095d5-7c27-4f0f-ab6e-42970b082ba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7c9e073cce4b41afb857c1634cf932)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:49.108934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c095d5-7c27-4f0f-ab6e-42970b082ba2 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:49.155740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-75c095d5-7c27-4f0f-ab6e-42970b082ba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7c9e073cce4b41afb857c1634cf932', 'request_id': 'req-75c095d5-7c27-4f0f-ab6e-42970b082ba2'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:49.162973 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-75c095d5-7c27-4f0f-ab6e-42970b082ba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7c9e073cce4b41afb857c1634cf932', 'request_id': 'req-75c095d5-7c27-4f0f-ab6e-42970b082ba2'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:49.171246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-75c095d5-7c27-4f0f-ab6e-42970b082ba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7c9e073cce4b41afb857c1634cf932', 'request_id': 'req-75c095d5-7c27-4f0f-ab6e-42970b082ba2'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:49.182838 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-75c095d5-7c27-4f0f-ab6e-42970b082ba2 admin admin] The token cache is being invalidate because project 4e7c9e073cce4b41afb857c1634cf932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:01:49.183643 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-75c095d5-7c27-4f0f-ab6e-42970b082ba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:49.184291 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-75c095d5-7c27-4f0f-ab6e-42970b082ba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:49.185810 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1351/2704] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:01:49 2022] DELETE /identity/v3/projects/4e7c9e073cce4b41afb857c1634cf932 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:52.310711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2bc84-a552-4fd0-bf5f-2e1dd9c74969 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:52.312203 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-dfd2bc84-a552-4fd0-bf5f-2e1dd9c74969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:52.325541 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2bc84-a552-4fd0-bf5f-2e1dd9c74969 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:52.345357 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:52.385802 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054a0c4-aaf6-4a94-95cc-8671e22c5bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:52.386550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054a0c4-aaf6-4a94-95cc-8671e22c5bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:52.386828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054a0c4-aaf6-4a94-95cc-8671e22c5bea admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:52.387102 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054a0c4-aaf6-4a94-95cc-8671e22c5bea admin admin] PATH_INFO: `/v3/users/b627c8121c3a478485a4ab73741cbba8` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:52.388286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054a0c4-aaf6-4a94-95cc-8671e22c5bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b627c8121c3a478485a4ab73741cbba8)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:52.390174 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054a0c4-aaf6-4a94-95cc-8671e22c5bea admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:52.435877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6054a0c4-aaf6-4a94-95cc-8671e22c5bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b627c8121c3a478485a4ab73741cbba8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:52.436516 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6054a0c4-aaf6-4a94-95cc-8671e22c5bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b627c8121c3a478485a4ab73741cbba8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:52.443937 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6054a0c4-aaf6-4a94-95cc-8671e22c5bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b627c8121c3a478485a4ab73741cbba8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:52.450965 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6054a0c4-aaf6-4a94-95cc-8671e22c5bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b627c8121c3a478485a4ab73741cbba8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:52.451603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-6054a0c4-aaf6-4a94-95cc-8671e22c5bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b627c8121c3a478485a4ab73741cbba8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:52.468654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1354/2705] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:01:52 2022] DELETE /identity/v3/users/b627c8121c3a478485a4ab73741cbba8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:52.473143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad6a6d-5bc3-4713-b030-0759efee90a3 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:52.473636 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad6a6d-5bc3-4713-b030-0759efee90a3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:52.473738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad6a6d-5bc3-4713-b030-0759efee90a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:52.493101 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-52ad6a6d-5bc3-4713-b030-0759efee90a3 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:52.494348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-52ad6a6d-5bc3-4713-b030-0759efee90a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:52.538676 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:52.556446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1352/2706] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:52.566984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054a0c4-aaf6-4a94-95cc-8671e22c5bea admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:52.568377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-6054a0c4-aaf6-4a94-95cc-8671e22c5bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:52.627633 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054a0c4-aaf6-4a94-95cc-8671e22c5bea admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:52.631330 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cb5d8-7c69-4fe8-932c-2806f0b43d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:52.631949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cb5d8-7c69-4fe8-932c-2806f0b43d2a service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:52.632234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cb5d8-7c69-4fe8-932c-2806f0b43d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:52.632511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cb5d8-7c69-4fe8-932c-2806f0b43d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:52.641913 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cb5d8-7c69-4fe8-932c-2806f0b43d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:52.643316 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cb5d8-7c69-4fe8-932c-2806f0b43d2a service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:52.653412 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1355/2707] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:01:52.935835 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad6a6d-5bc3-4713-b030-0759efee90a3 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:52.937404 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-52ad6a6d-5bc3-4713-b030-0759efee90a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:52.950476 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad6a6d-5bc3-4713-b030-0759efee90a3 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:52.955506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e06e84-d326-451e-820e-e4b4a94a9460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:52.956172 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e06e84-d326-451e-820e-e4b4a94a9460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:52.956441 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e06e84-d326-451e-820e-e4b4a94a9460 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:52.956712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e06e84-d326-451e-820e-e4b4a94a9460 admin admin] PATH_INFO: `/v3/projects/8fae47f18f824f35b549a9a76627dae8` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:52.958800 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e06e84-d326-451e-820e-e4b4a94a9460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fae47f18f824f35b549a9a76627dae8)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:52.960846 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e06e84-d326-451e-820e-e4b4a94a9460 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:53.008983 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-72e06e84-d326-451e-820e-e4b4a94a9460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fae47f18f824f35b549a9a76627dae8', 'request_id': 'req-72e06e84-d326-451e-820e-e4b4a94a9460'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:53.015399 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-72e06e84-d326-451e-820e-e4b4a94a9460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fae47f18f824f35b549a9a76627dae8', 'request_id': 'req-72e06e84-d326-451e-820e-e4b4a94a9460'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:53.022317 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-72e06e84-d326-451e-820e-e4b4a94a9460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fae47f18f824f35b549a9a76627dae8', 'request_id': 'req-72e06e84-d326-451e-820e-e4b4a94a9460'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:53.033454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-72e06e84-d326-451e-820e-e4b4a94a9460 admin admin] The token cache is being invalidate because project 8fae47f18f824f35b549a9a76627dae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:01:53.033749 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-72e06e84-d326-451e-820e-e4b4a94a9460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:53.034418 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-72e06e84-d326-451e-820e-e4b4a94a9460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:01:53.035937 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1353/2708] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:01:52 2022] DELETE /identity/v3/projects/8fae47f18f824f35b549a9a76627dae8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:53.040926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5abd3-937d-40d0-bb73-a007dd964577 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:53.041216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5abd3-937d-40d0-bb73-a007dd964577 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:53.041513 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5abd3-937d-40d0-bb73-a007dd964577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:53.061476 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-7fe5abd3-937d-40d0-bb73-a007dd964577 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:53.062721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-7fe5abd3-937d-40d0-bb73-a007dd964577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:53.108314 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:01:53.127525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1356/2709] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:53.135254 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894baddc-38b6-4630-9d08-7a874c5b617b None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:53.135538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894baddc-38b6-4630-9d08-7a874c5b617b None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:53.135811 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894baddc-38b6-4630-9d08-7a874c5b617b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:53.156752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-894baddc-38b6-4630-9d08-7a874c5b617b None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:53.157933 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-894baddc-38b6-4630-9d08-7a874c5b617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:53.166326 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1354/2710] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:53.170998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5abd3-937d-40d0-bb73-a007dd964577 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:53.180753 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5abd3-937d-40d0-bb73-a007dd964577 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:53.185730 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464fc8e-62da-4d40-acf9-dda76c7ab945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:53.186377 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464fc8e-62da-4d40-acf9-dda76c7ab945 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:53.186659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464fc8e-62da-4d40-acf9-dda76c7ab945 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:53.186933 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464fc8e-62da-4d40-acf9-dda76c7ab945 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:53.187682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464fc8e-62da-4d40-acf9-dda76c7ab945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 11:01:53.187987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464fc8e-62da-4d40-acf9-dda76c7ab945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:53.189567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464fc8e-62da-4d40-acf9-dda76c7ab945 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:53.201546 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1357/2711] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 11:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 11:01:53.206167 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894baddc-38b6-4630-9d08-7a874c5b617b None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:53.216271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894baddc-38b6-4630-9d08-7a874c5b617b None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:53.221077 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08e6cd-5257-4ae7-a83b-b6b205242522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:53.221690 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08e6cd-5257-4ae7-a83b-b6b205242522 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:53.221976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08e6cd-5257-4ae7-a83b-b6b205242522 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:53.222294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08e6cd-5257-4ae7-a83b-b6b205242522 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:53.222997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08e6cd-5257-4ae7-a83b-b6b205242522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:53.224898 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08e6cd-5257-4ae7-a83b-b6b205242522 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:53.252401 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1355/2712] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:01:53 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:53.256912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464fc8e-62da-4d40-acf9-dda76c7ab945 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:53.267590 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464fc8e-62da-4d40-acf9-dda76c7ab945 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:53.325558 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe3b35-9c55-4f4b-bf9e-515a8901371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:53.326290 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe3b35-9c55-4f4b-bf9e-515a8901371c admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:53.326529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe3b35-9c55-4f4b-bf9e-515a8901371c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:53.327017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe3b35-9c55-4f4b-bf9e-515a8901371c admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:53.327717 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe3b35-9c55-4f4b-bf9e-515a8901371c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:53.329648 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe3b35-9c55-4f4b-bf9e-515a8901371c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:53.350526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1358/2713] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:01:53 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:01:53.355400 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08e6cd-5257-4ae7-a83b-b6b205242522 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:53.365986 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08e6cd-5257-4ae7-a83b-b6b205242522 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:53.371206 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d3e7f-9455-41a9-bcc5-97a593726442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:53.371809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d3e7f-9455-41a9-bcc5-97a593726442 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:53.372086 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d3e7f-9455-41a9-bcc5-97a593726442 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:53.372353 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d3e7f-9455-41a9-bcc5-97a593726442 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:53.373047 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d3e7f-9455-41a9-bcc5-97a593726442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:53.374663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d3e7f-9455-41a9-bcc5-97a593726442 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:53.384613 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1356/2714] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:01:53.388763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe3b35-9c55-4f4b-bf9e-515a8901371c admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:53.398764 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe3b35-9c55-4f4b-bf9e-515a8901371c admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:53.404029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f13718-d7df-42df-8588-604d7d70a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:53.404636 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13718-d7df-42df-8588-604d7d70a966 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:53.404922 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13718-d7df-42df-8588-604d7d70a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:53.405198 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13718-d7df-42df-8588-604d7d70a966 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:53.405930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f13718-d7df-42df-8588-604d7d70a966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:53.407551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f13718-d7df-42df-8588-604d7d70a966 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:53.418808 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1359/2715] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:01:53.423201 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d3e7f-9455-41a9-bcc5-97a593726442 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:53.433397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d3e7f-9455-41a9-bcc5-97a593726442 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:53.437925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea2a9-b0eb-4c92-82bb-0fe73dc5fa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:53.438619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea2a9-b0eb-4c92-82bb-0fe73dc5fa42 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:53.438903 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea2a9-b0eb-4c92-82bb-0fe73dc5fa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:53.439178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea2a9-b0eb-4c92-82bb-0fe73dc5fa42 admin admin] PATH_INFO: `/v3/projects/4319d0a04bc14cf5b978c502bf782da2/users/b0d73cd1c4564fc58ce6507a851da6ef/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:53.457626 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fea2a9-b0eb-4c92-82bb-0fe73dc5fa42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4319d0a04bc14cf5b978c502bf782da2, user_id=b0d73cd1c4564fc58ce6507a851da6ef, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:53.460287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fea2a9-b0eb-4c92-82bb-0fe73dc5fa42 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:53.474567 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1357/2716] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:01:53 2022] PUT /identity/v3/projects/4319d0a04bc14cf5b978c502bf782da2/users/b0d73cd1c4564fc58ce6507a851da6ef/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:01:53.485268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5afb0f-0b89-4919-bd23-4007e31370aa None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:53.485551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5afb0f-0b89-4919-bd23-4007e31370aa None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:53.485821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5afb0f-0b89-4919-bd23-4007e31370aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:53.514278 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-bf5afb0f-0b89-4919-bd23-4007e31370aa None None] MFA Rules not processed for user `b0d73cd1c4564fc58ce6507a851da6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:01:53.515508 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-bf5afb0f-0b89-4919-bd23-4007e31370aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:53.580298 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1360/2717] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:01:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:01:53.591787 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea2a9-b0eb-4c92-82bb-0fe73dc5fa42 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:01:53.593479 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-57fea2a9-b0eb-4c92-82bb-0fe73dc5fa42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:01:53.649932 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea2a9-b0eb-4c92-82bb-0fe73dc5fa42 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:01:53.654402 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff1978-c59d-4a88-9f9c-57304ee4d9e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:01:53.655026 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff1978-c59d-4a88-9f9c-57304ee4d9e4 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:01:53.655309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff1978-c59d-4a88-9f9c-57304ee4d9e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:01:53.655586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff1978-c59d-4a88-9f9c-57304ee4d9e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:01:53.664060 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff1978-c59d-4a88-9f9c-57304ee4d9e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:01:53.665487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff1978-c59d-4a88-9f9c-57304ee4d9e4 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:01:53.675313 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1358/2718] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:01:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:02:03.577312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:02:03.671310 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:02:03.711079 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5afb0f-0b89-4919-bd23-4007e31370aa None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:02:03.774863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5afb0f-0b89-4919-bd23-4007e31370aa None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:02:03.779732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748385c-3506-4c8b-95bc-7496fc41f75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:02:03.780411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748385c-3506-4c8b-95bc-7496fc41f75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:02:03.780689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748385c-3506-4c8b-95bc-7496fc41f75f admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:02:03.780963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748385c-3506-4c8b-95bc-7496fc41f75f admin admin] PATH_INFO: `/v3/users/b0d73cd1c4564fc58ce6507a851da6ef` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:02:03.782121 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748385c-3506-4c8b-95bc-7496fc41f75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d73cd1c4564fc58ce6507a851da6ef)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:02:03.784046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748385c-3506-4c8b-95bc-7496fc41f75f admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:02:03.830427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c748385c-3506-4c8b-95bc-7496fc41f75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d73cd1c4564fc58ce6507a851da6ef'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:02:03.831087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c748385c-3506-4c8b-95bc-7496fc41f75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d73cd1c4564fc58ce6507a851da6ef'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:02:03.838028 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c748385c-3506-4c8b-95bc-7496fc41f75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d73cd1c4564fc58ce6507a851da6ef'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:02:03.845130 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c748385c-3506-4c8b-95bc-7496fc41f75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d73cd1c4564fc58ce6507a851da6ef'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:02:03.845773 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-c748385c-3506-4c8b-95bc-7496fc41f75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d73cd1c4564fc58ce6507a851da6ef'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:02:03.863109 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1361/2719] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:02:03 2022] DELETE /identity/v3/users/b0d73cd1c4564fc58ce6507a851da6ef => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:02:03.867782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b1121-c568-45d5-ba4e-243ec3ccc917 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:02:03.868073 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b1121-c568-45d5-ba4e-243ec3ccc917 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:02:03.868352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b1121-c568-45d5-ba4e-243ec3ccc917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:02:03.889287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-0f0b1121-c568-45d5-ba4e-243ec3ccc917 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:02:03.890549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0f0b1121-c568-45d5-ba4e-243ec3ccc917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:02:03.951267 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1359/2720] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 11:02:03.960906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748385c-3506-4c8b-95bc-7496fc41f75f admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:02:03.962416 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-c748385c-3506-4c8b-95bc-7496fc41f75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:02:04.021103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748385c-3506-4c8b-95bc-7496fc41f75f admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:02:04.024875 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16815df1-ac46-431d-9beb-46b610de1116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:02:04.025502 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16815df1-ac46-431d-9beb-46b610de1116 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:02:04.025786 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16815df1-ac46-431d-9beb-46b610de1116 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:02:04.027013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16815df1-ac46-431d-9beb-46b610de1116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:02:04.036464 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16815df1-ac46-431d-9beb-46b610de1116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:02:04.037889 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16815df1-ac46-431d-9beb-46b610de1116 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:02:04.048878 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1362/2721] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:02:04.326633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b1121-c568-45d5-ba4e-243ec3ccc917 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:02:04.328136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0f0b1121-c568-45d5-ba4e-243ec3ccc917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:02:04.340866 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b1121-c568-45d5-ba4e-243ec3ccc917 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:02:04.345486 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:02:04.346136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:02:04.346453 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:02:04.346732 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] PATH_INFO: `/v3/projects/4319d0a04bc14cf5b978c502bf782da2` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:02:04.347915 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4319d0a04bc14cf5b978c502bf782da2)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:02:04.349857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:02:04.398220 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4319d0a04bc14cf5b978c502bf782da2', 'request_id': 'req-f29d00a7-40bf-4536-987f-1ebdf3bef49f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:02:04.405472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4319d0a04bc14cf5b978c502bf782da2', 'request_id': 'req-f29d00a7-40bf-4536-987f-1ebdf3bef49f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:02:04.414253 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4319d0a04bc14cf5b978c502bf782da2', 'request_id': 'req-f29d00a7-40bf-4536-987f-1ebdf3bef49f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:02:04.425908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] The token cache is being invalidate because project 4319d0a04bc14cf5b978c502bf782da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:02:04.426214 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:02:04.426880 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:02:04.428469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1360/2722] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:02:04 2022] DELETE /identity/v3/projects/4319d0a04bc14cf5b978c502bf782da2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:02:14.043860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:02:14.422860 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:03:39.183745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16815df1-ac46-431d-9beb-46b610de1116 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:03:39.185305 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-16815df1-ac46-431d-9beb-46b610de1116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:03:39.256751 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16815df1-ac46-431d-9beb-46b610de1116 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:03:39.315810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613428a6-acd9-4fac-a120-47285bde52b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:03:39.316429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613428a6-acd9-4fac-a120-47285bde52b4 service placement] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:03:39.316711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613428a6-acd9-4fac-a120-47285bde52b4 service placement] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:03:39.316987 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613428a6-acd9-4fac-a120-47285bde52b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:03:39.318788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-613428a6-acd9-4fac-a120-47285bde52b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:03:39.330336 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613428a6-acd9-4fac-a120-47285bde52b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:03:39.331901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613428a6-acd9-4fac-a120-47285bde52b4 service placement] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:03:39.341648 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1363/2723] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:03:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:03:49.337477 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=58 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:05:33.848630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:05:33.850136 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:05:33.912398 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d00a7-40bf-4536-987f-1ebdf3bef49f admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:05:33.916339 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1142321-c05a-4c18-88bc-79fde41564e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:05:33.916971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1142321-c05a-4c18-88bc-79fde41564e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:05:33.917259 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1142321-c05a-4c18-88bc-79fde41564e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:05:33.917538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1142321-c05a-4c18-88bc-79fde41564e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:05:33.919385 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f1142321-c05a-4c18-88bc-79fde41564e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:05:33.998021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1142321-c05a-4c18-88bc-79fde41564e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:05:33.999496 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1142321-c05a-4c18-88bc-79fde41564e8 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:05:34.011627 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1361/2724] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:05:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:05:35.199267 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613428a6-acd9-4fac-a120-47285bde52b4 service placement] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:05:35.209743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613428a6-acd9-4fac-a120-47285bde52b4 service placement] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:05:35.213653 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f32f7-6222-4e81-b8fc-02ed7ecb3c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:05:35.214392 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f32f7-6222-4e81-b8fc-02ed7ecb3c50 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:05:35.214735 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f32f7-6222-4e81-b8fc-02ed7ecb3c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:05:35.215063 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f32f7-6222-4e81-b8fc-02ed7ecb3c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:05:35.217040 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0b3f32f7-6222-4e81-b8fc-02ed7ecb3c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:05:35.232497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f32f7-6222-4e81-b8fc-02ed7ecb3c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:05:35.233943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f32f7-6222-4e81-b8fc-02ed7ecb3c50 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:05:35.246399 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1364/2725] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:05:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:05:40.780594 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd314-72dd-4f88-af8c-a9f12b2f9230 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:05:40.781131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd314-72dd-4f88-af8c-a9f12b2f9230 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:05:40.781131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd314-72dd-4f88-af8c-a9f12b2f9230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:05:40.800906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-223cd314-72dd-4f88-af8c-a9f12b2f9230 None None] MFA Rules not processed for user `d064436405f449b8b6f4dd78e3792991`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:05:40.802129 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-223cd314-72dd-4f88-af8c-a9f12b2f9230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:05:40.861790 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1362/2726] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:05:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:05:41.183605 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f32f7-6222-4e81-b8fc-02ed7ecb3c50 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:05:41.193333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f32f7-6222-4e81-b8fc-02ed7ecb3c50 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:05:41.197029 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5aaa-cfe6-4590-b951-a12a128598fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:05:41.197641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5aaa-cfe6-4590-b951-a12a128598fd service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:05:41.197931 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5aaa-cfe6-4590-b951-a12a128598fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:05:41.198240 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea5aaa-cfe6-4590-b951-a12a128598fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:05:41.201194 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-87ea5aaa-cfe6-4590-b951-a12a128598fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:05:41.215546 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea5aaa-cfe6-4590-b951-a12a128598fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:05:41.217015 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea5aaa-cfe6-4590-b951-a12a128598fd service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:05:41.226285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1365/2727] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:05:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:05:41.570169 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cd314-72dd-4f88-af8c-a9f12b2f9230 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:05:41.571658 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-223cd314-72dd-4f88-af8c-a9f12b2f9230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:05:41.587608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cd314-72dd-4f88-af8c-a9f12b2f9230 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:05:41.596581 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e7543-b741-4b6b-a098-c5275223ba8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:05:41.597224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e7543-b741-4b6b-a098-c5275223ba8e service placement] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:05:41.597506 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e7543-b741-4b6b-a098-c5275223ba8e service placement] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:05:41.597779 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e7543-b741-4b6b-a098-c5275223ba8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:05:41.599772 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-096e7543-b741-4b6b-a098-c5275223ba8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:05:41.614027 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e7543-b741-4b6b-a098-c5275223ba8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:05:41.615859 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e7543-b741-4b6b-a098-c5275223ba8e service placement] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:05:41.627029 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1363/2728] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:05:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:05:43.927524 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5aaa-cfe6-4590-b951-a12a128598fd service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:05:43.929390 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-87ea5aaa-cfe6-4590-b951-a12a128598fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:05:43.943730 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea5aaa-cfe6-4590-b951-a12a128598fd service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:05:43.947801 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cafae-36bf-41d6-adfe-48dcf46ccd4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:05:43.948533 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cafae-36bf-41d6-adfe-48dcf46ccd4e service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:05:43.948984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cafae-36bf-41d6-adfe-48dcf46ccd4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:05:43.949249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cafae-36bf-41d6-adfe-48dcf46ccd4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:05:43.951800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-e87cafae-36bf-41d6-adfe-48dcf46ccd4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:05:43.963947 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cafae-36bf-41d6-adfe-48dcf46ccd4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:05:43.965451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cafae-36bf-41d6-adfe-48dcf46ccd4e service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:05:43.978449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1366/2729] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:05:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:05:49.889769 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e7543-b741-4b6b-a098-c5275223ba8e service placement] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:05:49.892471 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-096e7543-b741-4b6b-a098-c5275223ba8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:05:49.911828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e7543-b741-4b6b-a098-c5275223ba8e service placement] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:05:49.916983 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47bc61-b712-4acc-b5fc-983ac142c47d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:05:49.917616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47bc61-b712-4acc-b5fc-983ac142c47d service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:05:49.917899 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47bc61-b712-4acc-b5fc-983ac142c47d service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:05:49.918171 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47bc61-b712-4acc-b5fc-983ac142c47d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:05:49.920000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-dd47bc61-b712-4acc-b5fc-983ac142c47d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:05:49.934328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47bc61-b712-4acc-b5fc-983ac142c47d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:05:49.937217 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47bc61-b712-4acc-b5fc-983ac142c47d service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:05:49.951588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1364/2730] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:05:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:05:53.973102 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=18 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:05:59.946956 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=91 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:07:23.257761 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cafae-36bf-41d6-adfe-48dcf46ccd4e service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:23.259297 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-e87cafae-36bf-41d6-adfe-48dcf46ccd4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:23.277347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cafae-36bf-41d6-adfe-48dcf46ccd4e service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:23.283634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67681351-99f5-481e-bdfa-9acfd713ee30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:23.284301 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67681351-99f5-481e-bdfa-9acfd713ee30 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:23.284527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67681351-99f5-481e-bdfa-9acfd713ee30 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:23.284800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67681351-99f5-481e-bdfa-9acfd713ee30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:23.286927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-67681351-99f5-481e-bdfa-9acfd713ee30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:23.299649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67681351-99f5-481e-bdfa-9acfd713ee30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:23.301231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67681351-99f5-481e-bdfa-9acfd713ee30 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:23.311745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1367/2731] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:07:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:07:33.306519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=6 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:07:39.965334 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47bc61-b712-4acc-b5fc-983ac142c47d service nova] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:40.025454 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47bc61-b712-4acc-b5fc-983ac142c47d service nova] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:40.032308 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ba756-84c0-4a80-bdab-c82327059730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:40.032957 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ba756-84c0-4a80-bdab-c82327059730 service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:40.033238 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ba756-84c0-4a80-bdab-c82327059730 service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:40.033516 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ba756-84c0-4a80-bdab-c82327059730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:40.035962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f71ba756-84c0-4a80-bdab-c82327059730 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:40.078369 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ba756-84c0-4a80-bdab-c82327059730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:40.079996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ba756-84c0-4a80-bdab-c82327059730 service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:40.094289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1365/2732] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:07:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:07:45.491643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67681351-99f5-481e-bdfa-9acfd713ee30 service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:45.521621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67681351-99f5-481e-bdfa-9acfd713ee30 service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:45.525178 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9646c-eb7b-44d6-b088-7c4aac66e03b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:45.525794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9646c-eb7b-44d6-b088-7c4aac66e03b service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:45.526077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9646c-eb7b-44d6-b088-7c4aac66e03b service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:45.526384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9646c-eb7b-44d6-b088-7c4aac66e03b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:45.528135 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3db9646c-eb7b-44d6-b088-7c4aac66e03b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:45.614742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9646c-eb7b-44d6-b088-7c4aac66e03b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:45.616230 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9646c-eb7b-44d6-b088-7c4aac66e03b service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:45.635236 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1368/2733] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:07:48.986997 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ba756-84c0-4a80-bdab-c82327059730 service nova] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:48.998495 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ba756-84c0-4a80-bdab-c82327059730 service nova] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:49.003867 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab9b74-3cc6-4919-97ad-5d4af409d249 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:49.004493 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9b74-3cc6-4919-97ad-5d4af409d249 service placement] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:49.004778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9b74-3cc6-4919-97ad-5d4af409d249 service placement] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:49.005054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab9b74-3cc6-4919-97ad-5d4af409d249 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:49.006863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-49ab9b74-3cc6-4919-97ad-5d4af409d249 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:49.019475 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab9b74-3cc6-4919-97ad-5d4af409d249 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:49.021072 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab9b74-3cc6-4919-97ad-5d4af409d249 service placement] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:49.032102 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1366/2734] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:07:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:07:49.052940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9646c-eb7b-44d6-b088-7c4aac66e03b service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:49.054634 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3db9646c-eb7b-44d6-b088-7c4aac66e03b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:49.073648 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9646c-eb7b-44d6-b088-7c4aac66e03b service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:49.080521 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8614925-cd91-453e-b2a4-9292a74d81c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:49.081233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8614925-cd91-453e-b2a4-9292a74d81c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:49.081530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8614925-cd91-453e-b2a4-9292a74d81c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:49.081826 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8614925-cd91-453e-b2a4-9292a74d81c4 admin admin] PATH_INFO: `/v3/users/d064436405f449b8b6f4dd78e3792991` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:49.083088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8614925-cd91-453e-b2a4-9292a74d81c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d064436405f449b8b6f4dd78e3792991)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:49.085170 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8614925-cd91-453e-b2a4-9292a74d81c4 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:49.134336 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-e8614925-cd91-453e-b2a4-9292a74d81c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd064436405f449b8b6f4dd78e3792991'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:49.135022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-e8614925-cd91-453e-b2a4-9292a74d81c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd064436405f449b8b6f4dd78e3792991'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:49.143768 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-e8614925-cd91-453e-b2a4-9292a74d81c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd064436405f449b8b6f4dd78e3792991'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:49.156837 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-e8614925-cd91-453e-b2a4-9292a74d81c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd064436405f449b8b6f4dd78e3792991'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:49.157931 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-e8614925-cd91-453e-b2a4-9292a74d81c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd064436405f449b8b6f4dd78e3792991'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:49.177115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1369/2735] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:07:49 2022] DELETE /identity/v3/users/d064436405f449b8b6f4dd78e3792991 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:07:49.355029 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab9b74-3cc6-4919-97ad-5d4af409d249 service placement] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:49.366752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab9b74-3cc6-4919-97ad-5d4af409d249 service placement] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:49.436641 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e40d23-28b1-4490-a3af-48ce77baccb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:49.437285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e40d23-28b1-4490-a3af-48ce77baccb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:49.437565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e40d23-28b1-4490-a3af-48ce77baccb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:49.437839 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e40d23-28b1-4490-a3af-48ce77baccb0 admin admin] PATH_INFO: `/v3/projects/89e8e08ecf5c410f8fef5e4b71d7920e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:49.439046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e40d23-28b1-4490-a3af-48ce77baccb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e8e08ecf5c410f8fef5e4b71d7920e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:49.440929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e40d23-28b1-4490-a3af-48ce77baccb0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:49.487734 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-09e40d23-28b1-4490-a3af-48ce77baccb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e8e08ecf5c410f8fef5e4b71d7920e', 'request_id': 'req-09e40d23-28b1-4490-a3af-48ce77baccb0'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:49.493735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-09e40d23-28b1-4490-a3af-48ce77baccb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e8e08ecf5c410f8fef5e4b71d7920e', 'request_id': 'req-09e40d23-28b1-4490-a3af-48ce77baccb0'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:49.501790 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-09e40d23-28b1-4490-a3af-48ce77baccb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e8e08ecf5c410f8fef5e4b71d7920e', 'request_id': 'req-09e40d23-28b1-4490-a3af-48ce77baccb0'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:49.512841 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-09e40d23-28b1-4490-a3af-48ce77baccb0 admin admin] The token cache is being invalidate because project 89e8e08ecf5c410f8fef5e4b71d7920e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:07:49.513137 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-09e40d23-28b1-4490-a3af-48ce77baccb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:49.513826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-09e40d23-28b1-4490-a3af-48ce77baccb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:49.515943 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1367/2736] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:07:49 2022] DELETE /identity/v3/projects/89e8e08ecf5c410f8fef5e4b71d7920e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:07:49.520954 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97401e-424c-4fe5-afd8-221122504d4c None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:49.521245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97401e-424c-4fe5-afd8-221122504d4c None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:49.521527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97401e-424c-4fe5-afd8-221122504d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:49.544985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:07:49.583899 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-4e97401e-424c-4fe5-afd8-221122504d4c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:07:49.585114 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-4e97401e-424c-4fe5-afd8-221122504d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:49.648545 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1370/2737] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:07:49.657231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f960cd0-01c9-41db-9517-be1d16e1a63c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:49.657515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f960cd0-01c9-41db-9517-be1d16e1a63c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:49.657795 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f960cd0-01c9-41db-9517-be1d16e1a63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:49.680661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-3f960cd0-01c9-41db-9517-be1d16e1a63c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:07:49.681868 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3f960cd0-01c9-41db-9517-be1d16e1a63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:49.690412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1368/2738] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:07:49.694625 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97401e-424c-4fe5-afd8-221122504d4c None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:49.704385 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97401e-424c-4fe5-afd8-221122504d4c None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:49.708998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f2fc2-96b5-4f4d-8c7b-09ab3ddaacaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:49.709606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f2fc2-96b5-4f4d-8c7b-09ab3ddaacaa admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:49.709886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f2fc2-96b5-4f4d-8c7b-09ab3ddaacaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:49.710166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f2fc2-96b5-4f4d-8c7b-09ab3ddaacaa admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:49.710888 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f2fc2-96b5-4f4d-8c7b-09ab3ddaacaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 11:07:49.711192 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f2fc2-96b5-4f4d-8c7b-09ab3ddaacaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:49.712771 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f2fc2-96b5-4f4d-8c7b-09ab3ddaacaa admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:49.724462 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1371/2739] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 11:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 11:07:49.728983 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f960cd0-01c9-41db-9517-be1d16e1a63c None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:49.739120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f960cd0-01c9-41db-9517-be1d16e1a63c None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:49.743711 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c70d48-9a16-46fa-a0b6-97bfc121d4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:49.744328 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c70d48-9a16-46fa-a0b6-97bfc121d4fd admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:49.744611 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c70d48-9a16-46fa-a0b6-97bfc121d4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:49.744886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c70d48-9a16-46fa-a0b6-97bfc121d4fd admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:49.745563 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c70d48-9a16-46fa-a0b6-97bfc121d4fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:49.747485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c70d48-9a16-46fa-a0b6-97bfc121d4fd admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:49.753551 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:07:49.777651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1369/2740] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:07:49 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:07:49.782989 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f2fc2-96b5-4f4d-8c7b-09ab3ddaacaa admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:49.794833 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f2fc2-96b5-4f4d-8c7b-09ab3ddaacaa admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:49.854454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbaed23-5242-43b1-86eb-043efa8eadb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:49.855083 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbaed23-5242-43b1-86eb-043efa8eadb9 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:49.855359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbaed23-5242-43b1-86eb-043efa8eadb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:49.855637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbaed23-5242-43b1-86eb-043efa8eadb9 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:49.856300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbaed23-5242-43b1-86eb-043efa8eadb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:49.858794 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbaed23-5242-43b1-86eb-043efa8eadb9 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:49.883012 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1372/2741] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:07:49 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 11:07:49.887276 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c70d48-9a16-46fa-a0b6-97bfc121d4fd admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:49.898156 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c70d48-9a16-46fa-a0b6-97bfc121d4fd admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:49.902966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d7d61-5209-4bbf-8eae-5c471753b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:49.903588 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d7d61-5209-4bbf-8eae-5c471753b3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:49.903874 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d7d61-5209-4bbf-8eae-5c471753b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:49.904153 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d7d61-5209-4bbf-8eae-5c471753b3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:49.905151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d7d61-5209-4bbf-8eae-5c471753b3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:49.906797 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d7d61-5209-4bbf-8eae-5c471753b3a0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:49.917227 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1370/2742] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 11:07:49.922245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbaed23-5242-43b1-86eb-043efa8eadb9 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:49.932713 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbaed23-5242-43b1-86eb-043efa8eadb9 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:49.938641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e343d83-221b-4506-bd3d-b45db2adc1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:49.939529 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343d83-221b-4506-bd3d-b45db2adc1fd admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:49.939949 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343d83-221b-4506-bd3d-b45db2adc1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:49.940343 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343d83-221b-4506-bd3d-b45db2adc1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:49.941417 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e343d83-221b-4506-bd3d-b45db2adc1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:49.943489 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e343d83-221b-4506-bd3d-b45db2adc1fd admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:49.957530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1373/2743] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:07:49.962111 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d7d61-5209-4bbf-8eae-5c471753b3a0 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:49.976047 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d7d61-5209-4bbf-8eae-5c471753b3a0 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:49.981459 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37707d0e-fb2d-4b3a-8bcf-19f5f2b2473e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:49.982241 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37707d0e-fb2d-4b3a-8bcf-19f5f2b2473e admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:49.983289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37707d0e-fb2d-4b3a-8bcf-19f5f2b2473e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:49.983763 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37707d0e-fb2d-4b3a-8bcf-19f5f2b2473e admin admin] PATH_INFO: `/v3/projects/07f1a14dc7a647a5a7a224126b55411e/users/e10e4a2dcfaa4898ae34bca2ce8645fe/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:50.135760 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37707d0e-fb2d-4b3a-8bcf-19f5f2b2473e admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f1a14dc7a647a5a7a224126b55411e, user_id=e10e4a2dcfaa4898ae34bca2ce8645fe, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:50.138420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37707d0e-fb2d-4b3a-8bcf-19f5f2b2473e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:50.151193 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1371/2744] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:07:49 2022] PUT /identity/v3/projects/07f1a14dc7a647a5a7a224126b55411e/users/e10e4a2dcfaa4898ae34bca2ce8645fe/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:07:50.163305 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ed242-db7e-45a7-a446-0cedc6678087 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:50.163860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ed242-db7e-45a7-a446-0cedc6678087 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:50.163860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ed242-db7e-45a7-a446-0cedc6678087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:50.191588 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-ff1ed242-db7e-45a7-a446-0cedc6678087 None None] MFA Rules not processed for user `e10e4a2dcfaa4898ae34bca2ce8645fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:07:50.192800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-ff1ed242-db7e-45a7-a446-0cedc6678087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:50.234344 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:07:50.257787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1374/2745] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:07:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:07:50.268960 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37707d0e-fb2d-4b3a-8bcf-19f5f2b2473e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:50.270869 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-37707d0e-fb2d-4b3a-8bcf-19f5f2b2473e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:50.344619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37707d0e-fb2d-4b3a-8bcf-19f5f2b2473e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:50.350211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124cc7e-1372-48ec-bbef-0111073b309e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:50.350838 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124cc7e-1372-48ec-bbef-0111073b309e service nova] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:50.351118 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124cc7e-1372-48ec-bbef-0111073b309e service nova] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:50.351390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124cc7e-1372-48ec-bbef-0111073b309e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:50.359311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124cc7e-1372-48ec-bbef-0111073b309e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:50.360878 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124cc7e-1372-48ec-bbef-0111073b309e service nova] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:50.369619 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1372/2746] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:07:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:07:53.065361 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ed242-db7e-45a7-a446-0cedc6678087 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:53.127677 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ed242-db7e-45a7-a446-0cedc6678087 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:53.131963 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db0ba1-d635-46bc-9ec4-8e76bce4ffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:53.132597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0ba1-d635-46bc-9ec4-8e76bce4ffbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:53.132892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0ba1-d635-46bc-9ec4-8e76bce4ffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:53.133148 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0ba1-d635-46bc-9ec4-8e76bce4ffbf admin admin] PATH_INFO: `/v3/users/e10e4a2dcfaa4898ae34bca2ce8645fe` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:53.134312 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db0ba1-d635-46bc-9ec4-8e76bce4ffbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10e4a2dcfaa4898ae34bca2ce8645fe)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:53.136197 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db0ba1-d635-46bc-9ec4-8e76bce4ffbf admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:53.187723 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-14db0ba1-d635-46bc-9ec4-8e76bce4ffbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10e4a2dcfaa4898ae34bca2ce8645fe'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:53.188731 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-14db0ba1-d635-46bc-9ec4-8e76bce4ffbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10e4a2dcfaa4898ae34bca2ce8645fe'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:53.196359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-14db0ba1-d635-46bc-9ec4-8e76bce4ffbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10e4a2dcfaa4898ae34bca2ce8645fe'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:53.204444 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-14db0ba1-d635-46bc-9ec4-8e76bce4ffbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10e4a2dcfaa4898ae34bca2ce8645fe'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:53.205090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-14db0ba1-d635-46bc-9ec4-8e76bce4ffbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10e4a2dcfaa4898ae34bca2ce8645fe'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:53.222701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1375/2747] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:07:53 2022] DELETE /identity/v3/users/e10e4a2dcfaa4898ae34bca2ce8645fe => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:07:53.227237 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60286ca-4701-4748-af84-673b61c482f3 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:53.227736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60286ca-4701-4748-af84-673b61c482f3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:53.227837 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60286ca-4701-4748-af84-673b61c482f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:53.247571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e60286ca-4701-4748-af84-673b61c482f3 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:07:53.249305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e60286ca-4701-4748-af84-673b61c482f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:53.308194 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1373/2748] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:07:53.318206 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db0ba1-d635-46bc-9ec4-8e76bce4ffbf admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:53.319632 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-14db0ba1-d635-46bc-9ec4-8e76bce4ffbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:53.390691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db0ba1-d635-46bc-9ec4-8e76bce4ffbf admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:53.394177 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8512151-a753-43c8-8e57-9183b1b17300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:53.394815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8512151-a753-43c8-8e57-9183b1b17300 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:53.395100 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8512151-a753-43c8-8e57-9183b1b17300 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:53.395372 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8512151-a753-43c8-8e57-9183b1b17300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:53.401173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:07:53.407053 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8512151-a753-43c8-8e57-9183b1b17300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:53.408973 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8512151-a753-43c8-8e57-9183b1b17300 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:53.419260 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1376/2749] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:07:53.704429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60286ca-4701-4748-af84-673b61c482f3 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:53.705879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e60286ca-4701-4748-af84-673b61c482f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:53.720653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60286ca-4701-4748-af84-673b61c482f3 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:53.725447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed019d1b-b0bb-48f5-8644-d3b7db106c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:53.726138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed019d1b-b0bb-48f5-8644-d3b7db106c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:53.727053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed019d1b-b0bb-48f5-8644-d3b7db106c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:53.727053 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed019d1b-b0bb-48f5-8644-d3b7db106c68 admin admin] PATH_INFO: `/v3/projects/07f1a14dc7a647a5a7a224126b55411e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:53.727907 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed019d1b-b0bb-48f5-8644-d3b7db106c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f1a14dc7a647a5a7a224126b55411e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:53.729852 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed019d1b-b0bb-48f5-8644-d3b7db106c68 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:53.772432 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:07:53.788442 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ed019d1b-b0bb-48f5-8644-d3b7db106c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f1a14dc7a647a5a7a224126b55411e', 'request_id': 'req-ed019d1b-b0bb-48f5-8644-d3b7db106c68'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:53.795515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ed019d1b-b0bb-48f5-8644-d3b7db106c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f1a14dc7a647a5a7a224126b55411e', 'request_id': 'req-ed019d1b-b0bb-48f5-8644-d3b7db106c68'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:53.804015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ed019d1b-b0bb-48f5-8644-d3b7db106c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f1a14dc7a647a5a7a224126b55411e', 'request_id': 'req-ed019d1b-b0bb-48f5-8644-d3b7db106c68'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:53.817488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ed019d1b-b0bb-48f5-8644-d3b7db106c68 admin admin] The token cache is being invalidate because project 07f1a14dc7a647a5a7a224126b55411e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:07:53.817788 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ed019d1b-b0bb-48f5-8644-d3b7db106c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:53.818682 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-ed019d1b-b0bb-48f5-8644-d3b7db106c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:53.820668 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1374/2750] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:07:53 2022] DELETE /identity/v3/projects/07f1a14dc7a647a5a7a224126b55411e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:07:53.826706 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfde5f-4b8c-4f1d-93f7-c67df06313b6 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:53.827009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfde5f-4b8c-4f1d-93f7-c67df06313b6 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:53.827307 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfde5f-4b8c-4f1d-93f7-c67df06313b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:53.848694 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-91dfde5f-4b8c-4f1d-93f7-c67df06313b6 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:07:53.849915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-91dfde5f-4b8c-4f1d-93f7-c67df06313b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:53.910976 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1377/2751] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 11:07:53.918768 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf8294-c9d5-4b18-b9fc-d8be26826de6 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:53.919030 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf8294-c9d5-4b18-b9fc-d8be26826de6 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:53.919299 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf8294-c9d5-4b18-b9fc-d8be26826de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:53.939344 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-4bcf8294-c9d5-4b18-b9fc-d8be26826de6 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:07:53.940536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-4bcf8294-c9d5-4b18-b9fc-d8be26826de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:53.948341 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1375/2752] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:07:53.953313 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfde5f-4b8c-4f1d-93f7-c67df06313b6 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:53.963249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfde5f-4b8c-4f1d-93f7-c67df06313b6 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:53.967983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96793f93-7038-4946-9c95-0608bd6d7d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:53.968594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793f93-7038-4946-9c95-0608bd6d7d26 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:53.968877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793f93-7038-4946-9c95-0608bd6d7d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:53.969153 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793f93-7038-4946-9c95-0608bd6d7d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:53.969844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96793f93-7038-4946-9c95-0608bd6d7d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 11:07:53.970150 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96793f93-7038-4946-9c95-0608bd6d7d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:53.972007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96793f93-7038-4946-9c95-0608bd6d7d26 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:53.983650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1378/2753] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 11:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 11:07:53.987969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf8294-c9d5-4b18-b9fc-d8be26826de6 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:53.997276 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf8294-c9d5-4b18-b9fc-d8be26826de6 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:54.002848 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32717414-89e5-4cb9-988b-60152d08609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:54.003500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717414-89e5-4cb9-988b-60152d08609c admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:54.003777 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717414-89e5-4cb9-988b-60152d08609c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:54.004046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32717414-89e5-4cb9-988b-60152d08609c admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:54.004736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32717414-89e5-4cb9-988b-60152d08609c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:54.006689 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32717414-89e5-4cb9-988b-60152d08609c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:54.033888 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1376/2754] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:07:53 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:07:54.038348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96793f93-7038-4946-9c95-0608bd6d7d26 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:54.048140 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96793f93-7038-4946-9c95-0608bd6d7d26 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:54.103559 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a61de1-1286-4af6-900e-37b8d3970a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:54.104288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a61de1-1286-4af6-900e-37b8d3970a84 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:54.104639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a61de1-1286-4af6-900e-37b8d3970a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:54.104914 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a61de1-1286-4af6-900e-37b8d3970a84 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:54.105626 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a61de1-1286-4af6-900e-37b8d3970a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:54.108144 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a61de1-1286-4af6-900e-37b8d3970a84 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:54.130789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1379/2755] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:07:54 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:07:54.135285 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32717414-89e5-4cb9-988b-60152d08609c admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:54.146005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32717414-89e5-4cb9-988b-60152d08609c admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:54.150652 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7c0a2-c303-4fd1-b2e9-0baad9c5e12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:54.151272 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7c0a2-c303-4fd1-b2e9-0baad9c5e12d admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:54.151549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7c0a2-c303-4fd1-b2e9-0baad9c5e12d admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:54.151820 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7c0a2-c303-4fd1-b2e9-0baad9c5e12d admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:54.152510 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7c0a2-c303-4fd1-b2e9-0baad9c5e12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:54.154151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7c0a2-c303-4fd1-b2e9-0baad9c5e12d admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:54.164509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1377/2756] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:07:54.168463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a61de1-1286-4af6-900e-37b8d3970a84 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:54.179388 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a61de1-1286-4af6-900e-37b8d3970a84 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:54.184400 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb08f1-dbea-4ad0-8dce-d524cdb992c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:54.185033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb08f1-dbea-4ad0-8dce-d524cdb992c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:54.185322 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb08f1-dbea-4ad0-8dce-d524cdb992c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:54.186176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb08f1-dbea-4ad0-8dce-d524cdb992c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:54.186968 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb08f1-dbea-4ad0-8dce-d524cdb992c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:54.188657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb08f1-dbea-4ad0-8dce-d524cdb992c3 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:54.199460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1380/2757] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:07:54.203724 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7c0a2-c303-4fd1-b2e9-0baad9c5e12d admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:54.213616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7c0a2-c303-4fd1-b2e9-0baad9c5e12d admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:54.218174 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48489a-563c-4e2c-95f2-2e7081f2c849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:54.218848 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48489a-563c-4e2c-95f2-2e7081f2c849 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:54.219126 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48489a-563c-4e2c-95f2-2e7081f2c849 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:54.219397 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48489a-563c-4e2c-95f2-2e7081f2c849 admin admin] PATH_INFO: `/v3/projects/8320204c9bc044538018696926f91278/users/2f29c32216d040e8a85c3a48a197914e/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:54.235527 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48489a-563c-4e2c-95f2-2e7081f2c849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8320204c9bc044538018696926f91278, user_id=2f29c32216d040e8a85c3a48a197914e, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:54.238141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48489a-563c-4e2c-95f2-2e7081f2c849 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:54.252616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1378/2758] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:07:54 2022] PUT /identity/v3/projects/8320204c9bc044538018696926f91278/users/2f29c32216d040e8a85c3a48a197914e/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:07:54.264254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefc6d0-a1a3-4aa8-928d-f7808328b825 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:54.264581 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefc6d0-a1a3-4aa8-928d-f7808328b825 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:54.264857 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefc6d0-a1a3-4aa8-928d-f7808328b825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:54.292691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-9cefc6d0-a1a3-4aa8-928d-f7808328b825 None None] MFA Rules not processed for user `2f29c32216d040e8a85c3a48a197914e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:07:54.293909 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9cefc6d0-a1a3-4aa8-928d-f7808328b825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:54.340401 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:07:54.359975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1381/2759] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:07:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:07:54.364440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48489a-563c-4e2c-95f2-2e7081f2c849 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:54.426577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48489a-563c-4e2c-95f2-2e7081f2c849 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:54.433691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd26efb-3e8a-47f0-b882-14747ebe5831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:54.434780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd26efb-3e8a-47f0-b882-14747ebe5831 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:54.435280 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd26efb-3e8a-47f0-b882-14747ebe5831 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:54.436429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd26efb-3e8a-47f0-b882-14747ebe5831 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:54.437674 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd26efb-3e8a-47f0-b882-14747ebe5831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:54.441396 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd26efb-3e8a-47f0-b882-14747ebe5831 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:54.470911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1379/2760] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:07:54 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 11:07:54.474988 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefc6d0-a1a3-4aa8-928d-f7808328b825 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:54.486614 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefc6d0-a1a3-4aa8-928d-f7808328b825 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:54.549790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49d795-1a7b-4441-b69a-e8235fca19a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:54.550442 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49d795-1a7b-4441-b69a-e8235fca19a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:54.550720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49d795-1a7b-4441-b69a-e8235fca19a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:54.551001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49d795-1a7b-4441-b69a-e8235fca19a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:54.551650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49d795-1a7b-4441-b69a-e8235fca19a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:54.553548 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49d795-1a7b-4441-b69a-e8235fca19a3 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:54.574069 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1382/2761] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:07:54 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:07:54.578282 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd26efb-3e8a-47f0-b882-14747ebe5831 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:54.588529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd26efb-3e8a-47f0-b882-14747ebe5831 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:54.593961 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c05427-6d87-4c03-975f-d43b0c97d7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:54.594597 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c05427-6d87-4c03-975f-d43b0c97d7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:54.594877 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c05427-6d87-4c03-975f-d43b0c97d7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:54.595149 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c05427-6d87-4c03-975f-d43b0c97d7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:54.595845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c05427-6d87-4c03-975f-d43b0c97d7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:54.597420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c05427-6d87-4c03-975f-d43b0c97d7c8 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:54.607958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1380/2762] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:07:54.612423 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49d795-1a7b-4441-b69a-e8235fca19a3 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:54.622510 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49d795-1a7b-4441-b69a-e8235fca19a3 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:54.627454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a36e3-c88b-4097-a989-0146d42b7ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:54.628125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a36e3-c88b-4097-a989-0146d42b7ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:54.628411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a36e3-c88b-4097-a989-0146d42b7ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:54.628687 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a36e3-c88b-4097-a989-0146d42b7ab7 admin admin] PATH_INFO: `/v3/projects/9dcd3752a15d4c19b1017008577d7303/users/95c7cdfab1834199aef38539501960c8/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:54.643668 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a36e3-c88b-4097-a989-0146d42b7ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dcd3752a15d4c19b1017008577d7303, user_id=95c7cdfab1834199aef38539501960c8, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:54.646375 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a36e3-c88b-4097-a989-0146d42b7ab7 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:54.659711 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1383/2763] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:07:54 2022] PUT /identity/v3/projects/9dcd3752a15d4c19b1017008577d7303/users/95c7cdfab1834199aef38539501960c8/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:07:54.663958 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c05427-6d87-4c03-975f-d43b0c97d7c8 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:54.674383 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c05427-6d87-4c03-975f-d43b0c97d7c8 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:54.702357 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:07:54.733678 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88b281-eec7-45ef-882a-b31f0c5bf2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:54.734323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b281-eec7-45ef-882a-b31f0c5bf2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:54.734597 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b281-eec7-45ef-882a-b31f0c5bf2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:54.734868 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b281-eec7-45ef-882a-b31f0c5bf2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:54.735556 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88b281-eec7-45ef-882a-b31f0c5bf2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:54.737125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88b281-eec7-45ef-882a-b31f0c5bf2a7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:54.746841 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1381/2764] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:07:54.751309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a36e3-c88b-4097-a989-0146d42b7ab7 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:54.761702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a36e3-c88b-4097-a989-0146d42b7ab7 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:54.766714 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ef59a-33fe-42f8-8921-5881da8bedcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:54.767373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ef59a-33fe-42f8-8921-5881da8bedcc admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:54.767652 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ef59a-33fe-42f8-8921-5881da8bedcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:54.767925 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ef59a-33fe-42f8-8921-5881da8bedcc admin admin] PATH_INFO: `/v3/projects/9dcd3752a15d4c19b1017008577d7303/users/95c7cdfab1834199aef38539501960c8/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:54.769854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ef59a-33fe-42f8-8921-5881da8bedcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dcd3752a15d4c19b1017008577d7303, user_id=95c7cdfab1834199aef38539501960c8, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:54.772500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ef59a-33fe-42f8-8921-5881da8bedcc admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:54.783657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1384/2765] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:07:54 2022] PUT /identity/v3/projects/9dcd3752a15d4c19b1017008577d7303/users/95c7cdfab1834199aef38539501960c8/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:07:54.794367 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d3563-8f68-46c3-a2f9-3b17752d8dd3 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:54.794668 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d3563-8f68-46c3-a2f9-3b17752d8dd3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:54.795513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d3563-8f68-46c3-a2f9-3b17752d8dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:54.824041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-557d3563-8f68-46c3-a2f9-3b17752d8dd3 None None] MFA Rules not processed for user `95c7cdfab1834199aef38539501960c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:07:54.825271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-557d3563-8f68-46c3-a2f9-3b17752d8dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:54.901483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1382/2766] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:07:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:07:54.914886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ef59a-33fe-42f8-8921-5881da8bedcc admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:54.916779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-4b9ef59a-33fe-42f8-8921-5881da8bedcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:54.985262 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ef59a-33fe-42f8-8921-5881da8bedcc admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:54.988902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dda7d5-eed5-4141-be39-0355ae08e3af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:54.989536 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dda7d5-eed5-4141-be39-0355ae08e3af service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:54.989814 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dda7d5-eed5-4141-be39-0355ae08e3af service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:54.990085 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dda7d5-eed5-4141-be39-0355ae08e3af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:55.000761 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dda7d5-eed5-4141-be39-0355ae08e3af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:55.002241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dda7d5-eed5-4141-be39-0355ae08e3af service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:55.013046 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1385/2767] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:07:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:07:55.062110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d3563-8f68-46c3-a2f9-3b17752d8dd3 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:55.063591 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-557d3563-8f68-46c3-a2f9-3b17752d8dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:55.076635 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d3563-8f68-46c3-a2f9-3b17752d8dd3 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:55.080440 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c916e-958c-48d5-8f23-29c2bcd7508a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:55.081076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c916e-958c-48d5-8f23-29c2bcd7508a service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:55.081356 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c916e-958c-48d5-8f23-29c2bcd7508a service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:55.081630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c916e-958c-48d5-8f23-29c2bcd7508a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:55.141682 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c916e-958c-48d5-8f23-29c2bcd7508a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:55.143147 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c916e-958c-48d5-8f23-29c2bcd7508a service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:55.152925 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1383/2768] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:07:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:07:58.470101 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dda7d5-eed5-4141-be39-0355ae08e3af service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:58.525347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:07:58.556234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dda7d5-eed5-4141-be39-0355ae08e3af service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:58.563546 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d19da-f4a9-49b1-a01a-b77d39498608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:58.564585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d19da-f4a9-49b1-a01a-b77d39498608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:58.565060 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d19da-f4a9-49b1-a01a-b77d39498608 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:58.565530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d19da-f4a9-49b1-a01a-b77d39498608 admin admin] PATH_INFO: `/v3/users/2f29c32216d040e8a85c3a48a197914e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:58.567485 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d19da-f4a9-49b1-a01a-b77d39498608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f29c32216d040e8a85c3a48a197914e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:58.571014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d19da-f4a9-49b1-a01a-b77d39498608 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:58.621578 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9b7d19da-f4a9-49b1-a01a-b77d39498608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f29c32216d040e8a85c3a48a197914e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:58.622257 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9b7d19da-f4a9-49b1-a01a-b77d39498608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f29c32216d040e8a85c3a48a197914e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:58.630748 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9b7d19da-f4a9-49b1-a01a-b77d39498608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f29c32216d040e8a85c3a48a197914e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:58.637895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9b7d19da-f4a9-49b1-a01a-b77d39498608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f29c32216d040e8a85c3a48a197914e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:58.639293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9b7d19da-f4a9-49b1-a01a-b77d39498608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f29c32216d040e8a85c3a48a197914e'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:58.656994 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1386/2769] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:07:58 2022] DELETE /identity/v3/users/2f29c32216d040e8a85c3a48a197914e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:07:58.661831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35445f26-651c-43e1-bf6a-9b0537126e90 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:58.662343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35445f26-651c-43e1-bf6a-9b0537126e90 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:58.662463 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35445f26-651c-43e1-bf6a-9b0537126e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:58.681141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-35445f26-651c-43e1-bf6a-9b0537126e90 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:07:58.682361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-35445f26-651c-43e1-bf6a-9b0537126e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:58.726650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:07:58.741452 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1384/2770] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 11:07:58.751512 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d19da-f4a9-49b1-a01a-b77d39498608 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:58.752939 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9b7d19da-f4a9-49b1-a01a-b77d39498608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:58.811265 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d19da-f4a9-49b1-a01a-b77d39498608 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:58.814991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c1669-2f62-4a50-970a-84b3178c4ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:58.815651 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c1669-2f62-4a50-970a-84b3178c4ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:58.815932 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c1669-2f62-4a50-970a-84b3178c4ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:58.816210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c1669-2f62-4a50-970a-84b3178c4ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:58.825266 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c1669-2f62-4a50-970a-84b3178c4ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:58.827286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c1669-2f62-4a50-970a-84b3178c4ba6 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:58.836753 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1387/2771] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:07:59.123216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35445f26-651c-43e1-bf6a-9b0537126e90 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:59.124666 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-35445f26-651c-43e1-bf6a-9b0537126e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:59.141249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35445f26-651c-43e1-bf6a-9b0537126e90 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:59.146017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:59.146703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:59.146979 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:59.147246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] PATH_INFO: `/v3/projects/8320204c9bc044538018696926f91278` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:59.148558 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8320204c9bc044538018696926f91278)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:59.150477 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:59.200095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8320204c9bc044538018696926f91278', 'request_id': 'req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.207408 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8320204c9bc044538018696926f91278', 'request_id': 'req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.214862 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8320204c9bc044538018696926f91278', 'request_id': 'req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.228663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] The token cache is being invalidate because project 8320204c9bc044538018696926f91278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:07:59.228960 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.229644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.231260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1385/2772] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:07:59 2022] DELETE /identity/v3/projects/8320204c9bc044538018696926f91278 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:07:59.235622 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c1669-2f62-4a50-970a-84b3178c4ba6 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:59.245974 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c1669-2f62-4a50-970a-84b3178c4ba6 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:59.322745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbd342-4ee3-4f82-a86b-c44c1000613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:59.323416 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbd342-4ee3-4f82-a86b-c44c1000613a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:59.323700 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbd342-4ee3-4f82-a86b-c44c1000613a admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:59.323975 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbd342-4ee3-4f82-a86b-c44c1000613a admin admin] PATH_INFO: `/v3/users/95c7cdfab1834199aef38539501960c8` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:59.325369 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbd342-4ee3-4f82-a86b-c44c1000613a admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c7cdfab1834199aef38539501960c8)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:59.328386 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbd342-4ee3-4f82-a86b-c44c1000613a admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:59.335863 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:07:59.387299 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-95dbd342-4ee3-4f82-a86b-c44c1000613a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c7cdfab1834199aef38539501960c8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.388056 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-95dbd342-4ee3-4f82-a86b-c44c1000613a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c7cdfab1834199aef38539501960c8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.396242 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-95dbd342-4ee3-4f82-a86b-c44c1000613a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c7cdfab1834199aef38539501960c8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.404586 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-95dbd342-4ee3-4f82-a86b-c44c1000613a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c7cdfab1834199aef38539501960c8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.405356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-95dbd342-4ee3-4f82-a86b-c44c1000613a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c7cdfab1834199aef38539501960c8'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.424647 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1388/2773] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:07:59 2022] DELETE /identity/v3/users/95c7cdfab1834199aef38539501960c8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:07:59.740390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:07:59.743123 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:07:59.758249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ef4e7-e9ca-42e2-a8a3-b75f6f97995c admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:07:59.824488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e39b4a-7f01-4314-b965-36312c090cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:07:59.825046 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e39b4a-7f01-4314-b965-36312c090cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:59.825351 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e39b4a-7f01-4314-b965-36312c090cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:59.825702 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e39b4a-7f01-4314-b965-36312c090cf0 admin admin] PATH_INFO: `/v3/projects/9dcd3752a15d4c19b1017008577d7303` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:59.827132 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e39b4a-7f01-4314-b965-36312c090cf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dcd3752a15d4c19b1017008577d7303)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:07:59.829026 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e39b4a-7f01-4314-b965-36312c090cf0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:07:59.879382 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e5e39b4a-7f01-4314-b965-36312c090cf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dcd3752a15d4c19b1017008577d7303', 'request_id': 'req-e5e39b4a-7f01-4314-b965-36312c090cf0'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.886294 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e5e39b4a-7f01-4314-b965-36312c090cf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dcd3752a15d4c19b1017008577d7303', 'request_id': 'req-e5e39b4a-7f01-4314-b965-36312c090cf0'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.894498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e5e39b4a-7f01-4314-b965-36312c090cf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dcd3752a15d4c19b1017008577d7303', 'request_id': 'req-e5e39b4a-7f01-4314-b965-36312c090cf0'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.905962 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e5e39b4a-7f01-4314-b965-36312c090cf0 admin admin] The token cache is being invalidate because project 9dcd3752a15d4c19b1017008577d7303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:07:59.906293 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e5e39b4a-7f01-4314-b965-36312c090cf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.906924 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-e5e39b4a-7f01-4314-b965-36312c090cf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:07:59.908425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1386/2774] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:07:59 2022] DELETE /identity/v3/projects/9dcd3752a15d4c19b1017008577d7303 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 11:07:59.914095 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b79ad-0ddf-426e-a42e-dfb7cb46ad0f None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:07:59.914743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b79ad-0ddf-426e-a42e-dfb7cb46ad0f None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:07:59.914743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b79ad-0ddf-426e-a42e-dfb7cb46ad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:07:59.940819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-f66b79ad-0ddf-426e-a42e-dfb7cb46ad0f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:07:59.942031 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-f66b79ad-0ddf-426e-a42e-dfb7cb46ad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:00.008238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1389/2775] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:00.018141 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555fa63-a7dc-4bf2-ad8d-0de0920ee63a None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:00.018458 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555fa63-a7dc-4bf2-ad8d-0de0920ee63a None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:00.018741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555fa63-a7dc-4bf2-ad8d-0de0920ee63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:00.029680 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:00.046908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e555fa63-a7dc-4bf2-ad8d-0de0920ee63a None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:00.048131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e555fa63-a7dc-4bf2-ad8d-0de0920ee63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:00.057162 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1387/2776] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:00.062790 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b79ad-0ddf-426e-a42e-dfb7cb46ad0f None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:00.073446 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b79ad-0ddf-426e-a42e-dfb7cb46ad0f None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:00.079356 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032254c7-d9c5-47ef-85ba-fbde339a3969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:00.079995 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032254c7-d9c5-47ef-85ba-fbde339a3969 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:00.080350 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032254c7-d9c5-47ef-85ba-fbde339a3969 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:00.080629 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032254c7-d9c5-47ef-85ba-fbde339a3969 admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:00.081342 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032254c7-d9c5-47ef-85ba-fbde339a3969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 11:08:00.081657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032254c7-d9c5-47ef-85ba-fbde339a3969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:00.083288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032254c7-d9c5-47ef-85ba-fbde339a3969 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:00.098966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1390/2777] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 11:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 11:08:00.103319 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555fa63-a7dc-4bf2-ad8d-0de0920ee63a None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:00.115105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555fa63-a7dc-4bf2-ad8d-0de0920ee63a None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:00.120293 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf6fee-4907-440e-99a0-ca1db0b5c5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:00.120919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf6fee-4907-440e-99a0-ca1db0b5c5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:00.121197 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf6fee-4907-440e-99a0-ca1db0b5c5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:00.121483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf6fee-4907-440e-99a0-ca1db0b5c5b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:00.122234 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf6fee-4907-440e-99a0-ca1db0b5c5b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:00.126673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf6fee-4907-440e-99a0-ca1db0b5c5b8 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:00.155980 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1388/2778] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:08:00 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 11:08:00.160895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032254c7-d9c5-47ef-85ba-fbde339a3969 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:00.172155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032254c7-d9c5-47ef-85ba-fbde339a3969 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:00.229984 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8f3bc-56b4-46cd-ab1d-84ed7b129115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:00.230659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f3bc-56b4-46cd-ab1d-84ed7b129115 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:00.230948 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f3bc-56b4-46cd-ab1d-84ed7b129115 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:00.231238 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8f3bc-56b4-46cd-ab1d-84ed7b129115 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:00.232551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8f3bc-56b4-46cd-ab1d-84ed7b129115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:00.234912 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8f3bc-56b4-46cd-ab1d-84ed7b129115 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:00.259501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1391/2779] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:08:00 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 11:08:00.263614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf6fee-4907-440e-99a0-ca1db0b5c5b8 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:00.274337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf6fee-4907-440e-99a0-ca1db0b5c5b8 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:00.279476 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0240d7-6065-4bd5-a8db-7dda4d8c2452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:00.280112 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0240d7-6065-4bd5-a8db-7dda4d8c2452 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:00.280458 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0240d7-6065-4bd5-a8db-7dda4d8c2452 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:00.280795 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0240d7-6065-4bd5-a8db-7dda4d8c2452 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:00.281513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0240d7-6065-4bd5-a8db-7dda4d8c2452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:00.283176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0240d7-6065-4bd5-a8db-7dda4d8c2452 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:00.296028 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1389/2780] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:00.300209 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8f3bc-56b4-46cd-ab1d-84ed7b129115 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:00.305538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:00.312925 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8f3bc-56b4-46cd-ab1d-84ed7b129115 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:00.318899 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b762be-3005-494b-a04d-1cf24b399e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:00.319512 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b762be-3005-494b-a04d-1cf24b399e22 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:00.319795 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b762be-3005-494b-a04d-1cf24b399e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:00.320067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b762be-3005-494b-a04d-1cf24b399e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:00.320757 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b762be-3005-494b-a04d-1cf24b399e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:00.322411 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b762be-3005-494b-a04d-1cf24b399e22 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:00.333679 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1392/2781] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:00.338200 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0240d7-6065-4bd5-a8db-7dda4d8c2452 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:00.349654 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0240d7-6065-4bd5-a8db-7dda4d8c2452 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:00.355170 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033d8e2-bd67-4f85-95cc-763987731298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:00.355858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d8e2-bd67-4f85-95cc-763987731298 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:00.356138 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d8e2-bd67-4f85-95cc-763987731298 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:00.356412 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033d8e2-bd67-4f85-95cc-763987731298 admin admin] PATH_INFO: `/v3/projects/c5f61e01909a4fe588ff0d2effea0078/users/3a696121c43b41b88fedde678b8cdfdf/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:00.371952 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033d8e2-bd67-4f85-95cc-763987731298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f61e01909a4fe588ff0d2effea0078, user_id=3a696121c43b41b88fedde678b8cdfdf, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:00.375216 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033d8e2-bd67-4f85-95cc-763987731298 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:00.388660 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1390/2782] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:08:00 2022] PUT /identity/v3/projects/c5f61e01909a4fe588ff0d2effea0078/users/3a696121c43b41b88fedde678b8cdfdf/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:00.457035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb87166-957c-4fd0-b808-4fdf21e619fa None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:00.457318 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb87166-957c-4fd0-b808-4fdf21e619fa None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:00.457594 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb87166-957c-4fd0-b808-4fdf21e619fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:00.488433 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-aeb87166-957c-4fd0-b808-4fdf21e619fa None None] MFA Rules not processed for user `3a696121c43b41b88fedde678b8cdfdf`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:00.489930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-aeb87166-957c-4fd0-b808-4fdf21e619fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:00.558023 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1393/2783] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:00.563221 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033d8e2-bd67-4f85-95cc-763987731298 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:00.633033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033d8e2-bd67-4f85-95cc-763987731298 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:00.637713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21220301-26c9-4456-8424-0c7c70c52642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:00.638404 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21220301-26c9-4456-8424-0c7c70c52642 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:00.638722 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21220301-26c9-4456-8424-0c7c70c52642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:00.639035 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21220301-26c9-4456-8424-0c7c70c52642 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:00.639738 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21220301-26c9-4456-8424-0c7c70c52642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:00.641656 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21220301-26c9-4456-8424-0c7c70c52642 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:00.669150 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1391/2784] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:08:00 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:00.674016 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb87166-957c-4fd0-b808-4fdf21e619fa None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:00.685348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb87166-957c-4fd0-b808-4fdf21e619fa None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:00.742718 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a0527-9011-45a7-8c47-12e8dd1924dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:00.743335 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a0527-9011-45a7-8c47-12e8dd1924dd admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:00.743616 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a0527-9011-45a7-8c47-12e8dd1924dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:00.743892 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a0527-9011-45a7-8c47-12e8dd1924dd admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:00.744556 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a0527-9011-45a7-8c47-12e8dd1924dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:00.746492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a0527-9011-45a7-8c47-12e8dd1924dd admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:00.771681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1394/2785] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:08:00 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:00.775598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21220301-26c9-4456-8424-0c7c70c52642 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:00.787281 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21220301-26c9-4456-8424-0c7c70c52642 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:00.791968 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d209871-6dca-416d-99f5-bbdab9c31320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:00.792572 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d209871-6dca-416d-99f5-bbdab9c31320 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:00.792851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d209871-6dca-416d-99f5-bbdab9c31320 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:00.793125 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d209871-6dca-416d-99f5-bbdab9c31320 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:00.793822 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d209871-6dca-416d-99f5-bbdab9c31320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:00.796325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d209871-6dca-416d-99f5-bbdab9c31320 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:00.806730 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1392/2786] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:00.810724 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a0527-9011-45a7-8c47-12e8dd1924dd admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:00.820507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a0527-9011-45a7-8c47-12e8dd1924dd admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:00.825014 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76050ff-75fa-46bd-a5bd-363e7f212e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:00.826160 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76050ff-75fa-46bd-a5bd-363e7f212e09 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:00.826471 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76050ff-75fa-46bd-a5bd-363e7f212e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:00.826743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76050ff-75fa-46bd-a5bd-363e7f212e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:00.827431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76050ff-75fa-46bd-a5bd-363e7f212e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:00.828991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76050ff-75fa-46bd-a5bd-363e7f212e09 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:00.838598 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1395/2787] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:00.843648 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d209871-6dca-416d-99f5-bbdab9c31320 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:00.856487 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d209871-6dca-416d-99f5-bbdab9c31320 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:00.862537 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d95f03-6761-498d-b530-67af84d54de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:00.863375 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d95f03-6761-498d-b530-67af84d54de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:00.863745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d95f03-6761-498d-b530-67af84d54de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:00.864115 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d95f03-6761-498d-b530-67af84d54de7 admin admin] PATH_INFO: `/v3/projects/fb49e2b6909b4c1395ad71da3c6b4390/users/e6304231a8dd444eadb39e12f22c40ff/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:00.882698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d95f03-6761-498d-b530-67af84d54de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb49e2b6909b4c1395ad71da3c6b4390, user_id=e6304231a8dd444eadb39e12f22c40ff, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:00.886503 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d95f03-6761-498d-b530-67af84d54de7 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:00.901800 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1393/2788] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:08:00 2022] PUT /identity/v3/projects/fb49e2b6909b4c1395ad71da3c6b4390/users/e6304231a8dd444eadb39e12f22c40ff/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:00.912716 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b13ff-e122-4639-90c5-c0c42c373035 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:00.913011 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b13ff-e122-4639-90c5-c0c42c373035 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:00.913289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b13ff-e122-4639-90c5-c0c42c373035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:00.941320 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-445b13ff-e122-4639-90c5-c0c42c373035 None None] MFA Rules not processed for user `e6304231a8dd444eadb39e12f22c40ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:00.942563 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-445b13ff-e122-4639-90c5-c0c42c373035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:00.989708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:01.007995 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1396/2789] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:01.012472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d95f03-6761-498d-b530-67af84d54de7 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:01.063671 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:01.076032 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d95f03-6761-498d-b530-67af84d54de7 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:01.080829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dda84-83aa-457c-a49a-7c14265c32b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:01.081450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dda84-83aa-457c-a49a-7c14265c32b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:01.081735 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dda84-83aa-457c-a49a-7c14265c32b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:01.082012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dda84-83aa-457c-a49a-7c14265c32b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:01.082726 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406dda84-83aa-457c-a49a-7c14265c32b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:01.084608 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406dda84-83aa-457c-a49a-7c14265c32b3 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:01.110929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1394/2790] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:08:01 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:01.114977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b13ff-e122-4639-90c5-c0c42c373035 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:01.125884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b13ff-e122-4639-90c5-c0c42c373035 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:01.181593 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fb6ad-3525-4b28-bc6a-6923852be4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:01.182129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb6ad-3525-4b28-bc6a-6923852be4de admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:01.182435 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb6ad-3525-4b28-bc6a-6923852be4de admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:01.182708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb6ad-3525-4b28-bc6a-6923852be4de admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:01.183384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fb6ad-3525-4b28-bc6a-6923852be4de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:01.185391 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fb6ad-3525-4b28-bc6a-6923852be4de admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:01.206016 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1397/2791] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:08:01 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:01.210080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dda84-83aa-457c-a49a-7c14265c32b3 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:01.221854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dda84-83aa-457c-a49a-7c14265c32b3 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:01.226664 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8c985-efe2-4e73-8ae5-ede822ece73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:01.227283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8c985-efe2-4e73-8ae5-ede822ece73a admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:01.227568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8c985-efe2-4e73-8ae5-ede822ece73a admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:01.227847 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8c985-efe2-4e73-8ae5-ede822ece73a admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:01.228549 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8c985-efe2-4e73-8ae5-ede822ece73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:01.230143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8c985-efe2-4e73-8ae5-ede822ece73a admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:01.240998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1395/2792] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:01.245199 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fb6ad-3525-4b28-bc6a-6923852be4de admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:01.255989 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fb6ad-3525-4b28-bc6a-6923852be4de admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:01.260562 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9c83b-9f97-4ae1-a353-3a0e62c69db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:01.261220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c83b-9f97-4ae1-a353-3a0e62c69db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:01.261503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c83b-9f97-4ae1-a353-3a0e62c69db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:01.261779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c83b-9f97-4ae1-a353-3a0e62c69db3 admin admin] PATH_INFO: `/v3/projects/d7208b000da94ffba8812c14f9faa7ae/users/318f3bb4e3f0431fa82900f918b2ef70/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:01.277166 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9c83b-9f97-4ae1-a353-3a0e62c69db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7208b000da94ffba8812c14f9faa7ae, user_id=318f3bb4e3f0431fa82900f918b2ef70, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:01.279880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9c83b-9f97-4ae1-a353-3a0e62c69db3 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:01.292835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1398/2793] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:08:01 2022] PUT /identity/v3/projects/d7208b000da94ffba8812c14f9faa7ae/users/318f3bb4e3f0431fa82900f918b2ef70/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:01.296806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8c985-efe2-4e73-8ae5-ede822ece73a admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:01.306689 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8c985-efe2-4e73-8ae5-ede822ece73a admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:01.361998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf785c-018c-4729-b157-e900016173f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:01.362645 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf785c-018c-4729-b157-e900016173f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:01.362927 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf785c-018c-4729-b157-e900016173f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:01.363205 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf785c-018c-4729-b157-e900016173f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:01.363902 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf785c-018c-4729-b157-e900016173f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:01.365482 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf785c-018c-4729-b157-e900016173f0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:01.375941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1396/2794] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:01.380172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9c83b-9f97-4ae1-a353-3a0e62c69db3 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:01.391147 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9c83b-9f97-4ae1-a353-3a0e62c69db3 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:01.395708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef10c1-3823-4403-9c91-735e7fd41bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:01.396366 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef10c1-3823-4403-9c91-735e7fd41bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:01.396651 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef10c1-3823-4403-9c91-735e7fd41bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:01.396930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef10c1-3823-4403-9c91-735e7fd41bf5 admin admin] PATH_INFO: `/v3/projects/d7208b000da94ffba8812c14f9faa7ae/users/318f3bb4e3f0431fa82900f918b2ef70/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:01.398902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef10c1-3823-4403-9c91-735e7fd41bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7208b000da94ffba8812c14f9faa7ae, user_id=318f3bb4e3f0431fa82900f918b2ef70, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:01.401550 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef10c1-3823-4403-9c91-735e7fd41bf5 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:01.412299 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1399/2795] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:08:01 2022] PUT /identity/v3/projects/d7208b000da94ffba8812c14f9faa7ae/users/318f3bb4e3f0431fa82900f918b2ef70/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:01.422530 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa15abe-abb1-4be5-95cf-b0b33bf228bd None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:01.422808 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa15abe-abb1-4be5-95cf-b0b33bf228bd None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:01.423103 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa15abe-abb1-4be5-95cf-b0b33bf228bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:01.452384 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-6aa15abe-abb1-4be5-95cf-b0b33bf228bd None None] MFA Rules not processed for user `318f3bb4e3f0431fa82900f918b2ef70`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:01.453480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6aa15abe-abb1-4be5-95cf-b0b33bf228bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:01.520606 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1397/2796] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:01.532283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef10c1-3823-4403-9c91-735e7fd41bf5 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:01.534005 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-4bef10c1-3823-4403-9c91-735e7fd41bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:01.592838 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef10c1-3823-4403-9c91-735e7fd41bf5 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:01.596502 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b121d-52a5-4a43-8ff3-042f3980878e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:01.597115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b121d-52a5-4a43-8ff3-042f3980878e service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:01.597397 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b121d-52a5-4a43-8ff3-042f3980878e service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:01.597671 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b121d-52a5-4a43-8ff3-042f3980878e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:01.607549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b121d-52a5-4a43-8ff3-042f3980878e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:01.608962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b121d-52a5-4a43-8ff3-042f3980878e service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:01.618296 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1400/2797] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:08:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 11:08:01.659018 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa15abe-abb1-4be5-95cf-b0b33bf228bd None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:01.660712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-6aa15abe-abb1-4be5-95cf-b0b33bf228bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:01.673160 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa15abe-abb1-4be5-95cf-b0b33bf228bd None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:01.676778 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed0dc7-2932-4490-8828-784a7b284a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:01.677382 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0dc7-2932-4490-8828-784a7b284a8b service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:01.677691 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0dc7-2932-4490-8828-784a7b284a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:01.677967 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0dc7-2932-4490-8828-784a7b284a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:01.721630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:01.736137 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed0dc7-2932-4490-8828-784a7b284a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:01.737585 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed0dc7-2932-4490-8828-784a7b284a8b service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:01.747213 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1398/2798] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:08:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:08:04.725788 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b121d-52a5-4a43-8ff3-042f3980878e service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:04.771915 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:04.789433 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b121d-52a5-4a43-8ff3-042f3980878e service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:04.793907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47912f-ed87-4097-8ce7-a31e0458a17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:04.795254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47912f-ed87-4097-8ce7-a31e0458a17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:04.795538 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47912f-ed87-4097-8ce7-a31e0458a17c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:04.795811 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47912f-ed87-4097-8ce7-a31e0458a17c admin admin] PATH_INFO: `/v3/users/3a696121c43b41b88fedde678b8cdfdf` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:04.796958 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47912f-ed87-4097-8ce7-a31e0458a17c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a696121c43b41b88fedde678b8cdfdf)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:04.798895 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47912f-ed87-4097-8ce7-a31e0458a17c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:04.844025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2d47912f-ed87-4097-8ce7-a31e0458a17c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a696121c43b41b88fedde678b8cdfdf'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:04.844682 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2d47912f-ed87-4097-8ce7-a31e0458a17c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a696121c43b41b88fedde678b8cdfdf'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:04.851492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2d47912f-ed87-4097-8ce7-a31e0458a17c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a696121c43b41b88fedde678b8cdfdf'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:04.859142 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2d47912f-ed87-4097-8ce7-a31e0458a17c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a696121c43b41b88fedde678b8cdfdf'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:04.859818 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-2d47912f-ed87-4097-8ce7-a31e0458a17c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a696121c43b41b88fedde678b8cdfdf'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:04.877585 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1401/2799] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:08:04 2022] DELETE /identity/v3/users/3a696121c43b41b88fedde678b8cdfdf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:04.882178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b540b-e1e9-4f3d-bbe1-d04820e08af3 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:04.882616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b540b-e1e9-4f3d-bbe1-d04820e08af3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:04.882765 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b540b-e1e9-4f3d-bbe1-d04820e08af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:04.901936 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-8b5b540b-e1e9-4f3d-bbe1-d04820e08af3 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:04.903090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-8b5b540b-e1e9-4f3d-bbe1-d04820e08af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:04.962208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1399/2800] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:04.972515 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47912f-ed87-4097-8ce7-a31e0458a17c admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:04.973920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2d47912f-ed87-4097-8ce7-a31e0458a17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:05.030066 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47912f-ed87-4097-8ce7-a31e0458a17c admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:05.033738 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91be40-dc49-4e13-9be0-75dd7a1423bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:05.034384 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91be40-dc49-4e13-9be0-75dd7a1423bd service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:05.034670 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91be40-dc49-4e13-9be0-75dd7a1423bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:05.035195 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91be40-dc49-4e13-9be0-75dd7a1423bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:05.044721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91be40-dc49-4e13-9be0-75dd7a1423bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:05.046139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91be40-dc49-4e13-9be0-75dd7a1423bd service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:05.055513 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1402/2801] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:08:05.322568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b540b-e1e9-4f3d-bbe1-d04820e08af3 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:05.324222 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-8b5b540b-e1e9-4f3d-bbe1-d04820e08af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:05.345536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b540b-e1e9-4f3d-bbe1-d04820e08af3 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:05.353844 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:05.354914 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:05.355325 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:05.355704 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] PATH_INFO: `/v3/projects/c5f61e01909a4fe588ff0d2effea0078` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:05.357204 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5f61e01909a4fe588ff0d2effea0078)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:05.359251 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:05.405666 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5f61e01909a4fe588ff0d2effea0078', 'request_id': 'req-f113f136-e03e-4645-ad98-2cb601f6bc29'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:05.411964 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5f61e01909a4fe588ff0d2effea0078', 'request_id': 'req-f113f136-e03e-4645-ad98-2cb601f6bc29'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:05.418436 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5f61e01909a4fe588ff0d2effea0078', 'request_id': 'req-f113f136-e03e-4645-ad98-2cb601f6bc29'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:05.428791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] The token cache is being invalidate because project c5f61e01909a4fe588ff0d2effea0078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:08:05.429081 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:05.429713 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:05.431324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1400/2802] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:08:05 2022] DELETE /identity/v3/projects/c5f61e01909a4fe588ff0d2effea0078 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 11:08:05.435586 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91be40-dc49-4e13-9be0-75dd7a1423bd service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:05.445727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91be40-dc49-4e13-9be0-75dd7a1423bd service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:05.502020 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202bdd2-e60f-4f3b-8301-a69eabb4a000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:05.502697 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202bdd2-e60f-4f3b-8301-a69eabb4a000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:05.502977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202bdd2-e60f-4f3b-8301-a69eabb4a000 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:05.503249 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202bdd2-e60f-4f3b-8301-a69eabb4a000 admin admin] PATH_INFO: `/v3/users/e6304231a8dd444eadb39e12f22c40ff` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:05.504394 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202bdd2-e60f-4f3b-8301-a69eabb4a000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6304231a8dd444eadb39e12f22c40ff)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:05.506336 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202bdd2-e60f-4f3b-8301-a69eabb4a000 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:05.511519 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:05.552955 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9202bdd2-e60f-4f3b-8301-a69eabb4a000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6304231a8dd444eadb39e12f22c40ff'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:05.553609 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9202bdd2-e60f-4f3b-8301-a69eabb4a000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6304231a8dd444eadb39e12f22c40ff'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:05.560664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9202bdd2-e60f-4f3b-8301-a69eabb4a000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6304231a8dd444eadb39e12f22c40ff'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:05.567565 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9202bdd2-e60f-4f3b-8301-a69eabb4a000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6304231a8dd444eadb39e12f22c40ff'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:05.568218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9202bdd2-e60f-4f3b-8301-a69eabb4a000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6304231a8dd444eadb39e12f22c40ff'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:05.586798 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1403/2803] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:08:05 2022] DELETE /identity/v3/users/e6304231a8dd444eadb39e12f22c40ff => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:05.863752 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:05.865211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:05.879056 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113f136-e03e-4645-ad98-2cb601f6bc29 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:05.937889 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:05.938622 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:05.938829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:05.939104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] PATH_INFO: `/v3/projects/fb49e2b6909b4c1395ad71da3c6b4390` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:05.940512 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb49e2b6909b4c1395ad71da3c6b4390)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:05.942143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:05.953087 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:05.988781 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb49e2b6909b4c1395ad71da3c6b4390', 'request_id': 'req-a59e63aa-f54b-4360-b86c-70bc92eaf295'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:05.994760 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb49e2b6909b4c1395ad71da3c6b4390', 'request_id': 'req-a59e63aa-f54b-4360-b86c-70bc92eaf295'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:06.002265 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb49e2b6909b4c1395ad71da3c6b4390', 'request_id': 'req-a59e63aa-f54b-4360-b86c-70bc92eaf295'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:06.012535 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] The token cache is being invalidate because project fb49e2b6909b4c1395ad71da3c6b4390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:08:06.012901 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:06.013529 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:06.015069 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1401/2804] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:08:05 2022] DELETE /identity/v3/projects/fb49e2b6909b4c1395ad71da3c6b4390 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:06.019067 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202bdd2-e60f-4f3b-8301-a69eabb4a000 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:06.020492 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-9202bdd2-e60f-4f3b-8301-a69eabb4a000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:06.034115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202bdd2-e60f-4f3b-8301-a69eabb4a000 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:06.093902 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c5b60-ba0f-4f66-b331-d7fb3dd535df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:06.094806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c5b60-ba0f-4f66-b331-d7fb3dd535df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:06.095090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c5b60-ba0f-4f66-b331-d7fb3dd535df admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:06.095507 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c5b60-ba0f-4f66-b331-d7fb3dd535df admin admin] PATH_INFO: `/v3/users/318f3bb4e3f0431fa82900f918b2ef70` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:06.096663 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c5b60-ba0f-4f66-b331-d7fb3dd535df admin admin] RBAC: Authorizing `identity:delete_user(user_id=318f3bb4e3f0431fa82900f918b2ef70)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:06.098730 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c5b60-ba0f-4f66-b331-d7fb3dd535df admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:06.156203 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-a83c5b60-ba0f-4f66-b331-d7fb3dd535df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '318f3bb4e3f0431fa82900f918b2ef70'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:06.156930 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-a83c5b60-ba0f-4f66-b331-d7fb3dd535df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '318f3bb4e3f0431fa82900f918b2ef70'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:06.164158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-a83c5b60-ba0f-4f66-b331-d7fb3dd535df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '318f3bb4e3f0431fa82900f918b2ef70'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:06.171225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-a83c5b60-ba0f-4f66-b331-d7fb3dd535df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '318f3bb4e3f0431fa82900f918b2ef70'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:06.171862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-a83c5b60-ba0f-4f66-b331-d7fb3dd535df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '318f3bb4e3f0431fa82900f918b2ef70'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:06.188840 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1404/2805] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:08:06 2022] DELETE /identity/v3/users/318f3bb4e3f0431fa82900f918b2ef70 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:06.460811 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:06.462247 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:06.476837 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e63aa-f54b-4360-b86c-70bc92eaf295 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:06.535151 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48b58f-f849-4e6e-b526-f1b98f2310a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:06.535722 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48b58f-f849-4e6e-b526-f1b98f2310a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:06.536006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48b58f-f849-4e6e-b526-f1b98f2310a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:06.536283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48b58f-f849-4e6e-b526-f1b98f2310a3 admin admin] PATH_INFO: `/v3/projects/d7208b000da94ffba8812c14f9faa7ae` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:06.537447 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48b58f-f849-4e6e-b526-f1b98f2310a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7208b000da94ffba8812c14f9faa7ae)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:06.539431 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48b58f-f849-4e6e-b526-f1b98f2310a3 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:06.589149 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5b48b58f-f849-4e6e-b526-f1b98f2310a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7208b000da94ffba8812c14f9faa7ae', 'request_id': 'req-5b48b58f-f849-4e6e-b526-f1b98f2310a3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:06.595399 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5b48b58f-f849-4e6e-b526-f1b98f2310a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7208b000da94ffba8812c14f9faa7ae', 'request_id': 'req-5b48b58f-f849-4e6e-b526-f1b98f2310a3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:06.603453 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5b48b58f-f849-4e6e-b526-f1b98f2310a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7208b000da94ffba8812c14f9faa7ae', 'request_id': 'req-5b48b58f-f849-4e6e-b526-f1b98f2310a3'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:06.615437 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5b48b58f-f849-4e6e-b526-f1b98f2310a3 admin admin] The token cache is being invalidate because project d7208b000da94ffba8812c14f9faa7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:08:06.615729 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5b48b58f-f849-4e6e-b526-f1b98f2310a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:06.616357 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5b48b58f-f849-4e6e-b526-f1b98f2310a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:06.617860 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1402/2806] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:08:06 2022] DELETE /identity/v3/projects/d7208b000da94ffba8812c14f9faa7ae => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:06.624828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cbd5c-54fc-4fac-bbc0-6d1b9fd3fd75 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:06.625115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cbd5c-54fc-4fac-bbc0-6d1b9fd3fd75 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:06.625390 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cbd5c-54fc-4fac-bbc0-6d1b9fd3fd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:06.633824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:06.646407 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-a04cbd5c-54fc-4fac-bbc0-6d1b9fd3fd75 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:06.647649 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a04cbd5c-54fc-4fac-bbc0-6d1b9fd3fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:06.705983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1405/2807] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:06.714817 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657d9e9-1014-4f0d-9b3a-b00ffbb7b7c3 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:06.715107 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657d9e9-1014-4f0d-9b3a-b00ffbb7b7c3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:06.715386 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657d9e9-1014-4f0d-9b3a-b00ffbb7b7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:06.734841 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e657d9e9-1014-4f0d-9b3a-b00ffbb7b7c3 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:06.736038 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e657d9e9-1014-4f0d-9b3a-b00ffbb7b7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:06.743932 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1403/2808] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:06.748551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cbd5c-54fc-4fac-bbc0-6d1b9fd3fd75 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:06.758138 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cbd5c-54fc-4fac-bbc0-6d1b9fd3fd75 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:06.762635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e706d7-bb74-4f74-a677-a9e3059799fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:06.763945 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e706d7-bb74-4f74-a677-a9e3059799fb admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:06.764235 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e706d7-bb74-4f74-a677-a9e3059799fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:06.764514 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e706d7-bb74-4f74-a677-a9e3059799fb admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:06.765223 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e706d7-bb74-4f74-a677-a9e3059799fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 11:08:06.765530 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e706d7-bb74-4f74-a677-a9e3059799fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:06.767152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e706d7-bb74-4f74-a677-a9e3059799fb admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:06.779627 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1406/2809] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 11:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 11:08:06.785484 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657d9e9-1014-4f0d-9b3a-b00ffbb7b7c3 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:06.797584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657d9e9-1014-4f0d-9b3a-b00ffbb7b7c3 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:06.804039 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709ef10-b402-4480-afe9-d640dc2e6318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:06.804908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709ef10-b402-4480-afe9-d640dc2e6318 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:06.805298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709ef10-b402-4480-afe9-d640dc2e6318 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:06.805782 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709ef10-b402-4480-afe9-d640dc2e6318 admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:06.806869 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709ef10-b402-4480-afe9-d640dc2e6318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:06.810110 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709ef10-b402-4480-afe9-d640dc2e6318 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:06.839444 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:06.847769 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1404/2810] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:08:06 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:06.853010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e706d7-bb74-4f74-a677-a9e3059799fb admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:06.866665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e706d7-bb74-4f74-a677-a9e3059799fb admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:06.938424 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39af3a8-67f4-4295-8b01-1ac20cd6d113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:06.939254 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af3a8-67f4-4295-8b01-1ac20cd6d113 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:06.939720 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af3a8-67f4-4295-8b01-1ac20cd6d113 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:06.940074 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39af3a8-67f4-4295-8b01-1ac20cd6d113 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:06.940998 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39af3a8-67f4-4295-8b01-1ac20cd6d113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:06.943702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39af3a8-67f4-4295-8b01-1ac20cd6d113 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:06.971001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1407/2811] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:08:06 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:06.977709 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709ef10-b402-4480-afe9-d640dc2e6318 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:06.993410 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709ef10-b402-4480-afe9-d640dc2e6318 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:07.000899 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ec1a0-95b1-45df-9d32-4358fdcf525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:07.001661 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ec1a0-95b1-45df-9d32-4358fdcf525f admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:07.001978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ec1a0-95b1-45df-9d32-4358fdcf525f admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:07.002411 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ec1a0-95b1-45df-9d32-4358fdcf525f admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:07.003220 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ec1a0-95b1-45df-9d32-4358fdcf525f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:07.005612 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ec1a0-95b1-45df-9d32-4358fdcf525f admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:07.019841 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1405/2812] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:07.024650 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39af3a8-67f4-4295-8b01-1ac20cd6d113 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:07.037290 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39af3a8-67f4-4295-8b01-1ac20cd6d113 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:07.042210 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abfa9d-62e3-4099-b318-7edc13940e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:07.043021 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abfa9d-62e3-4099-b318-7edc13940e8e admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:07.043347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abfa9d-62e3-4099-b318-7edc13940e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:07.043721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abfa9d-62e3-4099-b318-7edc13940e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:07.045080 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abfa9d-62e3-4099-b318-7edc13940e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:07.047024 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abfa9d-62e3-4099-b318-7edc13940e8e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:07.060687 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1408/2813] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 11:08:07.064725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ec1a0-95b1-45df-9d32-4358fdcf525f admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:07.074976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ec1a0-95b1-45df-9d32-4358fdcf525f admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:07.079983 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3ba6b-ff95-4010-bee5-8fb865c7d512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:07.080649 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3ba6b-ff95-4010-bee5-8fb865c7d512 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:07.080919 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3ba6b-ff95-4010-bee5-8fb865c7d512 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:07.081199 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3ba6b-ff95-4010-bee5-8fb865c7d512 admin admin] PATH_INFO: `/v3/projects/2f693dc319ca46a8b011eb02373fa50b/users/dc126b2205a64f49a864c84f0f7f887f/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:07.102283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3ba6b-ff95-4010-bee5-8fb865c7d512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f693dc319ca46a8b011eb02373fa50b, user_id=dc126b2205a64f49a864c84f0f7f887f, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:07.105180 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3ba6b-ff95-4010-bee5-8fb865c7d512 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:07.118886 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1406/2814] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:08:07 2022] PUT /identity/v3/projects/2f693dc319ca46a8b011eb02373fa50b/users/dc126b2205a64f49a864c84f0f7f887f/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:07.131733 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c697db8-d2db-464e-b50a-4dc172b60e28 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:07.132032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c697db8-d2db-464e-b50a-4dc172b60e28 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:07.132309 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c697db8-d2db-464e-b50a-4dc172b60e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:07.161555 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-1c697db8-d2db-464e-b50a-4dc172b60e28 None None] MFA Rules not processed for user `dc126b2205a64f49a864c84f0f7f887f`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:07.162793 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1c697db8-d2db-464e-b50a-4dc172b60e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:07.225815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:07.234103 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1409/2815] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:07.235330 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3ba6b-ff95-4010-bee5-8fb865c7d512 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:07.296409 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3ba6b-ff95-4010-bee5-8fb865c7d512 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:07.300934 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1485ad-eb88-4b21-a73f-bdaa554e85ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:07.301547 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1485ad-eb88-4b21-a73f-bdaa554e85ed admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:07.301831 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1485ad-eb88-4b21-a73f-bdaa554e85ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:07.302105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1485ad-eb88-4b21-a73f-bdaa554e85ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:07.302800 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1485ad-eb88-4b21-a73f-bdaa554e85ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:07.304672 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1485ad-eb88-4b21-a73f-bdaa554e85ed admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:07.330712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1407/2816] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:08:07 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 11:08:07.334715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c697db8-d2db-464e-b50a-4dc172b60e28 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:07.346175 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c697db8-d2db-464e-b50a-4dc172b60e28 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:07.401839 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa64aa-4933-410c-a4e8-eedca0c7191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:07.402481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa64aa-4933-410c-a4e8-eedca0c7191d admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:07.402765 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa64aa-4933-410c-a4e8-eedca0c7191d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:07.403042 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa64aa-4933-410c-a4e8-eedca0c7191d admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:07.404380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa64aa-4933-410c-a4e8-eedca0c7191d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:07.406396 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa64aa-4933-410c-a4e8-eedca0c7191d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:07.428004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1410/2817] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:08:07 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:07.433337 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1485ad-eb88-4b21-a73f-bdaa554e85ed admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:07.444352 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1485ad-eb88-4b21-a73f-bdaa554e85ed admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:07.448995 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d7d46-d88d-4607-9659-9e0af1afb724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:07.449597 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d7d46-d88d-4607-9659-9e0af1afb724 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:07.449879 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d7d46-d88d-4607-9659-9e0af1afb724 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:07.450215 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d7d46-d88d-4607-9659-9e0af1afb724 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:07.451249 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d7d46-d88d-4607-9659-9e0af1afb724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:07.452859 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d7d46-d88d-4607-9659-9e0af1afb724 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:07.463536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1408/2818] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:07.468211 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa64aa-4933-410c-a4e8-eedca0c7191d admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:07.478084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa64aa-4933-410c-a4e8-eedca0c7191d admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:07.483280 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3d490-dee9-4b3f-8e03-414fd179f825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:07.483929 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3d490-dee9-4b3f-8e03-414fd179f825 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:07.484213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3d490-dee9-4b3f-8e03-414fd179f825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:07.484487 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3d490-dee9-4b3f-8e03-414fd179f825 admin admin] PATH_INFO: `/v3/projects/336f7203626e4cffb8f6d9ebae413384/users/19927c3cd9f74d478a96aa23f5809f33/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:07.500276 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3d490-dee9-4b3f-8e03-414fd179f825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=336f7203626e4cffb8f6d9ebae413384, user_id=19927c3cd9f74d478a96aa23f5809f33, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:07.502985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3d490-dee9-4b3f-8e03-414fd179f825 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:07.516396 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1411/2819] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:08:07 2022] PUT /identity/v3/projects/336f7203626e4cffb8f6d9ebae413384/users/19927c3cd9f74d478a96aa23f5809f33/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 11:08:07.520515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d7d46-d88d-4607-9659-9e0af1afb724 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:07.531165 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d7d46-d88d-4607-9659-9e0af1afb724 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:07.587403 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7b157-c34f-40eb-a9ce-b9a0b188c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:07.588017 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7b157-c34f-40eb-a9ce-b9a0b188c166 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:07.588297 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7b157-c34f-40eb-a9ce-b9a0b188c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:07.588571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7b157-c34f-40eb-a9ce-b9a0b188c166 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:07.589262 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7b157-c34f-40eb-a9ce-b9a0b188c166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:07.591602 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7b157-c34f-40eb-a9ce-b9a0b188c166 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:07.601985 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1409/2820] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 11:08:07.606449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3d490-dee9-4b3f-8e03-414fd179f825 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:07.617125 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3d490-dee9-4b3f-8e03-414fd179f825 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:07.621762 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916fd7c-651d-4830-9412-b5d6f7de6d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:07.622500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916fd7c-651d-4830-9412-b5d6f7de6d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:07.622763 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916fd7c-651d-4830-9412-b5d6f7de6d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:07.623202 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916fd7c-651d-4830-9412-b5d6f7de6d1d admin admin] PATH_INFO: `/v3/projects/336f7203626e4cffb8f6d9ebae413384/users/19927c3cd9f74d478a96aa23f5809f33/roles/36208a24005e4ff98d827138292bea37` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:07.625176 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916fd7c-651d-4830-9412-b5d6f7de6d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=336f7203626e4cffb8f6d9ebae413384, user_id=19927c3cd9f74d478a96aa23f5809f33, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:07.627846 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916fd7c-651d-4830-9412-b5d6f7de6d1d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:07.639772 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1412/2821] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:08:07 2022] PUT /identity/v3/projects/336f7203626e4cffb8f6d9ebae413384/users/19927c3cd9f74d478a96aa23f5809f33/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:07.651228 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd8f93-d648-4bd6-858d-b4ef174fdd48 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:07.651523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd8f93-d648-4bd6-858d-b4ef174fdd48 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:07.651806 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd8f93-d648-4bd6-858d-b4ef174fdd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:07.680178 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-d8dd8f93-d648-4bd6-858d-b4ef174fdd48 None None] MFA Rules not processed for user `19927c3cd9f74d478a96aa23f5809f33`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:07.681407 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d8dd8f93-d648-4bd6-858d-b4ef174fdd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:07.705976 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:07.761007 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1410/2822] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:07.772750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916fd7c-651d-4830-9412-b5d6f7de6d1d admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:07.774509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-0916fd7c-651d-4830-9412-b5d6f7de6d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:07.832969 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916fd7c-651d-4830-9412-b5d6f7de6d1d admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:07.836582 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a939dd4-4cfe-413b-ac0e-585be2d3fd9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:07.837227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a939dd4-4cfe-413b-ac0e-585be2d3fd9c service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:07.837514 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a939dd4-4cfe-413b-ac0e-585be2d3fd9c service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:07.837793 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a939dd4-4cfe-413b-ac0e-585be2d3fd9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:07.899706 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a939dd4-4cfe-413b-ac0e-585be2d3fd9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:07.901331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a939dd4-4cfe-413b-ac0e-585be2d3fd9c service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:07.912408 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1413/2823] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:08:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 11:08:10.465556 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd8f93-d648-4bd6-858d-b4ef174fdd48 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:10.527842 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd8f93-d648-4bd6-858d-b4ef174fdd48 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:10.532814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9e7fa-ba79-4aec-acc1-f0225c92cc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:10.533444 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9e7fa-ba79-4aec-acc1-f0225c92cc31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:10.533721 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9e7fa-ba79-4aec-acc1-f0225c92cc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:10.533992 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9e7fa-ba79-4aec-acc1-f0225c92cc31 admin admin] PATH_INFO: `/v3/users/dc126b2205a64f49a864c84f0f7f887f` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:10.535413 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9e7fa-ba79-4aec-acc1-f0225c92cc31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc126b2205a64f49a864c84f0f7f887f)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:10.537295 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9e7fa-ba79-4aec-acc1-f0225c92cc31 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:10.582179 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d5c9e7fa-ba79-4aec-acc1-f0225c92cc31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc126b2205a64f49a864c84f0f7f887f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:10.582848 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d5c9e7fa-ba79-4aec-acc1-f0225c92cc31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc126b2205a64f49a864c84f0f7f887f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:10.589587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d5c9e7fa-ba79-4aec-acc1-f0225c92cc31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc126b2205a64f49a864c84f0f7f887f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:10.590230 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d5c9e7fa-ba79-4aec-acc1-f0225c92cc31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc126b2205a64f49a864c84f0f7f887f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:10.598007 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-d5c9e7fa-ba79-4aec-acc1-f0225c92cc31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc126b2205a64f49a864c84f0f7f887f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:10.616287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1411/2824] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:08:10 2022] DELETE /identity/v3/users/dc126b2205a64f49a864c84f0f7f887f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:10.620901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09853f9a-1877-4821-9b6c-be56864386db None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:10.621385 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09853f9a-1877-4821-9b6c-be56864386db None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:10.621486 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09853f9a-1877-4821-9b6c-be56864386db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:10.634644 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:10.641779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-09853f9a-1877-4821-9b6c-be56864386db None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:10.643022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-09853f9a-1877-4821-9b6c-be56864386db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:10.701405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1414/2825] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:10.711080 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9e7fa-ba79-4aec-acc1-f0225c92cc31 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:10.712500 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d5c9e7fa-ba79-4aec-acc1-f0225c92cc31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:10.754850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:10.771212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9e7fa-ba79-4aec-acc1-f0225c92cc31 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:10.775219 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c391d4-8456-48f5-920a-b24078087fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:10.775935 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c391d4-8456-48f5-920a-b24078087fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:10.776279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c391d4-8456-48f5-920a-b24078087fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:10.776593 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c391d4-8456-48f5-920a-b24078087fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:10.786646 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c391d4-8456-48f5-920a-b24078087fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:10.788066 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c391d4-8456-48f5-920a-b24078087fc7 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:10.797357 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1412/2826] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:08:11.072631 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09853f9a-1877-4821-9b6c-be56864386db None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:11.074149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-09853f9a-1877-4821-9b6c-be56864386db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:11.087134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09853f9a-1877-4821-9b6c-be56864386db None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:11.092646 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:11.093300 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:11.093577 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:11.093854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] PATH_INFO: `/v3/projects/2f693dc319ca46a8b011eb02373fa50b` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:11.095192 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f693dc319ca46a8b011eb02373fa50b)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:11.097139 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:11.146467 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f693dc319ca46a8b011eb02373fa50b', 'request_id': 'req-3c345eab-f218-4ae8-a2ce-8669ba89a314'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.152665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f693dc319ca46a8b011eb02373fa50b', 'request_id': 'req-3c345eab-f218-4ae8-a2ce-8669ba89a314'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.159129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f693dc319ca46a8b011eb02373fa50b', 'request_id': 'req-3c345eab-f218-4ae8-a2ce-8669ba89a314'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.172398 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] The token cache is being invalidate because project 2f693dc319ca46a8b011eb02373fa50b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:08:11.172692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.173311 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.174852 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1415/2827] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:08:11 2022] DELETE /identity/v3/projects/2f693dc319ca46a8b011eb02373fa50b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:11.178900 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c391d4-8456-48f5-920a-b24078087fc7 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:11.188642 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c391d4-8456-48f5-920a-b24078087fc7 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:11.247271 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a700a53-6132-486f-b5e9-c8fe39562eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:11.247824 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a700a53-6132-486f-b5e9-c8fe39562eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:11.248104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a700a53-6132-486f-b5e9-c8fe39562eae admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:11.248378 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a700a53-6132-486f-b5e9-c8fe39562eae admin admin] PATH_INFO: `/v3/users/19927c3cd9f74d478a96aa23f5809f33` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:11.249542 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a700a53-6132-486f-b5e9-c8fe39562eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=19927c3cd9f74d478a96aa23f5809f33)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:11.251471 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a700a53-6132-486f-b5e9-c8fe39562eae admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:11.297317 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5a700a53-6132-486f-b5e9-c8fe39562eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19927c3cd9f74d478a96aa23f5809f33'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.297972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5a700a53-6132-486f-b5e9-c8fe39562eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19927c3cd9f74d478a96aa23f5809f33'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.305093 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5a700a53-6132-486f-b5e9-c8fe39562eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19927c3cd9f74d478a96aa23f5809f33'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.305722 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5a700a53-6132-486f-b5e9-c8fe39562eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19927c3cd9f74d478a96aa23f5809f33'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.312553 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-5a700a53-6132-486f-b5e9-c8fe39562eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19927c3cd9f74d478a96aa23f5809f33'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.331939 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1413/2828] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:08:11 2022] DELETE /identity/v3/users/19927c3cd9f74d478a96aa23f5809f33 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:11.618376 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:11.619834 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:11.633744 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c345eab-f218-4ae8-a2ce-8669ba89a314 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:11.691654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac114b-cf83-46de-be6a-a411801ad9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:11.692421 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac114b-cf83-46de-be6a-a411801ad9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:11.692710 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac114b-cf83-46de-be6a-a411801ad9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:11.692983 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac114b-cf83-46de-be6a-a411801ad9b6 admin admin] PATH_INFO: `/v3/projects/336f7203626e4cffb8f6d9ebae413384` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:11.694128 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac114b-cf83-46de-be6a-a411801ad9b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=336f7203626e4cffb8f6d9ebae413384)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:11.696090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac114b-cf83-46de-be6a-a411801ad9b6 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:11.736862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:11.751569 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f6ac114b-cf83-46de-be6a-a411801ad9b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336f7203626e4cffb8f6d9ebae413384', 'request_id': 'req-f6ac114b-cf83-46de-be6a-a411801ad9b6'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.758018 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f6ac114b-cf83-46de-be6a-a411801ad9b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336f7203626e4cffb8f6d9ebae413384', 'request_id': 'req-f6ac114b-cf83-46de-be6a-a411801ad9b6'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.764468 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f6ac114b-cf83-46de-be6a-a411801ad9b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336f7203626e4cffb8f6d9ebae413384', 'request_id': 'req-f6ac114b-cf83-46de-be6a-a411801ad9b6'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.778597 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f6ac114b-cf83-46de-be6a-a411801ad9b6 admin admin] The token cache is being invalidate because project 336f7203626e4cffb8f6d9ebae413384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:08:11.778897 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f6ac114b-cf83-46de-be6a-a411801ad9b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.779509 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f6ac114b-cf83-46de-be6a-a411801ad9b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:11.781019 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1416/2829] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:08:11 2022] DELETE /identity/v3/projects/336f7203626e4cffb8f6d9ebae413384 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:11.786429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915de3d-cf4e-4eb9-8a80-bbda36764d72 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:11.786929 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915de3d-cf4e-4eb9-8a80-bbda36764d72 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:11.787033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915de3d-cf4e-4eb9-8a80-bbda36764d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:11.810632 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-3915de3d-cf4e-4eb9-8a80-bbda36764d72 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:11.812050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3915de3d-cf4e-4eb9-8a80-bbda36764d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:11.874323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1414/2830] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:11.882069 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab53b-2850-4056-98d0-ee158f732f65 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:11.882403 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab53b-2850-4056-98d0-ee158f732f65 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:11.882684 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab53b-2850-4056-98d0-ee158f732f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:11.903901 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-1afab53b-2850-4056-98d0-ee158f732f65 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:11.905172 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1afab53b-2850-4056-98d0-ee158f732f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:11.913339 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1417/2831] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:11.917600 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915de3d-cf4e-4eb9-8a80-bbda36764d72 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:11.922525 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:11.928823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915de3d-cf4e-4eb9-8a80-bbda36764d72 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:11.934857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb68fa-64ee-4a81-a1ff-ba09751c21c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:11.935462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb68fa-64ee-4a81-a1ff-ba09751c21c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:11.935742 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb68fa-64ee-4a81-a1ff-ba09751c21c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:11.936015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb68fa-64ee-4a81-a1ff-ba09751c21c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:11.936705 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb68fa-64ee-4a81-a1ff-ba09751c21c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 11:08:11.937006 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb68fa-64ee-4a81-a1ff-ba09751c21c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:11.938638 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb68fa-64ee-4a81-a1ff-ba09751c21c1 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:11.950896 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1415/2832] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 11:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 11:08:11.955358 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab53b-2850-4056-98d0-ee158f732f65 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:11.964727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab53b-2850-4056-98d0-ee158f732f65 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:11.969501 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1534a-1005-4f8f-87ab-6607e54d65aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:11.970107 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1534a-1005-4f8f-87ab-6607e54d65aa admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:11.970430 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1534a-1005-4f8f-87ab-6607e54d65aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:11.970709 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1534a-1005-4f8f-87ab-6607e54d65aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:11.971403 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1534a-1005-4f8f-87ab-6607e54d65aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:11.973296 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1534a-1005-4f8f-87ab-6607e54d65aa admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:12.001058 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1418/2833] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:08:11 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:12.005287 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb68fa-64ee-4a81-a1ff-ba09751c21c1 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:12.016137 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb68fa-64ee-4a81-a1ff-ba09751c21c1 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:12.076863 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab50659-e21e-4ec0-8f47-e69d911b6fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:12.077509 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50659-e21e-4ec0-8f47-e69d911b6fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:12.077825 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50659-e21e-4ec0-8f47-e69d911b6fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:12.078103 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50659-e21e-4ec0-8f47-e69d911b6fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:12.078811 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab50659-e21e-4ec0-8f47-e69d911b6fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:12.080901 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab50659-e21e-4ec0-8f47-e69d911b6fe1 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:12.108307 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1416/2834] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:08:12 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:12.112478 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1534a-1005-4f8f-87ab-6607e54d65aa admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:12.123921 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1534a-1005-4f8f-87ab-6607e54d65aa admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:12.128573 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dcc2c-99a4-4d92-a024-5f645219ca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:12.129186 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dcc2c-99a4-4d92-a024-5f645219ca5c admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:12.129469 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dcc2c-99a4-4d92-a024-5f645219ca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:12.129745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282dcc2c-99a4-4d92-a024-5f645219ca5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:12.130473 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282dcc2c-99a4-4d92-a024-5f645219ca5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:12.132065 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282dcc2c-99a4-4d92-a024-5f645219ca5c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:12.142333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1419/2835] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:12.146555 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab50659-e21e-4ec0-8f47-e69d911b6fe1 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:12.157393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab50659-e21e-4ec0-8f47-e69d911b6fe1 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:12.162607 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd340a-e7fb-4811-9270-32c44f3e4552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:12.163256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd340a-e7fb-4811-9270-32c44f3e4552 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:12.163592 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd340a-e7fb-4811-9270-32c44f3e4552 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:12.163990 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd340a-e7fb-4811-9270-32c44f3e4552 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:12.164794 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd340a-e7fb-4811-9270-32c44f3e4552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:12.166538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd340a-e7fb-4811-9270-32c44f3e4552 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:12.178394 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1417/2836] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:12.183584 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dcc2c-99a4-4d92-a024-5f645219ca5c admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:12.195234 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282dcc2c-99a4-4d92-a024-5f645219ca5c admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:12.200032 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5789d9-383e-4432-b92b-dac33b7ea1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:12.200726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5789d9-383e-4432-b92b-dac33b7ea1ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:12.201006 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5789d9-383e-4432-b92b-dac33b7ea1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:12.201288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5789d9-383e-4432-b92b-dac33b7ea1ce admin admin] PATH_INFO: `/v3/projects/06d72564b68e43a597b1ee50a79fa6c8/users/fc2fb7f706e743c89663ab67c4aa0499/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:12.216654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5789d9-383e-4432-b92b-dac33b7ea1ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d72564b68e43a597b1ee50a79fa6c8, user_id=fc2fb7f706e743c89663ab67c4aa0499, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:12.219334 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5789d9-383e-4432-b92b-dac33b7ea1ce admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:12.233225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1420/2837] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:08:12 2022] PUT /identity/v3/projects/06d72564b68e43a597b1ee50a79fa6c8/users/fc2fb7f706e743c89663ab67c4aa0499/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 11:08:12.243666 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c6640-32a7-4f20-b78b-5ffa5624b719 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:12.243955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c6640-32a7-4f20-b78b-5ffa5624b719 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:12.244231 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c6640-32a7-4f20-b78b-5ffa5624b719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:12.271845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-3e1c6640-32a7-4f20-b78b-5ffa5624b719 None None] MFA Rules not processed for user `fc2fb7f706e743c89663ab67c4aa0499`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:12.272973 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3e1c6640-32a7-4f20-b78b-5ffa5624b719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:12.336229 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1418/2838] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:12.341017 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5789d9-383e-4432-b92b-dac33b7ea1ce admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:12.407245 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5789d9-383e-4432-b92b-dac33b7ea1ce admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:12.412090 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3512741-40df-43f5-9a9a-77bc8282ab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:12.412853 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3512741-40df-43f5-9a9a-77bc8282ab3d admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:12.413133 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3512741-40df-43f5-9a9a-77bc8282ab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:12.413408 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3512741-40df-43f5-9a9a-77bc8282ab3d admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:12.414107 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3512741-40df-43f5-9a9a-77bc8282ab3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:12.416025 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3512741-40df-43f5-9a9a-77bc8282ab3d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:12.443618 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1421/2839] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:08:12 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:12.447673 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c6640-32a7-4f20-b78b-5ffa5624b719 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:12.458514 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c6640-32a7-4f20-b78b-5ffa5624b719 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:12.514015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:12.521098 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f470ce-d294-425b-88c5-cb7432712558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:12.521963 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f470ce-d294-425b-88c5-cb7432712558 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:12.522208 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f470ce-d294-425b-88c5-cb7432712558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:12.522513 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f470ce-d294-425b-88c5-cb7432712558 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:12.523212 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f470ce-d294-425b-88c5-cb7432712558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:12.525156 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f470ce-d294-425b-88c5-cb7432712558 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:12.549651 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1419/2840] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:08:12 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:12.553323 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3512741-40df-43f5-9a9a-77bc8282ab3d admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:12.563787 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3512741-40df-43f5-9a9a-77bc8282ab3d admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:12.568802 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f419-418f-4ebc-9d98-7d61a57b3b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:12.569413 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f419-418f-4ebc-9d98-7d61a57b3b11 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:12.569692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f419-418f-4ebc-9d98-7d61a57b3b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:12.569962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f419-418f-4ebc-9d98-7d61a57b3b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:12.570751 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31f419-418f-4ebc-9d98-7d61a57b3b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:12.572359 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31f419-418f-4ebc-9d98-7d61a57b3b11 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:12.583257 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1422/2841] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:12.587345 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f470ce-d294-425b-88c5-cb7432712558 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:12.598016 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f470ce-d294-425b-88c5-cb7432712558 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:12.602725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568389fc-4782-42b3-be3b-c15598e92db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:12.603327 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568389fc-4782-42b3-be3b-c15598e92db0 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:12.603637 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568389fc-4782-42b3-be3b-c15598e92db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:12.603924 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568389fc-4782-42b3-be3b-c15598e92db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:12.604616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568389fc-4782-42b3-be3b-c15598e92db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:12.606972 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568389fc-4782-42b3-be3b-c15598e92db0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:12.616829 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1420/2842] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:12.620936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f419-418f-4ebc-9d98-7d61a57b3b11 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:12.630952 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f419-418f-4ebc-9d98-7d61a57b3b11 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:12.635568 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e405b-f4fa-45f7-ba10-1001298e6c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:12.636221 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e405b-f4fa-45f7-ba10-1001298e6c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:12.636511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e405b-f4fa-45f7-ba10-1001298e6c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:12.636793 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e405b-f4fa-45f7-ba10-1001298e6c60 admin admin] PATH_INFO: `/v3/projects/a69901c9fd2f42a4b1bee674c5914ce4/users/a8c5ae0596494bb6894c0e504a735274/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:12.652854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e405b-f4fa-45f7-ba10-1001298e6c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69901c9fd2f42a4b1bee674c5914ce4, user_id=a8c5ae0596494bb6894c0e504a735274, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:12.656370 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e405b-f4fa-45f7-ba10-1001298e6c60 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:12.671022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1423/2843] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:08:12 2022] PUT /identity/v3/projects/a69901c9fd2f42a4b1bee674c5914ce4/users/a8c5ae0596494bb6894c0e504a735274/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:12.682809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961e156-fff8-4160-840e-ced95751d160 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:12.683103 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961e156-fff8-4160-840e-ced95751d160 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:12.683386 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961e156-fff8-4160-840e-ced95751d160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:12.716373 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-d961e156-fff8-4160-840e-ced95751d160 None None] MFA Rules not processed for user `a8c5ae0596494bb6894c0e504a735274`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:12.717609 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d961e156-fff8-4160-840e-ced95751d160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:12.786012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1421/2844] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:12.790737 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e405b-f4fa-45f7-ba10-1001298e6c60 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:12.800250 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:12.859241 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e405b-f4fa-45f7-ba10-1001298e6c60 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:12.864000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76866c-0928-427b-b5c8-a3fb77911349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:12.864637 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76866c-0928-427b-b5c8-a3fb77911349 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:12.864920 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76866c-0928-427b-b5c8-a3fb77911349 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:12.865196 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76866c-0928-427b-b5c8-a3fb77911349 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:12.865884 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76866c-0928-427b-b5c8-a3fb77911349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:12.867854 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76866c-0928-427b-b5c8-a3fb77911349 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:12.895797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1424/2845] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:08:12 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:12.899881 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961e156-fff8-4160-840e-ced95751d160 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:12.911854 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961e156-fff8-4160-840e-ced95751d160 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:12.972105 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdeef6a-28cb-4e4d-96d3-c233531c22a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:12.972731 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdeef6a-28cb-4e4d-96d3-c233531c22a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:12.973012 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdeef6a-28cb-4e4d-96d3-c233531c22a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:12.973286 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdeef6a-28cb-4e4d-96d3-c233531c22a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:12.973977 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdeef6a-28cb-4e4d-96d3-c233531c22a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:12.975942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdeef6a-28cb-4e4d-96d3-c233531c22a4 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:12.997155 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1422/2846] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:08:12 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 11:08:13.001362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76866c-0928-427b-b5c8-a3fb77911349 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:13.013332 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76866c-0928-427b-b5c8-a3fb77911349 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:13.018005 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5456238-26d1-4834-9727-70aac7f95d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:13.018671 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5456238-26d1-4834-9727-70aac7f95d21 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:13.018950 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5456238-26d1-4834-9727-70aac7f95d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:13.019221 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5456238-26d1-4834-9727-70aac7f95d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:13.019918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5456238-26d1-4834-9727-70aac7f95d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:13.021495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5456238-26d1-4834-9727-70aac7f95d21 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:13.033152 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1425/2847] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:13.037926 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdeef6a-28cb-4e4d-96d3-c233531c22a4 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:13.048498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdeef6a-28cb-4e4d-96d3-c233531c22a4 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:13.053184 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b45d8-b41b-42ed-9a51-c6461304d4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:13.053851 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b45d8-b41b-42ed-9a51-c6461304d4bf admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:13.054135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b45d8-b41b-42ed-9a51-c6461304d4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:13.054453 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b45d8-b41b-42ed-9a51-c6461304d4bf admin admin] PATH_INFO: `/v3/projects/7fa1e104abba408da054ca1103f946cd/users/3940a9c7b3dc447cadb6b2aad40758c1/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:13.069568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b45d8-b41b-42ed-9a51-c6461304d4bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa1e104abba408da054ca1103f946cd, user_id=3940a9c7b3dc447cadb6b2aad40758c1, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:13.072300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b45d8-b41b-42ed-9a51-c6461304d4bf admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:13.091004 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1423/2848] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:08:13 2022] PUT /identity/v3/projects/7fa1e104abba408da054ca1103f946cd/users/3940a9c7b3dc447cadb6b2aad40758c1/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:13.096258 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5456238-26d1-4834-9727-70aac7f95d21 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:13.106870 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5456238-26d1-4834-9727-70aac7f95d21 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:13.168231 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94184d26-0766-4999-920c-b54532786b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:13.168956 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94184d26-0766-4999-920c-b54532786b20 admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:13.169326 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94184d26-0766-4999-920c-b54532786b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:13.169607 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94184d26-0766-4999-920c-b54532786b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:13.170333 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94184d26-0766-4999-920c-b54532786b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:13.171926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94184d26-0766-4999-920c-b54532786b20 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:13.181866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1426/2849] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:13.186085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b45d8-b41b-42ed-9a51-c6461304d4bf admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:13.196538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b45d8-b41b-42ed-9a51-c6461304d4bf admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:13.201826 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1942c07-5fb2-491f-bd3f-1b7037378a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:13.202538 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1942c07-5fb2-491f-bd3f-1b7037378a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:13.202823 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1942c07-5fb2-491f-bd3f-1b7037378a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:13.203101 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1942c07-5fb2-491f-bd3f-1b7037378a36 admin admin] PATH_INFO: `/v3/projects/7fa1e104abba408da054ca1103f946cd/users/3940a9c7b3dc447cadb6b2aad40758c1/roles/36208a24005e4ff98d827138292bea37` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:13.205075 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1942c07-5fb2-491f-bd3f-1b7037378a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa1e104abba408da054ca1103f946cd, user_id=3940a9c7b3dc447cadb6b2aad40758c1, role_id=36208a24005e4ff98d827138292bea37)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:13.207845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1942c07-5fb2-491f-bd3f-1b7037378a36 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:13.219633 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1424/2850] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:08:13 2022] PUT /identity/v3/projects/7fa1e104abba408da054ca1103f946cd/users/3940a9c7b3dc447cadb6b2aad40758c1/roles/36208a24005e4ff98d827138292bea37 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:13.230325 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab9e8b-13a6-40c7-b9a7-fe1fae391b41 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:13.230665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab9e8b-13a6-40c7-b9a7-fe1fae391b41 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:13.230986 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab9e8b-13a6-40c7-b9a7-fe1fae391b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:13.259721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-baab9e8b-13a6-40c7-b9a7-fe1fae391b41 None None] MFA Rules not processed for user `3940a9c7b3dc447cadb6b2aad40758c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:13.260925 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-baab9e8b-13a6-40c7-b9a7-fe1fae391b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:13.333966 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1427/2851] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:13.345804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1942c07-5fb2-491f-bd3f-1b7037378a36 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:13.348720 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f1942c07-5fb2-491f-bd3f-1b7037378a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:13.368855 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:13.413152 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1942c07-5fb2-491f-bd3f-1b7037378a36 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:13.416801 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9cf4c-a24c-4c99-924f-e4ced913ce02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:13.417419 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9cf4c-a24c-4c99-924f-e4ced913ce02 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:13.417703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9cf4c-a24c-4c99-924f-e4ced913ce02 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:13.417980 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9cf4c-a24c-4c99-924f-e4ced913ce02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:13.477528 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9cf4c-a24c-4c99-924f-e4ced913ce02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:13.479135 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9cf4c-a24c-4c99-924f-e4ced913ce02 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:13.488971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1425/2852] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:08:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:08:15.009247 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab9e8b-13a6-40c7-b9a7-fe1fae391b41 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:15.010797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-baab9e8b-13a6-40c7-b9a7-fe1fae391b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:15.018531 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:15.025760 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab9e8b-13a6-40c7-b9a7-fe1fae391b41 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:15.029469 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59165592-b2fb-434d-9f0d-67a9be62449a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:15.030099 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59165592-b2fb-434d-9f0d-67a9be62449a service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:15.030422 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59165592-b2fb-434d-9f0d-67a9be62449a service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:15.030701 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59165592-b2fb-434d-9f0d-67a9be62449a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:15.090602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59165592-b2fb-434d-9f0d-67a9be62449a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:15.092041 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59165592-b2fb-434d-9f0d-67a9be62449a service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:15.101831 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1428/2853] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:08:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:08:15.660839 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9cf4c-a24c-4c99-924f-e4ced913ce02 service cinder] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:15.670598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9cf4c-a24c-4c99-924f-e4ced913ce02 service cinder] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:15.674258 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8bf6a-f2d7-4f75-abc1-0958fb785657 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:15.674873 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8bf6a-f2d7-4f75-abc1-0958fb785657 service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:15.675153 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8bf6a-f2d7-4f75-abc1-0958fb785657 service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:15.675425 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8bf6a-f2d7-4f75-abc1-0958fb785657 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:15.685041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8bf6a-f2d7-4f75-abc1-0958fb785657 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:15.686483 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8bf6a-f2d7-4f75-abc1-0958fb785657 service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:15.696076 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1426/2854] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:08:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:08:19.582742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59165592-b2fb-434d-9f0d-67a9be62449a service cinder] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:19.656710 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59165592-b2fb-434d-9f0d-67a9be62449a service cinder] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:19.661616 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880d86a-16f4-4e0f-bd85-5986f8b663ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:19.662286 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880d86a-16f4-4e0f-bd85-5986f8b663ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:19.662575 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880d86a-16f4-4e0f-bd85-5986f8b663ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:19.662852 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880d86a-16f4-4e0f-bd85-5986f8b663ce admin admin] PATH_INFO: `/v3/users/fc2fb7f706e743c89663ab67c4aa0499` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:19.664013 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880d86a-16f4-4e0f-bd85-5986f8b663ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc2fb7f706e743c89663ab67c4aa0499)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:19.665934 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880d86a-16f4-4e0f-bd85-5986f8b663ce admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:19.718504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3880d86a-16f4-4e0f-bd85-5986f8b663ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2fb7f706e743c89663ab67c4aa0499'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:19.719165 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3880d86a-16f4-4e0f-bd85-5986f8b663ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2fb7f706e743c89663ab67c4aa0499'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:19.726526 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3880d86a-16f4-4e0f-bd85-5986f8b663ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2fb7f706e743c89663ab67c4aa0499'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:19.734383 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3880d86a-16f4-4e0f-bd85-5986f8b663ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2fb7f706e743c89663ab67c4aa0499'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:19.735081 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-3880d86a-16f4-4e0f-bd85-5986f8b663ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2fb7f706e743c89663ab67c4aa0499'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:19.752151 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1429/2855] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:08:19 2022] DELETE /identity/v3/users/fc2fb7f706e743c89663ab67c4aa0499 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:19.756629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b2e0e-cf88-4c40-8395-52ff1d201c08 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:19.757129 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b2e0e-cf88-4c40-8395-52ff1d201c08 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:19.757239 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b2e0e-cf88-4c40-8395-52ff1d201c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:19.776693 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-147b2e0e-cf88-4c40-8395-52ff1d201c08 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:19.778587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-147b2e0e-cf88-4c40-8395-52ff1d201c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:19.836966 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1427/2856] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:19.847886 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880d86a-16f4-4e0f-bd85-5986f8b663ce admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:19.849354 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3880d86a-16f4-4e0f-bd85-5986f8b663ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:19.871621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:19.921040 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880d86a-16f4-4e0f-bd85-5986f8b663ce admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:19.924707 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4ab4e-580d-4028-8361-fd1b05d22576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:19.925332 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ab4e-580d-4028-8361-fd1b05d22576 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:19.925611 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ab4e-580d-4028-8361-fd1b05d22576 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:19.925883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ab4e-580d-4028-8361-fd1b05d22576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:19.936547 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4ab4e-580d-4028-8361-fd1b05d22576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:19.938544 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4ab4e-580d-4028-8361-fd1b05d22576 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:19.948727 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1430/2857] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:08:20.220574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b2e0e-cf88-4c40-8395-52ff1d201c08 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:20.222279 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-147b2e0e-cf88-4c40-8395-52ff1d201c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:20.235074 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b2e0e-cf88-4c40-8395-52ff1d201c08 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:20.239918 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:20.240598 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:20.240882 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:20.241439 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] PATH_INFO: `/v3/projects/06d72564b68e43a597b1ee50a79fa6c8` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:20.242662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d72564b68e43a597b1ee50a79fa6c8)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:20.244568 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:20.295998 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d72564b68e43a597b1ee50a79fa6c8', 'request_id': 'req-83226f4f-be11-4787-ae9e-69e191aee8a1'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.302120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d72564b68e43a597b1ee50a79fa6c8', 'request_id': 'req-83226f4f-be11-4787-ae9e-69e191aee8a1'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.303841 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:20.310911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d72564b68e43a597b1ee50a79fa6c8', 'request_id': 'req-83226f4f-be11-4787-ae9e-69e191aee8a1'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.321655 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] The token cache is being invalidate because project 06d72564b68e43a597b1ee50a79fa6c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:08:20.321941 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.322587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.324082 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1428/2858] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:08:20 2022] DELETE /identity/v3/projects/06d72564b68e43a597b1ee50a79fa6c8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:20.328940 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4ab4e-580d-4028-8361-fd1b05d22576 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:20.338747 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4ab4e-580d-4028-8361-fd1b05d22576 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:20.396866 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35590a-8995-4824-8f52-b1843c366954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:20.397513 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35590a-8995-4824-8f52-b1843c366954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:20.397797 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35590a-8995-4824-8f52-b1843c366954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:20.398073 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35590a-8995-4824-8f52-b1843c366954 admin admin] PATH_INFO: `/v3/users/a8c5ae0596494bb6894c0e504a735274` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:20.399263 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35590a-8995-4824-8f52-b1843c366954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8c5ae0596494bb6894c0e504a735274)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:20.401173 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35590a-8995-4824-8f52-b1843c366954 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:20.449159 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8b35590a-8995-4824-8f52-b1843c366954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8c5ae0596494bb6894c0e504a735274'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.450560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8b35590a-8995-4824-8f52-b1843c366954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8c5ae0596494bb6894c0e504a735274'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.458129 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8b35590a-8995-4824-8f52-b1843c366954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8c5ae0596494bb6894c0e504a735274'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.465906 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8b35590a-8995-4824-8f52-b1843c366954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8c5ae0596494bb6894c0e504a735274'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.466567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-8b35590a-8995-4824-8f52-b1843c366954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8c5ae0596494bb6894c0e504a735274'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.483821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1431/2859] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:08:20 2022] DELETE /identity/v3/users/a8c5ae0596494bb6894c0e504a735274 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:20.768793 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:20.770298 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:20.784472 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83226f4f-be11-4787-ae9e-69e191aee8a1 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:20.843469 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:20.844026 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:20.844308 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:20.844587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] PATH_INFO: `/v3/projects/a69901c9fd2f42a4b1bee674c5914ce4` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:20.845747 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69901c9fd2f42a4b1bee674c5914ce4)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:20.847716 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:20.896101 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69901c9fd2f42a4b1bee674c5914ce4', 'request_id': 'req-c30dae06-70e3-43f3-9f90-2368b04a4073'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.902311 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69901c9fd2f42a4b1bee674c5914ce4', 'request_id': 'req-c30dae06-70e3-43f3-9f90-2368b04a4073'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.911083 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69901c9fd2f42a4b1bee674c5914ce4', 'request_id': 'req-c30dae06-70e3-43f3-9f90-2368b04a4073'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.921813 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] The token cache is being invalidate because project a69901c9fd2f42a4b1bee674c5914ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:08:20.922104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.922779 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:20.924304 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1429/2860] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:08:20 2022] DELETE /identity/v3/projects/a69901c9fd2f42a4b1bee674c5914ce4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 11:08:20.928402 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35590a-8995-4824-8f52-b1843c366954 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:20.929855 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-8b35590a-8995-4824-8f52-b1843c366954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:20.943654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35590a-8995-4824-8f52-b1843c366954 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:20.986346 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:21.004546 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794b402-6772-4eae-9d4f-0a35a0fa462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:21.005203 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794b402-6772-4eae-9d4f-0a35a0fa462c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:21.005490 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794b402-6772-4eae-9d4f-0a35a0fa462c admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:21.005770 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794b402-6772-4eae-9d4f-0a35a0fa462c admin admin] PATH_INFO: `/v3/users/3940a9c7b3dc447cadb6b2aad40758c1` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:21.006992 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794b402-6772-4eae-9d4f-0a35a0fa462c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3940a9c7b3dc447cadb6b2aad40758c1)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:21.008926 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794b402-6772-4eae-9d4f-0a35a0fa462c admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:21.058204 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f794b402-6772-4eae-9d4f-0a35a0fa462c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3940a9c7b3dc447cadb6b2aad40758c1'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:21.058904 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f794b402-6772-4eae-9d4f-0a35a0fa462c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3940a9c7b3dc447cadb6b2aad40758c1'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:21.066800 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f794b402-6772-4eae-9d4f-0a35a0fa462c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3940a9c7b3dc447cadb6b2aad40758c1'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:21.078579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f794b402-6772-4eae-9d4f-0a35a0fa462c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3940a9c7b3dc447cadb6b2aad40758c1'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:21.078579 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-f794b402-6772-4eae-9d4f-0a35a0fa462c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3940a9c7b3dc447cadb6b2aad40758c1'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:21.094802 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1432/2861] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:08:20 2022] DELETE /identity/v3/users/3940a9c7b3dc447cadb6b2aad40758c1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:21.384305 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:21.385729 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:21.408168 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dae06-70e3-43f3-9f90-2368b04a4073 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:21.467536 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:21.468188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:21.468474 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:21.468748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1 admin admin] PATH_INFO: `/v3/projects/7fa1e104abba408da054ca1103f946cd` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:21.469965 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa1e104abba408da054ca1103f946cd)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:21.471912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:21.488009 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:21.521921 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa1e104abba408da054ca1103f946cd', 'request_id': 'req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:21.528300 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa1e104abba408da054ca1103f946cd', 'request_id': 'req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:21.536276 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa1e104abba408da054ca1103f946cd', 'request_id': 'req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:21.546911 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1 admin admin] The token cache is being invalidate because project 7fa1e104abba408da054ca1103f946cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86616) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:08:21.547203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:21.547845 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-20c340ae-d642-4d3f-863c-d4a3a2eb35c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:21.549360 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1430/2862] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:08:21 2022] DELETE /identity/v3/projects/7fa1e104abba408da054ca1103f946cd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:21.554392 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1201-72a8-4ea6-80cf-3b69274901a3 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:21.554681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1201-72a8-4ea6-80cf-3b69274901a3 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:21.554961 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1201-72a8-4ea6-80cf-3b69274901a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:21.575991 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-2e5b1201-72a8-4ea6-80cf-3b69274901a3 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:21.577223 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-2e5b1201-72a8-4ea6-80cf-3b69274901a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:21.638451 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1433/2863] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:21.647599 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fd4de-70c8-4797-b7f7-91fb874fdf42 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:21.647888 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fd4de-70c8-4797-b7f7-91fb874fdf42 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:21.648191 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fd4de-70c8-4797-b7f7-91fb874fdf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:21.669498 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-0d0fd4de-70c8-4797-b7f7-91fb874fdf42 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:21.670745 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-0d0fd4de-70c8-4797-b7f7-91fb874fdf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:21.678868 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1431/2864] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:21.683200 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b1201-72a8-4ea6-80cf-3b69274901a3 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:21.693371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b1201-72a8-4ea6-80cf-3b69274901a3 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:21.698010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50963128-e05c-4ba4-8ac3-330c29fb060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:21.698664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963128-e05c-4ba4-8ac3-330c29fb060e admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:21.698947 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963128-e05c-4ba4-8ac3-330c29fb060e admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:21.699220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50963128-e05c-4ba4-8ac3-330c29fb060e admin admin] PATH_INFO: `/v3/domains` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:21.700057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50963128-e05c-4ba4-8ac3-330c29fb060e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86617) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 11:08:21.700393 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50963128-e05c-4ba4-8ac3-330c29fb060e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:21.701972 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50963128-e05c-4ba4-8ac3-330c29fb060e admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:21.713702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1434/2865] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 11:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 11:08:21.718653 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fd4de-70c8-4797-b7f7-91fb874fdf42 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:21.729589 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fd4de-70c8-4797-b7f7-91fb874fdf42 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:21.734817 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47be83-745b-4bff-ba8c-3b100e62a22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:21.735441 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47be83-745b-4bff-ba8c-3b100e62a22e admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:21.735725 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47be83-745b-4bff-ba8c-3b100e62a22e admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:21.736004 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47be83-745b-4bff-ba8c-3b100e62a22e admin admin] PATH_INFO: `/v3/projects` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:21.736717 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47be83-745b-4bff-ba8c-3b100e62a22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:21.738662 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47be83-745b-4bff-ba8c-3b100e62a22e admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:21.766429 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1432/2866] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:08:21 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:21.770635 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50963128-e05c-4ba4-8ac3-330c29fb060e admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:21.781758 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50963128-e05c-4ba4-8ac3-330c29fb060e admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:21.827285 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:21.841491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d2ae6-ab95-4cab-a891-f57eedd3b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:21.842112 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d2ae6-ab95-4cab-a891-f57eedd3b157 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:21.842429 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d2ae6-ab95-4cab-a891-f57eedd3b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:21.842719 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d2ae6-ab95-4cab-a891-f57eedd3b157 admin admin] PATH_INFO: `/v3/users` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:21.843380 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d2ae6-ab95-4cab-a891-f57eedd3b157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:21.845297 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d2ae6-ab95-4cab-a891-f57eedd3b157 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:21.865534 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1435/2867] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:08:21 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:21.869740 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47be83-745b-4bff-ba8c-3b100e62a22e admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:21.880755 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47be83-745b-4bff-ba8c-3b100e62a22e admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:21.885488 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448565fb-1b78-4283-a7cb-4208c1d61655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:21.886255 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448565fb-1b78-4283-a7cb-4208c1d61655 admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:21.886544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448565fb-1b78-4283-a7cb-4208c1d61655 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:21.887346 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448565fb-1b78-4283-a7cb-4208c1d61655 admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:21.888047 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448565fb-1b78-4283-a7cb-4208c1d61655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:21.889916 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448565fb-1b78-4283-a7cb-4208c1d61655 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:21.900377 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1433/2868] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 11:08:21.905337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d2ae6-ab95-4cab-a891-f57eedd3b157 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:21.916033 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d2ae6-ab95-4cab-a891-f57eedd3b157 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:21.921732 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb855b-d5c9-4c21-897b-8953d5c98dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:21.922403 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb855b-d5c9-4c21-897b-8953d5c98dbb admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:21.922693 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb855b-d5c9-4c21-897b-8953d5c98dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:21.922977 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb855b-d5c9-4c21-897b-8953d5c98dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:21.923681 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb855b-d5c9-4c21-897b-8953d5c98dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:21.925288 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb855b-d5c9-4c21-897b-8953d5c98dbb admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:21.937946 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1436/2869] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 11:08:21.942203 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448565fb-1b78-4283-a7cb-4208c1d61655 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:21.952422 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448565fb-1b78-4283-a7cb-4208c1d61655 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:21.957044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e16c1f-72b5-4e4b-aa5d-4a531d61d082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:21.957703 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e16c1f-72b5-4e4b-aa5d-4a531d61d082 admin admin] REQUEST_METHOD: `PUT` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:21.958005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e16c1f-72b5-4e4b-aa5d-4a531d61d082 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:21.958306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e16c1f-72b5-4e4b-aa5d-4a531d61d082 admin admin] PATH_INFO: `/v3/projects/6c2e707b20694eeaafc5c454faa7fe26/users/8d7cc301cdd7413c8d415149b65cb48f/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:21.973544 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e16c1f-72b5-4e4b-aa5d-4a531d61d082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2e707b20694eeaafc5c454faa7fe26, user_id=8d7cc301cdd7413c8d415149b65cb48f, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:21.976701 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e16c1f-72b5-4e4b-aa5d-4a531d61d082 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:21.990681 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1434/2870] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:08:21 2022] PUT /identity/v3/projects/6c2e707b20694eeaafc5c454faa7fe26/users/8d7cc301cdd7413c8d415149b65cb48f/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 11:08:22.001596 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd025fa1-a281-45f9-972c-8c9c5048df32 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:22.001883 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd025fa1-a281-45f9-972c-8c9c5048df32 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:22.002157 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd025fa1-a281-45f9-972c-8c9c5048df32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:22.031570 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-dd025fa1-a281-45f9-972c-8c9c5048df32 None None] MFA Rules not processed for user `8d7cc301cdd7413c8d415149b65cb48f`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:22.032812 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-dd025fa1-a281-45f9-972c-8c9c5048df32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:22.103400 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1437/2871] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:22.114650 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e16c1f-72b5-4e4b-aa5d-4a531d61d082 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:22.116330 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f1e16c1f-72b5-4e4b-aa5d-4a531d61d082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:22.175071 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e16c1f-72b5-4e4b-aa5d-4a531d61d082 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:22.178712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82231f23-d873-4079-bc28-e9a5fab3468b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:22.179333 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82231f23-d873-4079-bc28-e9a5fab3468b service cinder] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:22.179616 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82231f23-d873-4079-bc28-e9a5fab3468b service cinder] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:22.179892 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82231f23-d873-4079-bc28-e9a5fab3468b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:22.189981 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82231f23-d873-4079-bc28-e9a5fab3468b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:22.191177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82231f23-d873-4079-bc28-e9a5fab3468b service cinder] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:22.201478 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1435/2872] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:08:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:08:23.562138 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3849cd-04a2-4f97-b534-3494f33e07d6 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:23.562745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3849cd-04a2-4f97-b534-3494f33e07d6 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:23.562745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3849cd-04a2-4f97-b534-3494f33e07d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:23.589151 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-1d3849cd-04a2-4f97-b534-3494f33e07d6 None None] MFA Rules not processed for user `8d7cc301cdd7413c8d415149b65cb48f`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:23.591213 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1d3849cd-04a2-4f97-b534-3494f33e07d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:23.599362 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1438/2873] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:32.196415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:33.581972 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:39.629335 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e757818-f381-4552-a6cc-52a95e64382e None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:39.629835 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e757818-f381-4552-a6cc-52a95e64382e None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:39.629942 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e757818-f381-4552-a6cc-52a95e64382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:39.661140 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-1e757818-f381-4552-a6cc-52a95e64382e None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:39.662393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1e757818-f381-4552-a6cc-52a95e64382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:39.725428 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1436/2874] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 11:08:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:39.771852 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3849cd-04a2-4f97-b534-3494f33e07d6 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:39.773270 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-1d3849cd-04a2-4f97-b534-3494f33e07d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:39.851405 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3849cd-04a2-4f97-b534-3494f33e07d6 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:39.857087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2d3ad-52a2-4bd3-b0c4-83840ffa3307 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:39.857898 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d3ad-52a2-4bd3-b0c4-83840ffa3307 service swift] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:39.858201 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d3ad-52a2-4bd3-b0c4-83840ffa3307 service swift] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:39.858491 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d3ad-52a2-4bd3-b0c4-83840ffa3307 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:39.867880 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2d3ad-52a2-4bd3-b0c4-83840ffa3307 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:39.870916 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2d3ad-52a2-4bd3-b0c4-83840ffa3307 service swift] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:39.885088 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1439/2875] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 11:08:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 11:08:40.407292 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409c2e5-cbb5-4370-a229-23a157c43ba9 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:40.407579 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409c2e5-cbb5-4370-a229-23a157c43ba9 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:40.407850 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409c2e5-cbb5-4370-a229-23a157c43ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:40.427888 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-f409c2e5-cbb5-4370-a229-23a157c43ba9 None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:40.429104 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-f409c2e5-cbb5-4370-a229-23a157c43ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:40.436511 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1437/2876] 10.222.0.43 () {58 vars in 967 bytes} [Wed Jul 27 11:08:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:40.449218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2d3ad-52a2-4bd3-b0c4-83840ffa3307 service swift] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:40.460149 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2d3ad-52a2-4bd3-b0c4-83840ffa3307 service swift] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:40.465221 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a181b2-ccf2-46bf-ab3d-ea5c68d0c127 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:40.466454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a181b2-ccf2-46bf-ab3d-ea5c68d0c127 service swift] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:40.466736 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a181b2-ccf2-46bf-ab3d-ea5c68d0c127 service swift] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:40.467009 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a181b2-ccf2-46bf-ab3d-ea5c68d0c127 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:40.475434 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a181b2-ccf2-46bf-ab3d-ea5c68d0c127 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:40.477010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a181b2-ccf2-46bf-ab3d-ea5c68d0c127 service swift] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:40.486000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1440/2877] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 11:08:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 11:08:40.703122 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3ac50-da33-4d0b-86b5-4bc01cb15579 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:40.703595 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3ac50-da33-4d0b-86b5-4bc01cb15579 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:40.703708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3ac50-da33-4d0b-86b5-4bc01cb15579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:40.722644 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-d9a3ac50-da33-4d0b-86b5-4bc01cb15579 None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:40.723837 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-d9a3ac50-da33-4d0b-86b5-4bc01cb15579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:40.731050 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1438/2878] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jul 27 11:08:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:40.744345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a181b2-ccf2-46bf-ab3d-ea5c68d0c127 service swift] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:40.755806 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a181b2-ccf2-46bf-ab3d-ea5c68d0c127 service swift] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:40.760919 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4541520-090e-47e2-afa9-e3075c0b46e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:40.761531 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4541520-090e-47e2-afa9-e3075c0b46e4 service swift] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:40.761816 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4541520-090e-47e2-afa9-e3075c0b46e4 service swift] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:40.762093 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4541520-090e-47e2-afa9-e3075c0b46e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:40.770456 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4541520-090e-47e2-afa9-e3075c0b46e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:40.772034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4541520-090e-47e2-afa9-e3075c0b46e4 service swift] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:40.780272 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1441/2879] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 11:08:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 11:08:41.109610 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580986d-89fa-4b9b-8a58-228b47246593 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:41.109971 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580986d-89fa-4b9b-8a58-228b47246593 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:41.110354 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580986d-89fa-4b9b-8a58-228b47246593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:41.129897 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-2580986d-89fa-4b9b-8a58-228b47246593 None None] MFA Rules not processed for user `8cfba665ebb9497bad355c0c24f2ccfc`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:41.131149 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-2580986d-89fa-4b9b-8a58-228b47246593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:41.139085 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1439/2880] 10.222.0.43 () {58 vars in 967 bytes} [Wed Jul 27 11:08:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:41.154348 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4541520-090e-47e2-afa9-e3075c0b46e4 service swift] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:41.166603 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4541520-090e-47e2-afa9-e3075c0b46e4 service swift] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:41.172243 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40422eb-475f-41dc-a1ca-46b9260927cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc3b05867de6493e94c01e3c478e1d8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:41.172859 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40422eb-475f-41dc-a1ca-46b9260927cb service swift] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:41.173171 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40422eb-475f-41dc-a1ca-46b9260927cb service swift] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:41.173449 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40422eb-475f-41dc-a1ca-46b9260927cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:41.181911 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40422eb-475f-41dc-a1ca-46b9260927cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:41.183535 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40422eb-475f-41dc-a1ca-46b9260927cb service swift] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:41.192001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1442/2881] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jul 27 11:08:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 11:08:43.322470 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580986d-89fa-4b9b-8a58-228b47246593 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:43.385791 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580986d-89fa-4b9b-8a58-228b47246593 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:43.390988 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e5a56-bcc2-48a9-b01a-03b68edeaa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:43.391629 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e5a56-bcc2-48a9-b01a-03b68edeaa11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:43.391912 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e5a56-bcc2-48a9-b01a-03b68edeaa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:43.392188 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e5a56-bcc2-48a9-b01a-03b68edeaa11 admin admin] PATH_INFO: `/v3/users/8d7cc301cdd7413c8d415149b65cb48f` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:43.393480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e5a56-bcc2-48a9-b01a-03b68edeaa11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d7cc301cdd7413c8d415149b65cb48f)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:43.395415 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e5a56-bcc2-48a9-b01a-03b68edeaa11 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:43.442211 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fc3e5a56-bcc2-48a9-b01a-03b68edeaa11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d7cc301cdd7413c8d415149b65cb48f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:43.442906 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fc3e5a56-bcc2-48a9-b01a-03b68edeaa11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d7cc301cdd7413c8d415149b65cb48f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:43.450015 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fc3e5a56-bcc2-48a9-b01a-03b68edeaa11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d7cc301cdd7413c8d415149b65cb48f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:43.451348 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fc3e5a56-bcc2-48a9-b01a-03b68edeaa11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d7cc301cdd7413c8d415149b65cb48f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:43.458575 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-fc3e5a56-bcc2-48a9-b01a-03b68edeaa11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d7cc301cdd7413c8d415149b65cb48f'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:43.465554 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:43.480079 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1440/2882] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:08:43 2022] DELETE /identity/v3/users/8d7cc301cdd7413c8d415149b65cb48f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:43.486112 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98080cc-aab1-423d-991b-75d685200d87 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:43.486657 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98080cc-aab1-423d-991b-75d685200d87 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:43.486777 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98080cc-aab1-423d-991b-75d685200d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:43.505412 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-e98080cc-aab1-423d-991b-75d685200d87 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:43.506659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-e98080cc-aab1-423d-991b-75d685200d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:43.566715 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1443/2883] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:43.577347 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e5a56-bcc2-48a9-b01a-03b68edeaa11 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:43.578884 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-fc3e5a56-bcc2-48a9-b01a-03b68edeaa11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:43.636318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e5a56-bcc2-48a9-b01a-03b68edeaa11 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:43.640550 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943142c-6d8c-428c-8b51-43bfac08c2f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:43.641161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943142c-6d8c-428c-8b51-43bfac08c2f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:43.641439 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943142c-6d8c-428c-8b51-43bfac08c2f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:43.641710 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943142c-6d8c-428c-8b51-43bfac08c2f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:43.651335 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943142c-6d8c-428c-8b51-43bfac08c2f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:43.653163 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943142c-6d8c-428c-8b51-43bfac08c2f6 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:43.667177 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1441/2884] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:08:43.837061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98080cc-aab1-423d-991b-75d685200d87 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:43.838567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-e98080cc-aab1-423d-991b-75d685200d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:43.854775 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98080cc-aab1-423d-991b-75d685200d87 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:43.860628 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2650d4-79d9-479c-a8d9-72a435ce073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:43.861283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2650d4-79d9-479c-a8d9-72a435ce073b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:43.861567 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2650d4-79d9-479c-a8d9-72a435ce073b admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:43.861844 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2650d4-79d9-479c-a8d9-72a435ce073b admin admin] PATH_INFO: `/v3/projects/6c2e707b20694eeaafc5c454faa7fe26` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:43.863696 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2650d4-79d9-479c-a8d9-72a435ce073b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2e707b20694eeaafc5c454faa7fe26)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:43.865810 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2650d4-79d9-479c-a8d9-72a435ce073b admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:43.918750 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:43.922959 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9b2650d4-79d9-479c-a8d9-72a435ce073b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2e707b20694eeaafc5c454faa7fe26', 'request_id': 'req-9b2650d4-79d9-479c-a8d9-72a435ce073b'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:43.929708 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9b2650d4-79d9-479c-a8d9-72a435ce073b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2e707b20694eeaafc5c454faa7fe26', 'request_id': 'req-9b2650d4-79d9-479c-a8d9-72a435ce073b'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:43.935753 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9b2650d4-79d9-479c-a8d9-72a435ce073b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2e707b20694eeaafc5c454faa7fe26', 'request_id': 'req-9b2650d4-79d9-479c-a8d9-72a435ce073b'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:43.948010 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9b2650d4-79d9-479c-a8d9-72a435ce073b admin admin] The token cache is being invalidate because project 6c2e707b20694eeaafc5c454faa7fe26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:08:43.948432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9b2650d4-79d9-479c-a8d9-72a435ce073b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:43.949069 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-9b2650d4-79d9-479c-a8d9-72a435ce073b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:08:43.950660 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1444/2885] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:08:43 2022] DELETE /identity/v3/projects/6c2e707b20694eeaafc5c454faa7fe26 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:43.955747 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71273d12-aabd-46e2-8546-26f78c5d7e82 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:43.956044 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71273d12-aabd-46e2-8546-26f78c5d7e82 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:43.956324 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71273d12-aabd-46e2-8546-26f78c5d7e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:43.975981 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-71273d12-aabd-46e2-8546-26f78c5d7e82 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:43.977195 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-71273d12-aabd-46e2-8546-26f78c5d7e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:44.036996 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1442/2886] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 11:08:44.045462 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93f01-f901-40ed-ab4d-fbc7ac9a2712 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:44.045751 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93f01-f901-40ed-ab4d-fbc7ac9a2712 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:44.046034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93f01-f901-40ed-ab4d-fbc7ac9a2712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:44.066641 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-3eb93f01-f901-40ed-ab4d-fbc7ac9a2712 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:44.067858 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-3eb93f01-f901-40ed-ab4d-fbc7ac9a2712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:44.076115 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1445/2887] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:44.080522 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71273d12-aabd-46e2-8546-26f78c5d7e82 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:44.090309 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71273d12-aabd-46e2-8546-26f78c5d7e82 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:44.095565 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19be4e-5702-4bf8-a278-1edf7e84b22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:44.096187 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19be4e-5702-4bf8-a278-1edf7e84b22b admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:44.096473 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19be4e-5702-4bf8-a278-1edf7e84b22b admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:44.096750 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19be4e-5702-4bf8-a278-1edf7e84b22b admin admin] PATH_INFO: `/v3/domains` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:44.097452 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19be4e-5702-4bf8-a278-1edf7e84b22b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86616) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 11:08:44.097761 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19be4e-5702-4bf8-a278-1edf7e84b22b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:44.099405 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19be4e-5702-4bf8-a278-1edf7e84b22b admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:44.112452 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1443/2888] 10.222.0.43 () {58 vars in 1153 bytes} [Wed Jul 27 11:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 11:08:44.116962 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb93f01-f901-40ed-ab4d-fbc7ac9a2712 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:44.126454 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb93f01-f901-40ed-ab4d-fbc7ac9a2712 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:44.131205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0b2de-4cca-4c84-83a8-a14e05c16d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:44.131826 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0b2de-4cca-4c84-83a8-a14e05c16d07 admin admin] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:44.132110 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0b2de-4cca-4c84-83a8-a14e05c16d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:44.132387 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0b2de-4cca-4c84-83a8-a14e05c16d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:44.133071 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0b2de-4cca-4c84-83a8-a14e05c16d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:44.135007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0b2de-4cca-4c84-83a8-a14e05c16d07 admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:44.164669 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1446/2889] 10.222.0.43 () {60 vars in 1153 bytes} [Wed Jul 27 11:08:44 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 11:08:44.168464 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19be4e-5702-4bf8-a278-1edf7e84b22b admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:44.181101 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19be4e-5702-4bf8-a278-1edf7e84b22b admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:44.240856 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80c4ff-d128-4687-ad9e-a25c2562b4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:44.241480 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c4ff-d128-4687-ad9e-a25c2562b4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:44.241764 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c4ff-d128-4687-ad9e-a25c2562b4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:44.242043 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c4ff-d128-4687-ad9e-a25c2562b4b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:44.242786 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80c4ff-d128-4687-ad9e-a25c2562b4b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:44.244722 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80c4ff-d128-4687-ad9e-a25c2562b4b0 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:44.267323 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1444/2890] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jul 27 11:08:44 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 11:08:44.271427 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0b2de-4cca-4c84-83a8-a14e05c16d07 admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:44.282639 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0b2de-4cca-4c84-83a8-a14e05c16d07 admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:44.287602 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3f4b7-6e34-43f6-8618-bece6fca3e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:44.288218 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3f4b7-6e34-43f6-8618-bece6fca3e9f admin admin] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:44.288503 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3f4b7-6e34-43f6-8618-bece6fca3e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:44.288779 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3f4b7-6e34-43f6-8618-bece6fca3e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:44.289481 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3f4b7-6e34-43f6-8618-bece6fca3e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:44.291117 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3f4b7-6e34-43f6-8618-bece6fca3e9f admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:44.302894 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1447/2891] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:44.306994 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80c4ff-d128-4687-ad9e-a25c2562b4b0 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:44.317376 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80c4ff-d128-4687-ad9e-a25c2562b4b0 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:44.321928 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a99316-8b40-42cc-b292-3ba72edfc3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:44.322571 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a99316-8b40-42cc-b292-3ba72edfc3ed admin admin] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:44.323124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a99316-8b40-42cc-b292-3ba72edfc3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:44.323124 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a99316-8b40-42cc-b292-3ba72edfc3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:44.323799 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a99316-8b40-42cc-b292-3ba72edfc3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:44.325923 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a99316-8b40-42cc-b292-3ba72edfc3ed admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:44.328584 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:44.340075 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1445/2892] 10.222.0.43 () {58 vars in 1122 bytes} [Wed Jul 27 11:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 11:08:44.344815 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3f4b7-6e34-43f6-8618-bece6fca3e9f admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:44.355322 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3f4b7-6e34-43f6-8618-bece6fca3e9f admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:44.360214 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a02d54-71ed-4d8d-977a-5d831b44054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:44.361502 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02d54-71ed-4d8d-977a-5d831b44054d admin admin] REQUEST_METHOD: `PUT` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:44.361502 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02d54-71ed-4d8d-977a-5d831b44054d admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:44.361502 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02d54-71ed-4d8d-977a-5d831b44054d admin admin] PATH_INFO: `/v3/projects/110781ab107540d1bf4be3c16834429a/users/24e604ede66d439e97057e8987fb1195/roles/eef1174229014437a0db0fd8954bc25e` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:44.377070 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a02d54-71ed-4d8d-977a-5d831b44054d admin admin] RBAC: Authorizing `identity:create_grant(project_id=110781ab107540d1bf4be3c16834429a, user_id=24e604ede66d439e97057e8987fb1195, role_id=eef1174229014437a0db0fd8954bc25e)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:44.379778 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a02d54-71ed-4d8d-977a-5d831b44054d admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:44.397007 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1448/2893] 10.222.0.43 () {60 vars in 1483 bytes} [Wed Jul 27 11:08:44 2022] PUT /identity/v3/projects/110781ab107540d1bf4be3c16834429a/users/24e604ede66d439e97057e8987fb1195/roles/eef1174229014437a0db0fd8954bc25e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:08:44.402446 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3513b9-4b2f-4464-82c0-733980aba93f None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:44.402755 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3513b9-4b2f-4464-82c0-733980aba93f None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:44.403062 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3513b9-4b2f-4464-82c0-733980aba93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:44.424069 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-bd3513b9-4b2f-4464-82c0-733980aba93f None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:44.425293 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-bd3513b9-4b2f-4464-82c0-733980aba93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:44.485574 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1446/2894] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:44.498034 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a02d54-71ed-4d8d-977a-5d831b44054d admin admin] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:44.499985 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-97a02d54-71ed-4d8d-977a-5d831b44054d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:44.562927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a02d54-71ed-4d8d-977a-5d831b44054d admin admin] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:44.567030 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8754189-608d-4391-a3a5-240103300b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:44.567654 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8754189-608d-4391-a3a5-240103300b5a service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:44.567938 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8754189-608d-4391-a3a5-240103300b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:44.568216 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8754189-608d-4391-a3a5-240103300b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:44.577586 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8754189-608d-4391-a3a5-240103300b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:44.579049 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8754189-608d-4391-a3a5-240103300b5a service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:44.588741 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1449/2895] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:08:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 11:08:45.272054 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e787ad2-d512-4650-8acc-0765d1e72aaf None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:45.272462 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e787ad2-d512-4650-8acc-0765d1e72aaf None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:45.272814 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e787ad2-d512-4650-8acc-0765d1e72aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:45.303263 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-1e787ad2-d512-4650-8acc-0765d1e72aaf None None] MFA Rules not processed for user `24e604ede66d439e97057e8987fb1195`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:45.304482 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1e787ad2-d512-4650-8acc-0765d1e72aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:45.373505 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1447/2896] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:08:45.385005 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8754189-608d-4391-a3a5-240103300b5a service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:45.386444 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-d8754189-608d-4391-a3a5-240103300b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:45.448933 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8754189-608d-4391-a3a5-240103300b5a service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:45.453772 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c956965-ef43-49fc-80aa-e81841758b43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65bd5264306d4d33a2e14b01abb4364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:45.454437 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c956965-ef43-49fc-80aa-e81841758b43 service cinder] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:45.454721 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c956965-ef43-49fc-80aa-e81841758b43 service cinder] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:45.455000 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c956965-ef43-49fc-80aa-e81841758b43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:45.468702 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c956965-ef43-49fc-80aa-e81841758b43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:45.470155 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c956965-ef43-49fc-80aa-e81841758b43 service cinder] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:45.479432 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1450/2897] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:08:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:08:46.145000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e787ad2-d512-4650-8acc-0765d1e72aaf None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:08:46.146450 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1e787ad2-d512-4650-8acc-0765d1e72aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:46.239041 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e787ad2-d512-4650-8acc-0765d1e72aaf None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:08:46.244095 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5edc92-c0fd-492f-9230-eb28b9f36dc7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:08:46.244722 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5edc92-c0fd-492f-9230-eb28b9f36dc7 service placement] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:46.245005 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5edc92-c0fd-492f-9230-eb28b9f36dc7 service placement] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:46.245283 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5edc92-c0fd-492f-9230-eb28b9f36dc7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:46.247614 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1c5edc92-c0fd-492f-9230-eb28b9f36dc7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:46.259838 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5edc92-c0fd-492f-9230-eb28b9f36dc7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:08:46.261433 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5edc92-c0fd-492f-9230-eb28b9f36dc7 service placement] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:08:46.266857 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=100 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:46.274090 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1448/2898] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:08:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:08:47.042345 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de36b2-e606-413c-bcf3-f47fb92888e0 None None] REQUEST_METHOD: `POST` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:08:47.042923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de36b2-e606-413c-bcf3-f47fb92888e0 None None] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:08:47.042923 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de36b2-e606-413c-bcf3-f47fb92888e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:08:47.062493 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.auth.core [None req-67de36b2-e606-413c-bcf3-f47fb92888e0 None None] MFA Rules not processed for user `24e604ede66d439e97057e8987fb1195`. Rule list: `[]` (Enabled: `True`). {{(pid=86617) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:08:47.063705 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-67de36b2-e606-413c-bcf3-f47fb92888e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:08:47.070605 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1451/2899] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:08:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 11:08:56.270577 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:08:57.057077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:DELETE=4,keystone:SELECT=89,keystone:INSERT=3 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:09:20.773741 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869129e-57a7-4e9a-99ad-8decc7603ff3 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:09:20.774390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869129e-57a7-4e9a-99ad-8decc7603ff3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:09:20.774390 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869129e-57a7-4e9a-99ad-8decc7603ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:09:20.794224 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b869129e-57a7-4e9a-99ad-8decc7603ff3 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:09:20.795393 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b869129e-57a7-4e9a-99ad-8decc7603ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:09:20.803485 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1449/2900] 10.222.0.82 () {58 vars in 1016 bytes} [Wed Jul 27 11:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:09:20.826064 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de36b2-e606-413c-bcf3-f47fb92888e0 None None] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:09:20.827560 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-67de36b2-e606-413c-bcf3-f47fb92888e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:09:20.901782 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de36b2-e606-413c-bcf3-f47fb92888e0 None None] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:09:20.907417 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7c96f-5b5d-4614-8fc2-20ceb0284411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:09:20.908061 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7c96f-5b5d-4614-8fc2-20ceb0284411 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:09:20.908606 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7c96f-5b5d-4614-8fc2-20ceb0284411 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:09:20.908877 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7c96f-5b5d-4614-8fc2-20ceb0284411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:09:20.918158 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7c96f-5b5d-4614-8fc2-20ceb0284411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:09:20.919824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7c96f-5b5d-4614-8fc2-20ceb0284411 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:09:20.930224 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1452/2901] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:09:24.846260 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36042b76-12c2-4d10-abd3-605668b44dad None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:09:24.846821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36042b76-12c2-4d10-abd3-605668b44dad None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:09:24.846821 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36042b76-12c2-4d10-abd3-605668b44dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:09:24.867570 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-36042b76-12c2-4d10-abd3-605668b44dad None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:09:24.868781 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-36042b76-12c2-4d10-abd3-605668b44dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:09:24.877663 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1450/2902] 10.222.0.82 () {58 vars in 1016 bytes} [Wed Jul 27 11:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:09:24.899292 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7c96f-5b5d-4614-8fc2-20ceb0284411 service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:09:24.900687 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-30b7c96f-5b5d-4614-8fc2-20ceb0284411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:09:24.916537 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7c96f-5b5d-4614-8fc2-20ceb0284411 service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:09:24.924527 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828e2b6-b390-461c-b2ec-d42924298b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:09:24.925137 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828e2b6-b390-461c-b2ec-d42924298b3f service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:09:24.925416 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828e2b6-b390-461c-b2ec-d42924298b3f service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:09:24.925692 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828e2b6-b390-461c-b2ec-d42924298b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:09:24.935293 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828e2b6-b390-461c-b2ec-d42924298b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:09:24.936868 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828e2b6-b390-461c-b2ec-d42924298b3f service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:09:24.946500 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1453/2903] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:09:29.147016 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdfd8e-44ee-4046-b0fd-6d033fd270e4 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:09:29.147606 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdfd8e-44ee-4046-b0fd-6d033fd270e4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:09:29.147606 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdfd8e-44ee-4046-b0fd-6d033fd270e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:09:29.168718 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-3fbdfd8e-44ee-4046-b0fd-6d033fd270e4 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:09:29.169951 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-3fbdfd8e-44ee-4046-b0fd-6d033fd270e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:09:29.178033 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1451/2904] 10.222.0.82 () {58 vars in 1016 bytes} [Wed Jul 27 11:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:09:29.203801 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828e2b6-b390-461c-b2ec-d42924298b3f service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:09:29.220057 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828e2b6-b390-461c-b2ec-d42924298b3f service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:09:29.227828 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29781fac-b8c4-47a3-9428-8267a1eb26f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:09:29.228532 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29781fac-b8c4-47a3-9428-8267a1eb26f1 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:09:29.228826 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29781fac-b8c4-47a3-9428-8267a1eb26f1 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:09:29.229860 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29781fac-b8c4-47a3-9428-8267a1eb26f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:09:29.239233 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29781fac-b8c4-47a3-9428-8267a1eb26f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:09:29.240864 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29781fac-b8c4-47a3-9428-8267a1eb26f1 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:09:29.251523 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1454/2905] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:09:33.273210 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753c3e5-864f-4086-a627-3c3c35a1d4a5 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:09:33.273804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753c3e5-864f-4086-a627-3c3c35a1d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:09:33.273804 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753c3e5-864f-4086-a627-3c3c35a1d4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:09:33.294084 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-1753c3e5-864f-4086-a627-3c3c35a1d4a5 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:09:33.295318 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1753c3e5-864f-4086-a627-3c3c35a1d4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:09:33.303142 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1452/2906] 10.222.0.82 () {58 vars in 1016 bytes} [Wed Jul 27 11:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:09:33.325004 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29781fac-b8c4-47a3-9428-8267a1eb26f1 service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:09:33.336525 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29781fac-b8c4-47a3-9428-8267a1eb26f1 service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:09:33.342661 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529868e-d19a-4cfb-b782-3e9141d4cf19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:09:33.343268 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529868e-d19a-4cfb-b782-3e9141d4cf19 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:09:33.343554 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529868e-d19a-4cfb-b782-3e9141d4cf19 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:09:33.343832 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529868e-d19a-4cfb-b782-3e9141d4cf19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:09:33.352497 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529868e-d19a-4cfb-b782-3e9141d4cf19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:09:33.354328 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529868e-d19a-4cfb-b782-3e9141d4cf19 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:09:33.363848 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1455/2907] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:09:37.446223 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974827ce-6b82-4451-a6db-7b95c1bf2357 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:09:37.446809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974827ce-6b82-4451-a6db-7b95c1bf2357 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:09:37.446809 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974827ce-6b82-4451-a6db-7b95c1bf2357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:09:37.467586 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-974827ce-6b82-4451-a6db-7b95c1bf2357 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:09:37.468792 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-974827ce-6b82-4451-a6db-7b95c1bf2357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:09:37.476674 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1453/2908] 10.222.0.82 () {58 vars in 1016 bytes} [Wed Jul 27 11:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:09:37.498918 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529868e-d19a-4cfb-b782-3e9141d4cf19 service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:09:37.510857 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529868e-d19a-4cfb-b782-3e9141d4cf19 service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:09:37.516299 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bf2cd-6e62-4c18-a81f-c85d0edbe40a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:09:37.516907 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bf2cd-6e62-4c18-a81f-c85d0edbe40a service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:09:37.517191 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bf2cd-6e62-4c18-a81f-c85d0edbe40a service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:09:37.517468 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bf2cd-6e62-4c18-a81f-c85d0edbe40a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:09:37.526463 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bf2cd-6e62-4c18-a81f-c85d0edbe40a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:09:37.528045 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513bf2cd-6e62-4c18-a81f-c85d0edbe40a service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:09:37.537796 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1456/2909] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:09:41.633932 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbcc3e-98a9-4e02-bbac-8a2218bd21e3 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:09:41.634419 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbcc3e-98a9-4e02-bbac-8a2218bd21e3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:09:41.635066 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbcc3e-98a9-4e02-bbac-8a2218bd21e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:09:41.664743 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-e0dbcc3e-98a9-4e02-bbac-8a2218bd21e3 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:09:41.666094 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-e0dbcc3e-98a9-4e02-bbac-8a2218bd21e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:09:41.673978 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1454/2910] 10.222.0.82 () {58 vars in 1016 bytes} [Wed Jul 27 11:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:09:41.696549 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bf2cd-6e62-4c18-a81f-c85d0edbe40a service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:09:41.708687 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bf2cd-6e62-4c18-a81f-c85d0edbe40a service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:09:41.714331 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9001639-7888-4f79-991f-595adb6cf2c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:09:41.714941 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9001639-7888-4f79-991f-595adb6cf2c3 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:09:41.715227 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9001639-7888-4f79-991f-595adb6cf2c3 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:09:41.715504 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9001639-7888-4f79-991f-595adb6cf2c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:09:41.724087 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9001639-7888-4f79-991f-595adb6cf2c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:09:41.725687 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9001639-7888-4f79-991f-595adb6cf2c3 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:09:41.735670 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1457/2911] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:09:51.659061 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=18 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:09:51.731283 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=64 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:09:57.831207 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c676237-44ee-4193-9d4e-10ac4f67253c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:09:57.831748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c676237-44ee-4193-9d4e-10ac4f67253c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:09:57.831748 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c676237-44ee-4193-9d4e-10ac4f67253c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:09:57.850246 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-1c676237-44ee-4193-9d4e-10ac4f67253c None None] MFA Rules not processed for user `24e604ede66d439e97057e8987fb1195`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:09:57.851426 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-1c676237-44ee-4193-9d4e-10ac4f67253c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:09:57.858849 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1455/2912] 10.222.0.43 () {58 vars in 958 bytes} [Wed Jul 27 11:09:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:09:58.090077 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9001639-7888-4f79-991f-595adb6cf2c3 service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:09:58.100072 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9001639-7888-4f79-991f-595adb6cf2c3 service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:09:58.104205 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05585e8d-1ee0-4c28-95e2-ee9729e68a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:09:58.104819 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05585e8d-1ee0-4c28-95e2-ee9729e68a15 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:09:58.105105 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05585e8d-1ee0-4c28-95e2-ee9729e68a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:09:58.105390 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05585e8d-1ee0-4c28-95e2-ee9729e68a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:09:58.107193 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-05585e8d-1ee0-4c28-95e2-ee9729e68a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:09:58.117533 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05585e8d-1ee0-4c28-95e2-ee9729e68a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:09:58.119689 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05585e8d-1ee0-4c28-95e2-ee9729e68a15 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:09:58.128310 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1458/2913] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:09:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:10:07.845058 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=3 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:10:08.124337 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=6 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:10:12.753830 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49f6e5-0579-44db-b9e1-e0fe20e32e5c None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:10:12.754420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49f6e5-0579-44db-b9e1-e0fe20e32e5c None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:10:12.754420 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49f6e5-0579-44db-b9e1-e0fe20e32e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:10:12.774712 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-7a49f6e5-0579-44db-b9e1-e0fe20e32e5c None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:10:12.775938 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-7a49f6e5-0579-44db-b9e1-e0fe20e32e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:10:12.784343 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1456/2914] 10.222.0.82 () {58 vars in 1016 bytes} [Wed Jul 27 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:10:12.805658 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05585e8d-1ee0-4c28-95e2-ee9729e68a15 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:10:12.829726 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05585e8d-1ee0-4c28-95e2-ee9729e68a15 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:10:12.835460 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69669fbf-aeba-4d60-b6af-9b9c35ced276 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:10:12.836382 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69669fbf-aeba-4d60-b6af-9b9c35ced276 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:10:12.836665 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69669fbf-aeba-4d60-b6af-9b9c35ced276 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:10:12.836943 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69669fbf-aeba-4d60-b6af-9b9c35ced276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:10:12.845743 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69669fbf-aeba-4d60-b6af-9b9c35ced276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:10:12.847371 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69669fbf-aeba-4d60-b6af-9b9c35ced276 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:10:12.858035 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1459/2915] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:10:16.018159 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720502-2bff-48db-99f8-6f5539f3d8a7 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:10:16.018733 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720502-2bff-48db-99f8-6f5539f3d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:10:16.018865 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44720502-2bff-48db-99f8-6f5539f3d8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:10:16.039451 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-44720502-2bff-48db-99f8-6f5539f3d8a7 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:10:16.041176 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-44720502-2bff-48db-99f8-6f5539f3d8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:10:16.049158 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1457/2916] 10.222.0.82 () {58 vars in 1016 bytes} [Wed Jul 27 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:10:16.073468 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69669fbf-aeba-4d60-b6af-9b9c35ced276 service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:10:16.084896 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69669fbf-aeba-4d60-b6af-9b9c35ced276 service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:10:16.090643 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290a633-b1c5-4b51-96bf-8e739166b378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:10:16.091275 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290a633-b1c5-4b51-96bf-8e739166b378 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:10:16.091551 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290a633-b1c5-4b51-96bf-8e739166b378 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:10:16.091821 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290a633-b1c5-4b51-96bf-8e739166b378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:10:16.100236 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290a633-b1c5-4b51-96bf-8e739166b378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:10:16.102347 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290a633-b1c5-4b51-96bf-8e739166b378 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:10:16.111786 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1460/2917] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:10:20.136234 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8db32-462b-41cb-a6a2-f9488edb07a3 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:10:20.136819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8db32-462b-41cb-a6a2-f9488edb07a3 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:10:20.136819 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8db32-462b-41cb-a6a2-f9488edb07a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:10:20.157467 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-dfc8db32-462b-41cb-a6a2-f9488edb07a3 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:10:20.158728 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-dfc8db32-462b-41cb-a6a2-f9488edb07a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:10:20.167383 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1458/2918] 10.222.0.82 () {58 vars in 1016 bytes} [Wed Jul 27 11:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:10:20.189225 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290a633-b1c5-4b51-96bf-8e739166b378 service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:10:20.200431 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290a633-b1c5-4b51-96bf-8e739166b378 service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:10:20.205881 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a138279-2ff9-435c-b427-e1f71d7d97bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:10:20.206512 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a138279-2ff9-435c-b427-e1f71d7d97bf service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:10:20.206814 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a138279-2ff9-435c-b427-e1f71d7d97bf service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:10:20.207066 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a138279-2ff9-435c-b427-e1f71d7d97bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:10:20.215944 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a138279-2ff9-435c-b427-e1f71d7d97bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:10:20.217511 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a138279-2ff9-435c-b427-e1f71d7d97bf service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:10:20.227621 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1461/2919] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:10:24.359679 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768398-1771-45e0-8592-ca2c8e4176dd None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:10:24.360273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768398-1771-45e0-8592-ca2c8e4176dd None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:10:24.360273 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5768398-1771-45e0-8592-ca2c8e4176dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:10:24.380331 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-c5768398-1771-45e0-8592-ca2c8e4176dd None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:10:24.381541 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-c5768398-1771-45e0-8592-ca2c8e4176dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:10:24.389587 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1459/2920] 10.222.0.82 () {58 vars in 1016 bytes} [Wed Jul 27 11:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:10:24.410789 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a138279-2ff9-435c-b427-e1f71d7d97bf service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:10:24.422691 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a138279-2ff9-435c-b427-e1f71d7d97bf service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:10:24.428134 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47ab34-8cbd-4ef3-9215-ed3ded3c2847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:10:24.428742 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47ab34-8cbd-4ef3-9215-ed3ded3c2847 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:10:24.429162 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47ab34-8cbd-4ef3-9215-ed3ded3c2847 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:10:24.429448 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47ab34-8cbd-4ef3-9215-ed3ded3c2847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:10:24.437845 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47ab34-8cbd-4ef3-9215-ed3ded3c2847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:10:24.439471 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47ab34-8cbd-4ef3-9215-ed3ded3c2847 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:10:24.449244 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1462/2921] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:10:28.526120 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2065204-7c9d-4cb2-8b7c-b6cd1b330cc4 None None] REQUEST_METHOD: `POST` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:10:28.526698 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2065204-7c9d-4cb2-8b7c-b6cd1b330cc4 None None] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:10:28.526817 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2065204-7c9d-4cb2-8b7c-b6cd1b330cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:10:28.546615 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.auth.core [None req-b2065204-7c9d-4cb2-8b7c-b6cd1b330cc4 None None] MFA Rules not processed for user `877c11b74f674bd1b8410ffe1d18db3e`. Rule list: `[]` (Enabled: `True`). {{(pid=86616) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 11:10:28.547816 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-b2065204-7c9d-4cb2-8b7c-b6cd1b330cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:10:28.556684 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1460/2922] 10.222.0.82 () {58 vars in 1016 bytes} [Wed Jul 27 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 11:10:28.587921 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47ab34-8cbd-4ef3-9215-ed3ded3c2847 service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:10:28.599402 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47ab34-8cbd-4ef3-9215-ed3ded3c2847 service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:10:28.605598 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5851f3-24cb-45fb-bea9-dc602f88bc43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb16c9232464cc2aeee12b7fa918b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:10:28.606269 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5851f3-24cb-45fb-bea9-dc602f88bc43 service nova] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:10:28.606557 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5851f3-24cb-45fb-bea9-dc602f88bc43 service nova] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:10:28.606835 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5851f3-24cb-45fb-bea9-dc602f88bc43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:10:28.616825 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5851f3-24cb-45fb-bea9-dc602f88bc43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:10:28.618465 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5851f3-24cb-45fb-bea9-dc602f88bc43 service nova] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:10:28.628289 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1463/2923] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:10:35.237736 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2065204-7c9d-4cb2-8b7c-b6cd1b330cc4 None None] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:10:35.248306 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2065204-7c9d-4cb2-8b7c-b6cd1b330cc4 None None] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:10:35.251858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a9a51-3862-4e61-a67b-a2a1389bf787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:10:35.252473 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a9a51-3862-4e61-a67b-a2a1389bf787 service neutron] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:10:35.252757 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a9a51-3862-4e61-a67b-a2a1389bf787 service neutron] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:10:35.253034 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a9a51-3862-4e61-a67b-a2a1389bf787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:10:35.254828 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-ea7a9a51-3862-4e61-a67b-a2a1389bf787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:10:35.282515 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a9a51-3862-4e61-a67b-a2a1389bf787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:10:35.283969 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a9a51-3862-4e61-a67b-a2a1389bf787 service neutron] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:10:35.295858 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1461/2924] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:10:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:10:36.474022 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5851f3-24cb-45fb-bea9-dc602f88bc43 service nova] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:10:36.484659 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5851f3-24cb-45fb-bea9-dc602f88bc43 service nova] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:10:36.488261 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0bd8f-643e-44d6-80d0-e651ea767928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b33631df63d4657a8e2ad108ca9f670', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:10:36.488862 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0bd8f-643e-44d6-80d0-e651ea767928 service neutron] REQUEST_METHOD: `GET` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:10:36.489145 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0bd8f-643e-44d6-80d0-e651ea767928 service neutron] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:10:36.489423 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0bd8f-643e-44d6-80d0-e651ea767928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:10:36.491181 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.fernet_utils [None req-a7d0bd8f-643e-44d6-80d0-e651ea767928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86617) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:10:36.504417 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0bd8f-643e-44d6-80d0-e651ea767928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:10:36.505824 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0bd8f-643e-44d6-80d0-e651ea767928 service neutron] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:10:36.516910 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1464/2925] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:10:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:10:45.290908 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=26 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:10:46.511972 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=40 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:10:59.794499 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a9a51-3862-4e61-a67b-a2a1389bf787 service neutron] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:10:59.805256 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a9a51-3862-4e61-a67b-a2a1389bf787 service neutron] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:10:59.809674 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006079d-61f3-4543-8071-46714f3fe7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:10:59.810341 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006079d-61f3-4543-8071-46714f3fe7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:10:59.810622 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006079d-61f3-4543-8071-46714f3fe7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:10:59.810894 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006079d-61f3-4543-8071-46714f3fe7e3 admin admin] PATH_INFO: `/v3/users/24e604ede66d439e97057e8987fb1195` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:10:59.812161 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006079d-61f3-4543-8071-46714f3fe7e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e604ede66d439e97057e8987fb1195)` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:10:59.813955 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006079d-61f3-4543-8071-46714f3fe7e3 admin admin] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:10:59.861131 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7006079d-61f3-4543-8071-46714f3fe7e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e604ede66d439e97057e8987fb1195'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:10:59.861780 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7006079d-61f3-4543-8071-46714f3fe7e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e604ede66d439e97057e8987fb1195'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:10:59.868887 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7006079d-61f3-4543-8071-46714f3fe7e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e604ede66d439e97057e8987fb1195'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:10:59.869523 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7006079d-61f3-4543-8071-46714f3fe7e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e604ede66d439e97057e8987fb1195'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:10:59.876797 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.notifications [None req-7006079d-61f3-4543-8071-46714f3fe7e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e604ede66d439e97057e8987fb1195'} {{(pid=86616) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:10:59.895000 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1462/2926] 10.222.0.43 () {58 vars in 1224 bytes} [Wed Jul 27 11:10:59 2022] DELETE /identity/v3/users/24e604ede66d439e97057e8987fb1195 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:11:00.071745 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0bd8f-643e-44d6-80d0-e651ea767928 service neutron] Authenticating user token {{(pid=86617) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:11:00.082664 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0bd8f-643e-44d6-80d0-e651ea767928 service neutron] Validating token access rules against request {{(pid=86617) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:11:00.142294 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e072d-665b-4da9-9352-f7aaa795df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '877c11b74f674bd1b8410ffe1d18db3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c0fb163aada45c0be9fae56f3795bdd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86617) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:11:00.142936 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e072d-665b-4da9-9352-f7aaa795df2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:11:00.143220 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e072d-665b-4da9-9352-f7aaa795df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:11:00.143495 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e072d-665b-4da9-9352-f7aaa795df2a admin admin] PATH_INFO: `/v3/projects/110781ab107540d1bf4be3c16834429a` {{(pid=86617) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:11:00.144642 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e072d-665b-4da9-9352-f7aaa795df2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=110781ab107540d1bf4be3c16834429a)` {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:11:00.147084 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e072d-665b-4da9-9352-f7aaa795df2a admin admin] RBAC: Authorization granted {{(pid=86617) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:11:00.193829 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bd0e072d-665b-4da9-9352-f7aaa795df2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '110781ab107540d1bf4be3c16834429a', 'request_id': 'req-bd0e072d-665b-4da9-9352-f7aaa795df2a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:11:00.199927 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bd0e072d-665b-4da9-9352-f7aaa795df2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '110781ab107540d1bf4be3c16834429a', 'request_id': 'req-bd0e072d-665b-4da9-9352-f7aaa795df2a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:11:00.205373 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bd0e072d-665b-4da9-9352-f7aaa795df2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '110781ab107540d1bf4be3c16834429a', 'request_id': 'req-bd0e072d-665b-4da9-9352-f7aaa795df2a'} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:11:00.218091 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bd0e072d-665b-4da9-9352-f7aaa795df2a admin admin] The token cache is being invalidate because project 110781ab107540d1bf4be3c16834429a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86617) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 11:11:00.218415 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bd0e072d-665b-4da9-9352-f7aaa795df2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:11:00.219036 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG keystone.notifications [None req-bd0e072d-665b-4da9-9352-f7aaa795df2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86617) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 11:11:00.220575 dv-cinder-850840-3-smb devstack@keystone.service[86617]: [pid: 86617|app: 0|req: 1465/2927] 10.222.0.43 () {58 vars in 1233 bytes} [Wed Jul 27 11:11:00 2022] DELETE /identity/v3/projects/110781ab107540d1bf4be3c16834429a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 11:11:09.891361 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:11:10.215001 dv-cinder-850840-3-smb devstack@keystone.service[86617]: DEBUG dbcounter [-] [86617] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 11:13:51.148143 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006079d-61f3-4543-8071-46714f3fe7e3 admin admin] Authenticating user token {{(pid=86616) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 11:13:51.149563 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-7006079d-61f3-4543-8071-46714f3fe7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:13:51.219630 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006079d-61f3-4543-8071-46714f3fe7e3 admin admin] Validating token access rules against request {{(pid=86616) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 11:13:51.281438 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662eb24-f2c0-468c-8027-becbb388a2a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39830a354dee41b5b210d80807886299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52e68e1a140146e28b504864955367c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86616) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 11:13:51.282289 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662eb24-f2c0-468c-8027-becbb388a2a8 service placement] REQUEST_METHOD: `GET` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 11:13:51.282578 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662eb24-f2c0-468c-8027-becbb388a2a8 service placement] SCRIPT_NAME: `/identity` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 11:13:51.282884 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662eb24-f2c0-468c-8027-becbb388a2a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86616) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 11:13:51.284699 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.fernet_utils [None req-9662eb24-f2c0-468c-8027-becbb388a2a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86616) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 11:13:51.295885 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662eb24-f2c0-468c-8027-becbb388a2a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 11:13:51.298051 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662eb24-f2c0-468c-8027-becbb388a2a8 service placement] RBAC: Authorization granted {{(pid=86616) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 11:13:51.308021 dv-cinder-850840-3-smb devstack@keystone.service[86616]: [pid: 86616|app: 0|req: 1463/2928] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jul 27 11:13:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 11:14:01.303708 dv-cinder-850840-3-smb devstack@keystone.service[86616]: DEBUG dbcounter [-] [86616] Writing DB stats keystone:SELECT=58 {{(pid=86616) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}